Jun 12 18:28:30.006000 ip-10-0-143-164 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 18:28:30.006012 ip-10-0-143-164 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 18:28:30.006019 ip-10-0-143-164 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 18:28:30.006288 ip-10-0-143-164 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 18:28:40.248757 ip-10-0-143-164 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 18:28:40.248773 ip-10-0-143-164 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4b8232682ea54a2c9ce6a9ca62d9a309 -- Jun 12 18:30:54.938870 ip-10-0-143-164 systemd[1]: Starting Kubernetes Kubelet... Jun 12 18:30:55.346959 ip-10-0-143-164 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:30:55.346959 ip-10-0-143-164 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 18:30:55.346959 ip-10-0-143-164 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:30:55.346959 ip-10-0-143-164 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 18:30:55.347600 ip-10-0-143-164 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:30:55.347600 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.347029 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 18:30:55.352426 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352410 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:55.352426 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352426 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352430 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352433 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352436 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352439 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352443 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352447 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352450 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352453 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352455 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352458 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352461 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352464 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352467 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352470 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352473 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352475 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352478 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352481 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352485 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:55.352490 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352487 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352490 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352492 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352495 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352498 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352501 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352504 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352507 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352509 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352512 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352514 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352517 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352520 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352523 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352526 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352529 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352531 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352534 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352537 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352540 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:55.352990 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352542 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352544 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352549 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352553 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352556 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352559 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352563 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352567 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352569 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352591 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352595 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352597 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352600 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352603 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352606 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352610 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352613 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352615 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352618 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:55.353478 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352620 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352623 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352626 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352629 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352632 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352635 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352638 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352641 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352644 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352647 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352650 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352654 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352657 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352659 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352663 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352665 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352668 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352671 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352674 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:55.354091 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352677 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352679 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352682 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352684 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352687 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352689 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352693 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352696 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352699 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352702 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352705 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352707 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352710 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352713 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352715 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352718 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352720 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352723 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352725 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:55.354560 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.352728 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.354984 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.354993 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.354996 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.354999 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355003 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355006 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355009 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355011 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355014 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355017 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355020 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355022 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355025 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355027 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355030 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355033 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355036 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355039 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:55.355034 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355041 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355045 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355048 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355050 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355053 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355055 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355058 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355060 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355063 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355065 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355068 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355070 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355072 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355075 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355077 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355080 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355082 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355085 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355087 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355090 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:55.355514 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355093 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355095 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355098 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355101 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355103 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355105 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355108 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355110 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355113 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355115 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355118 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355120 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355123 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355129 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355133 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355136 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355139 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355144 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355147 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:55.356030 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355150 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355153 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355156 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355158 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355161 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355164 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355167 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355169 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355172 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355174 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355177 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355179 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355183 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355187 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355190 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355193 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355196 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355198 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355201 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355204 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:55.356504 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355207 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355209 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355211 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355214 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355217 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355219 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355222 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355225 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355228 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355230 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355233 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355235 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355238 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355241 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355243 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355245 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355248 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355251 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355253 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355256 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:55.357008 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355258 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355260 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355639 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355645 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355648 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355650 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355656 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355660 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355663 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355666 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355669 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355671 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355674 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355677 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355680 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355682 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355685 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355688 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355690 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355694 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:55.357500 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355696 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355699 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355702 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355705 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355708 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355711 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355713 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355716 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355718 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355721 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355724 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355727 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355729 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355732 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355734 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355737 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355739 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355742 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355745 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355748 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:55.358004 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355751 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355754 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355756 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355758 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355761 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355763 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355766 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355768 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355771 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355773 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355776 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355779 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355782 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355785 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355788 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355792 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355795 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355798 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355800 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:55.358492 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355803 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355806 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355809 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355811 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355815 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355817 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355820 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355822 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355825 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355827 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355830 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355832 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355835 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355838 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355842 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355846 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355849 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355851 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355854 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:55.359015 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355857 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355859 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355862 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355865 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355868 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355870 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355873 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355876 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355878 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355881 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355883 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355917 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355920 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355923 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355925 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355928 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355931 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355934 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355936 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355939 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:55.359501 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355941 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355944 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.355946 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356024 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356040 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356046 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356050 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356055 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356058 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356062 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356066 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356069 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356073 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356076 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356079 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356085 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356088 2564 flags.go:64] FLAG: --cgroup-root="" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356091 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356094 2564 flags.go:64] FLAG: --client-ca-file="" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356097 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356100 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356105 2564 flags.go:64] FLAG: --cluster-domain="" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356108 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 18:30:55.359995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356112 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356115 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356118 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356122 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356125 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356128 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356131 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356134 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356137 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356140 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356143 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356146 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356150 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356153 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356155 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356159 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356162 2564 flags.go:64] FLAG: --enable-server="true" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356165 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356170 2564 flags.go:64] FLAG: --event-burst="100" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356173 2564 flags.go:64] FLAG: --event-qps="50" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356176 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356179 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356181 2564 flags.go:64] FLAG: --eviction-hard="" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356185 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 18:30:55.360553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356190 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356193 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356196 2564 flags.go:64] FLAG: --eviction-soft="" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356199 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356202 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356204 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356207 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356210 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356213 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356216 2564 flags.go:64] FLAG: --feature-gates="" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356220 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356223 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356226 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356229 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356232 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356235 2564 flags.go:64] FLAG: --help="false" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356238 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356241 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356244 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356247 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356250 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356253 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356256 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 18:30:55.361156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356259 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356262 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356264 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356267 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356270 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356273 2564 flags.go:64] FLAG: --kube-reserved="" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356276 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356279 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356282 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356286 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356289 2564 flags.go:64] FLAG: --lock-file="" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356292 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356295 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356298 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356303 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356306 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356309 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356312 2564 flags.go:64] FLAG: --logging-format="text" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356314 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356318 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356321 2564 flags.go:64] FLAG: --manifest-url="" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356324 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356328 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356331 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356335 2564 flags.go:64] FLAG: --max-pods="110" Jun 12 18:30:55.361764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356338 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356341 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356344 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356347 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356350 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356353 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356356 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356362 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356365 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356368 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356371 2564 flags.go:64] FLAG: --pod-cidr="" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356374 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356380 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356383 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356386 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356389 2564 flags.go:64] FLAG: --port="10250" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356397 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356400 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f9abf9bf028c110e" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356403 2564 flags.go:64] FLAG: --qos-reserved="" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356406 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356409 2564 flags.go:64] FLAG: --register-node="true" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356412 2564 flags.go:64] FLAG: --register-with-taints="" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356415 2564 flags.go:64] FLAG: --registry-burst="10" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356418 2564 flags.go:64] FLAG: --registry-qps="5" Jun 12 18:30:55.362412 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356421 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356424 2564 flags.go:64] FLAG: --reserved-memory="" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356428 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356430 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356433 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356436 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356439 2564 flags.go:64] FLAG: --runonce="false" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356442 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356445 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356448 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356451 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356454 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356457 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356460 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356463 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356466 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356469 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356471 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356474 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356477 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356480 2564 flags.go:64] FLAG: --system-cgroups="" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356483 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356488 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356491 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356499 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 18:30:55.363014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356504 2564 flags.go:64] FLAG: --tls-min-version="" Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356507 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356510 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356513 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356516 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356519 2564 flags.go:64] FLAG: --v="2" Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356523 2564 flags.go:64] FLAG: --version="false" Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356527 2564 flags.go:64] FLAG: --vmodule="" Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356530 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.356534 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356666 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356671 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356675 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356678 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356681 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356684 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356688 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356690 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356693 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356696 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356699 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:55.363650 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356701 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356704 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356706 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356709 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356712 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356714 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356717 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356720 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356723 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356726 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356731 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356734 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356736 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356739 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356742 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356745 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356747 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356750 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356752 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356755 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:55.364158 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356757 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356760 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356763 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356765 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356768 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356770 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356773 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356776 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356778 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356781 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356783 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356786 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356788 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356791 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356795 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356798 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356801 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356804 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356807 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356810 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:55.364659 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356813 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356816 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356822 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356824 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356827 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356830 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356832 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356835 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356838 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356840 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356843 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356846 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356848 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356852 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356855 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356858 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356861 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356864 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356867 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:55.365160 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356870 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356872 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356875 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356878 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356880 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356883 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356885 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356888 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356891 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356893 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356896 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356899 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356901 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356904 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356907 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356912 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356915 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356917 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356920 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356922 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:55.365656 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356925 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356928 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356930 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356933 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356935 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356938 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356941 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356944 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.356946 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.357547 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.364403 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.364512 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.364532 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.364538 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364610 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:55.366159 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364616 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364619 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364623 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364626 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364629 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364632 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364636 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364639 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364643 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364647 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364650 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364653 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364656 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364659 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364662 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364666 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364670 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364673 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364675 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:55.366543 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364678 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364681 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364683 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364686 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364689 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364691 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364694 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364696 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364699 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364703 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364706 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364709 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364711 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364714 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364717 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364719 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364722 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364724 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364727 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364729 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:55.367026 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364732 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364735 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364737 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364740 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364742 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364745 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364747 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364750 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364754 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364757 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364760 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364763 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364766 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364769 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364772 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364774 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364777 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364780 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364783 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:55.367528 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364785 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364787 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364791 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364795 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364797 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364800 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364802 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364805 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364808 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364810 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364813 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364815 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364818 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364820 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364823 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364826 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364828 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364831 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364834 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364836 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:55.368048 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364839 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364842 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364845 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364848 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364850 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364853 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364856 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364858 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364861 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364863 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364866 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364868 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364871 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364874 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364877 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364879 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364882 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364885 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364888 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:55.368540 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.364890 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.364895 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365007 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365012 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365015 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365018 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365021 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365023 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365026 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365029 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365031 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365034 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365037 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365039 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365042 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:55.369009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365045 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365048 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365052 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365056 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365059 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365062 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365065 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365068 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365071 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365075 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365078 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365081 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365084 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365086 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365089 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365092 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365095 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365097 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365099 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365102 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:55.369378 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365104 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365107 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365109 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365112 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365115 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365118 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365120 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365123 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365125 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365127 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365130 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365133 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365135 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365138 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365141 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365144 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365146 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365149 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365151 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:55.370009 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365155 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365158 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365161 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365164 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365167 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365170 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365172 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365175 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365178 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365181 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365183 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365185 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365188 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365190 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365193 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365195 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365198 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365200 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365203 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365205 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:55.370475 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365207 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365210 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365212 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365215 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365217 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365220 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365222 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365225 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365229 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365232 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365235 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365237 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365240 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365242 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365245 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365247 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365250 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365253 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365256 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365258 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:55.370960 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365261 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365263 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365266 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365268 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365271 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365273 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:55.365276 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.365281 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.365394 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.368316 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.369863 2564 server.go:1019] "Starting client certificate rotation" Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.369965 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:30:55.371448 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.370027 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:30:55.372779 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.372766 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:30:55.378761 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.378737 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:30:55.388759 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.388742 2564 log.go:25] "Validated CRI v1 runtime API" Jun 12 18:30:55.392047 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.392032 2564 log.go:25] "Validated CRI v1 image API" Jun 12 18:30:55.393617 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.393588 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 18:30:55.398349 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.398324 2564 fs.go:135] Filesystem UUIDs: map[2bdf91d0-5295-4072-94ee-e125b2e615b9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bb4776ab-9e34-4c01-a5a2-2a18d510ca3c:/dev/nvme0n1p4] Jun 12 18:30:55.398398 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.398349 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 18:30:55.401556 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.401539 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:30:55.403730 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.403626 2564 manager.go:216] Machine: {Timestamp:2026-06-12 18:30:55.402152291 +0000 UTC m=+0.340914278 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098133 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e1e5adf63f40c0f03b937e6942f26 SystemUUID:ec2e1e5a-df63-f40c-0f03-b937e6942f26 BootID:4b823268-2ea5-4a2c-9ce6-a9ca62d9a309 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:42:38:23:2d:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:42:38:23:2d:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:a0:e9:42:14:35 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 18:30:55.403730 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.403725 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 18:30:55.403842 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.403834 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 18:30:55.406749 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.406728 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 18:30:55.406881 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.406752 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-164.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 18:30:55.407402 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.407393 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 18:30:55.407433 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.407404 2564 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 18:30:55.407433 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.407417 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:30:55.408002 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.407992 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:30:55.409277 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.409268 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 18:30:55.412285 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.412273 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:30:55.412389 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.412380 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 18:30:55.412423 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.412408 2564 kubelet.go:486] "Attempting to sync node with API server" Jun 12 18:30:55.412454 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.412426 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 18:30:55.412454 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.412445 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 18:30:55.412506 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.412458 2564 kubelet.go:398] "Adding apiserver pod source" Jun 12 18:30:55.412506 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.412481 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 18:30:55.412856 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.412845 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:30:55.412901 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.412861 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:30:55.416030 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.416010 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 18:30:55.417769 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.417748 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 18:30:55.417811 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.417786 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 18:30:55.417953 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.417943 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 18:30:55.417996 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.417958 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 18:30:55.417996 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.417964 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 18:30:55.417996 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.417969 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 18:30:55.417996 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.417977 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 18:30:55.417996 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.417982 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 18:30:55.418847 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.418838 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 18:30:55.418847 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.418847 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 18:30:55.418913 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.418854 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 18:30:55.418913 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.418860 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 18:30:55.418913 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.418868 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 18:30:55.418913 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.418876 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 18:30:55.419496 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.419486 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 18:30:55.419496 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.419496 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 18:30:55.422753 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.422739 2564 server.go:1268] "Started kubelet" Jun 12 18:30:55.425748 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.425684 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 18:30:55.425823 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.422865 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 18:30:55.425871 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.425831 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 18:30:55.426382 ip-10-0-143-164 systemd[1]: Started Kubernetes Kubelet. Jun 12 18:30:55.427664 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.427644 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 18:30:55.428842 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.428823 2564 server.go:310] "Adding debug handlers to kubelet server" Jun 12 18:30:55.429614 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.429585 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 18:30:55.429710 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.429634 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 18:30:55.429710 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.429687 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-164.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 18:30:55.433358 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.433340 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 18:30:55.433439 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.433357 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 18:30:55.433505 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.433488 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:55.433857 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.432964 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-164.ec2.internal.18b868f54ec2ef2b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-164.ec2.internal,UID:ip-10-0-143-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-164.ec2.internal,},FirstTimestamp:2026-06-12 18:30:55.422705451 +0000 UTC m=+0.361467439,LastTimestamp:2026-06-12 18:30:55.422705451 +0000 UTC m=+0.361467439,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-164.ec2.internal,}" Jun 12 18:30:55.434103 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434078 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 18:30:55.434103 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434104 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 18:30:55.434233 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434198 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 12 18:30:55.434233 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434209 2564 reconciler.go:29] "Reconciler: start to sync state" Jun 12 18:30:55.434323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434237 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 18:30:55.434373 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434348 2564 factory.go:55] Registering systemd factory Jun 12 18:30:55.434373 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434363 2564 factory.go:223] Registration of the systemd container factory successfully Jun 12 18:30:55.434621 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434608 2564 factory.go:153] Registering CRI-O factory Jun 12 18:30:55.434621 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434623 2564 factory.go:223] Registration of the crio container factory successfully Jun 12 18:30:55.434704 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434670 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 18:30:55.434704 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434694 2564 factory.go:103] Registering Raw factory Jun 12 18:30:55.434758 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.434707 2564 manager.go:1196] Started watching for new ooms in manager Jun 12 18:30:55.435087 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.435074 2564 manager.go:349] Starting recovery of all containers Jun 12 18:30:55.436549 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.436510 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 18:30:55.440781 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.440755 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 12 18:30:55.440868 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.440848 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 12 18:30:55.446222 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.446207 2564 manager.go:354] Recovery completed Jun 12 18:30:55.450381 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.450369 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:55.452284 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.452252 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:55.452359 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.452299 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:55.452359 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.452312 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:55.452817 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.452802 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 18:30:55.452887 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.452816 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 18:30:55.452887 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.452837 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:30:55.452887 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.452848 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:55.453537 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.453521 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:55.453612 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.453547 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:55.453612 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.453558 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:55.454089 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.454076 2564 policy_none.go:49] "None policy: Start" Jun 12 18:30:55.454145 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.454095 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 18:30:55.454145 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.454108 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 18:30:55.455072 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.455058 2564 policy_none.go:47] "Start" Jun 12 18:30:55.456456 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.456383 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-164.ec2.internal.18b868f55086427a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-164.ec2.internal,UID:ip-10-0-143-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-164.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-164.ec2.internal,},FirstTimestamp:2026-06-12 18:30:55.452283514 +0000 UTC m=+0.391045500,LastTimestamp:2026-06-12 18:30:55.452283514 +0000 UTC m=+0.391045500,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-164.ec2.internal,}" Jun 12 18:30:55.472060 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.472042 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d8fvp" Jun 12 18:30:55.477888 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.477801 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-164.ec2.internal.18b868f550869e87 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-164.ec2.internal,UID:ip-10-0-143-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-164.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-164.ec2.internal,},FirstTimestamp:2026-06-12 18:30:55.452307079 +0000 UTC m=+0.391069065,LastTimestamp:2026-06-12 18:30:55.452307079 +0000 UTC m=+0.391069065,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-164.ec2.internal,}" Jun 12 18:30:55.487302 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.487288 2564 manager.go:337] "Starting Device Plugin manager" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.487334 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.487359 2564 server.go:87] "Starting device plugin registration server" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.487611 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.487626 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.487768 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.487829 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.487834 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.488550 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.488622 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.491999 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-164.ec2.internal.18b868f55086c41d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-164.ec2.internal,UID:ip-10-0-143-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-164.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-164.ec2.internal,},FirstTimestamp:2026-06-12 18:30:55.452316701 +0000 UTC m=+0.391078689,LastTimestamp:2026-06-12 18:30:55.452316701 +0000 UTC m=+0.391078689,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-164.ec2.internal,}" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.492193 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d8fvp" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.496407 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.497556 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.497600 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.497622 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 18:30:55.498390 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.497687 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 18:30:55.502592 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.502562 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:55.588365 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.588332 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:55.589314 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.589299 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:55.589391 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.589335 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:55.589391 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.589358 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:55.589391 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.589382 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.598530 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.598477 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal"] Jun 12 18:30:55.598627 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.598544 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:55.600051 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.600037 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:55.600126 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.600068 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:55.600126 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.600084 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:55.600454 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.600440 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.600503 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.600458 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-164.ec2.internal\": node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:55.601324 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.601310 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:55.601437 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.601419 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.601482 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.601452 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:55.602899 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.602879 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:55.602986 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.602908 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:55.602986 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.602920 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:55.602986 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.602881 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:55.602986 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.602983 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:55.603109 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.602993 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:55.604155 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.604141 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.604209 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.604167 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:55.604982 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.604963 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:55.605052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.604994 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:55.605052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.605008 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:55.631286 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.631264 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-164.ec2.internal\" not found" node="ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.635630 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.635610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28841d03b59641e8a6ba3290e407336a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"28841d03b59641e8a6ba3290e407336a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.635717 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.635636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45cf0217c278b01860a43fa25a90b85c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-164.ec2.internal\" (UID: \"45cf0217c278b01860a43fa25a90b85c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.635717 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.635652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/28841d03b59641e8a6ba3290e407336a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"28841d03b59641e8a6ba3290e407336a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.635717 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.635661 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-164.ec2.internal\" not found" node="ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.661315 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.661296 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:55.736440 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.736412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45cf0217c278b01860a43fa25a90b85c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-164.ec2.internal\" (UID: \"45cf0217c278b01860a43fa25a90b85c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.736440 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.736443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/28841d03b59641e8a6ba3290e407336a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"28841d03b59641e8a6ba3290e407336a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.736622 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.736464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28841d03b59641e8a6ba3290e407336a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"28841d03b59641e8a6ba3290e407336a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.736622 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.736514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/45cf0217c278b01860a43fa25a90b85c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-164.ec2.internal\" (UID: \"45cf0217c278b01860a43fa25a90b85c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.736622 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.736523 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/28841d03b59641e8a6ba3290e407336a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"28841d03b59641e8a6ba3290e407336a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.736622 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.736514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28841d03b59641e8a6ba3290e407336a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal\" (UID: \"28841d03b59641e8a6ba3290e407336a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.761539 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.761514 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:55.862091 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.862015 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:55.934031 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.934009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.939180 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:55.939163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" Jun 12 18:30:55.962404 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:55.962381 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:56.062999 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:56.062953 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:56.163606 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:56.163511 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:56.264110 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:56.264081 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:56.364618 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:56.364565 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:56.368710 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.368690 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 18:30:56.368842 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.368824 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:30:56.388403 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:56.388224 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28841d03b59641e8a6ba3290e407336a.slice/crio-b1dd68010341a80c249b825b20042f3c3fcfd90d83dd64a0091d653c8ee41138 WatchSource:0}: Error finding container b1dd68010341a80c249b825b20042f3c3fcfd90d83dd64a0091d653c8ee41138: Status 404 returned error can't find the container with id b1dd68010341a80c249b825b20042f3c3fcfd90d83dd64a0091d653c8ee41138 Jun 12 18:30:56.388639 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:56.388620 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45cf0217c278b01860a43fa25a90b85c.slice/crio-8bb94b490931f38278635463bf4e6d677a1105ab3b655529d1e853f5ba1ef34a WatchSource:0}: Error finding container 8bb94b490931f38278635463bf4e6d677a1105ab3b655529d1e853f5ba1ef34a: Status 404 returned error can't find the container with id 8bb94b490931f38278635463bf4e6d677a1105ab3b655529d1e853f5ba1ef34a Jun 12 18:30:56.393255 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.393232 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:30:56.465691 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:56.465612 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:56.496961 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.496922 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 18:25:55 +0000 UTC" deadline="2028-03-12 15:01:55.034977348 +0000 UTC" Jun 12 18:30:56.496961 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.496956 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15332h30m58.538024973s" Jun 12 18:30:56.501116 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.501068 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" event={"ID":"28841d03b59641e8a6ba3290e407336a","Type":"ContainerStarted","Data":"b1dd68010341a80c249b825b20042f3c3fcfd90d83dd64a0091d653c8ee41138"} Jun 12 18:30:56.502034 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.502009 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" event={"ID":"45cf0217c278b01860a43fa25a90b85c","Type":"ContainerStarted","Data":"8bb94b490931f38278635463bf4e6d677a1105ab3b655529d1e853f5ba1ef34a"} Jun 12 18:30:56.566596 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:56.566557 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-164.ec2.internal\" not found" Jun 12 18:30:56.595736 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.595714 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:56.634035 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.634006 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" Jun 12 18:30:56.657553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.657526 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:30:56.659495 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.659472 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" Jun 12 18:30:56.680690 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.680666 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:56.690558 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.690538 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:30:56.959626 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:56.959533 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:57.412935 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.412850 2564 apiserver.go:52] "Watching apiserver" Jun 12 18:30:57.420954 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.420921 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 18:30:57.421315 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.421291 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-qx8rj","openshift-network-operator/iptables-alerter-k4pkt","openshift-ovn-kubernetes/ovnkube-node-j48wj","kube-system/global-pull-secret-syncer-4dmzd","kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7","openshift-cluster-node-tuning-operator/tuned-w4kfp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal","openshift-multus/multus-pwvdx","openshift-multus/network-metrics-daemon-zxk4r","openshift-network-diagnostics/network-check-target-rzhxp","kube-system/konnectivity-agent-c8mch","openshift-dns/node-resolver-jdlf6","openshift-image-registry/node-ca-sbjhs"] Jun 12 18:30:57.422837 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.422812 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.423915 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.423895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:30:57.424014 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.423967 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:30:57.425330 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.425308 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.426560 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.426540 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:57.426738 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.426712 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:30:57.427755 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.427594 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 18:30:57.427755 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.427597 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:30:57.427755 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.427708 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ks4hv\"" Jun 12 18:30:57.427958 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.427921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.429238 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.429223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.430537 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.430518 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.431891 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.431873 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.433417 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.433398 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.433878 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.433862 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 18:30:57.434011 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.433986 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 18:30:57.434092 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.434021 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 18:30:57.434996 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.434974 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 18:30:57.435088 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.434983 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 18:30:57.437594 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.435475 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:30:57.437594 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.435558 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:30:57.437594 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.435988 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jx4bd\"" Jun 12 18:30:57.437594 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.436260 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 18:30:57.437594 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.436491 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 18:30:57.438486 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.438432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.440022 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.440005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:30:57.441959 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.441925 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 18:30:57.441959 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.441925 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 18:30:57.442099 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.442058 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 18:30:57.442521 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.442500 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 18:30:57.442521 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.442518 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 18:30:57.442970 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.442949 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 18:30:57.443353 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.443324 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 18:30:57.443712 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.443697 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qmr67\"" Jun 12 18:30:57.444073 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.444054 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wkdmz\"" Jun 12 18:30:57.444159 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.444090 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 18:30:57.444159 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.444118 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 18:30:57.444323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.444306 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 18:30:57.444757 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.444739 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-prqq7\"" Jun 12 18:30:57.444856 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.444742 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:30:57.444856 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.444807 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 18:30:57.445133 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.445116 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 18:30:57.445214 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.445137 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9fjg5\"" Jun 12 18:30:57.445214 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.445121 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 18:30:57.445496 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.445481 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 18:30:57.445617 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.445596 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 18:30:57.445684 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.445615 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mjknt\"" Jun 12 18:30:57.445728 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.445686 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 18:30:57.445782 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.445747 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 18:30:57.445782 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.445766 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jwbtq\"" Jun 12 18:30:57.446661 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446538 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-systemd\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.446661 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-run-ovn\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.446661 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:57.446661 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8586e9b3-11cd-4bf3-950e-6b512230a52e-cni-binary-copy\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.446661 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-cni-netd\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.446918 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5beee50-dc70-4fb5-a035-cc771afd231b-host-slash\") pod \"iptables-alerter-k4pkt\" (UID: \"c5beee50-dc70-4fb5-a035-cc771afd231b\") " pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.446918 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-sys\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.446918 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-run-netns\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.446918 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446787 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f025ae2f-0c71-4565-b247-20a5a36792a3-dbus\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:57.446918 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446819 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2599d11-5c45-411f-af19-4f166bb99e11-hosts-file\") pod \"node-resolver-jdlf6\" (UID: \"a2599d11-5c45-411f-af19-4f166bb99e11\") " pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.446918 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcdjl\" (UniqueName: \"kubernetes.io/projected/d08d72a8-3550-4fe7-9823-7382ef593bc2-kube-api-access-rcdjl\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:30:57.446918 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.446918 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-cnibin\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-node-log\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.446996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f6jg\" (UniqueName: \"kubernetes.io/projected/81765229-3f4f-40a1-9f61-ce6b693176b3-kube-api-access-6f6jg\") pod \"node-ca-sbjhs\" (UID: \"81765229-3f4f-40a1-9f61-ce6b693176b3\") " pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-modprobe-d\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dngnk\" (UniqueName: \"kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk\") pod \"network-check-target-rzhxp\" (UID: \"f815076e-dca9-4955-b1d3-fd86bb4be28a\") " pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447094 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-registration-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-run-openvswitch\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447177 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81765229-3f4f-40a1-9f61-ce6b693176b3-serviceca\") pod \"node-ca-sbjhs\" (UID: \"81765229-3f4f-40a1-9f61-ce6b693176b3\") " pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5beee50-dc70-4fb5-a035-cc771afd231b-iptables-alerter-script\") pod \"iptables-alerter-k4pkt\" (UID: \"c5beee50-dc70-4fb5-a035-cc771afd231b\") " pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447217 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-sysconfig\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-socket-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-cni-dir\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.447323 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-conf-dir\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-kubelet\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-run-systemd\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81765229-3f4f-40a1-9f61-ce6b693176b3-host\") pod \"node-ca-sbjhs\" (UID: \"81765229-3f4f-40a1-9f61-ce6b693176b3\") " pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h44dn\" (UniqueName: \"kubernetes.io/projected/a2599d11-5c45-411f-af19-4f166bb99e11-kube-api-access-h44dn\") pod \"node-resolver-jdlf6\" (UID: \"a2599d11-5c45-411f-af19-4f166bb99e11\") " pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-kubernetes\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-system-cni-dir\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447516 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-socket-dir-parent\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-run-k8s-cni-cncf-io\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-cni-bin\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-ovnkube-script-lib\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhtsn\" (UniqueName: \"kubernetes.io/projected/c5beee50-dc70-4fb5-a035-cc771afd231b-kube-api-access-mhtsn\") pod \"iptables-alerter-k4pkt\" (UID: \"c5beee50-dc70-4fb5-a035-cc771afd231b\") " pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-lib-modules\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-device-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-log-socket\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-var-lib-kubelet\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.447924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-host\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f025ae2f-0c71-4565-b247-20a5a36792a3-kubelet-config\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-var-lib-cni-bin\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-var-lib-kubelet\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-var-lib-openvswitch\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nppv\" (UniqueName: \"kubernetes.io/projected/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-kube-api-access-9nppv\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-var-lib-cni-multus\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-daemon-config\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447976 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qtp7j\"" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.447985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-systemd-units\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-tuned\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448055 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qktx\" (UniqueName: \"kubernetes.io/projected/8586e9b3-11cd-4bf3-950e-6b512230a52e-kube-api-access-8qktx\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-slash\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448116 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxrmx\" (UniqueName: \"kubernetes.io/projected/b208043e-0f3b-4ef2-b4a2-931a81a82a39-kube-api-access-dxrmx\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448147 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-env-overrides\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-sysctl-d\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-sysctl-conf\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.448639 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448217 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-os-release\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-hostroot\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-run-multus-certs\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-run-netns\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2599d11-5c45-411f-af19-4f166bb99e11-tmp-dir\") pod \"node-resolver-jdlf6\" (UID: \"a2599d11-5c45-411f-af19-4f166bb99e11\") " pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-run\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448410 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/194d51e2-572a-43a3-a88e-8791f1a13bbf-tmp\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbtl7\" (UniqueName: \"kubernetes.io/projected/194d51e2-572a-43a3-a88e-8791f1a13bbf-kube-api-access-fbtl7\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448496 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-etc-selinux\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-sys-fs\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-etc-openvswitch\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-ovnkube-config\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-ovn-node-metrics-cert\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-etc-kubernetes\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.449201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.448694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-run-ovn-kubernetes\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.449868 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.449383 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 18:30:57.452811 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.452793 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:30:57.533748 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.533717 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cnprk" Jun 12 18:30:57.535242 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.535225 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 18:30:57.548992 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.548970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5beee50-dc70-4fb5-a035-cc771afd231b-iptables-alerter-script\") pod \"iptables-alerter-k4pkt\" (UID: \"c5beee50-dc70-4fb5-a035-cc771afd231b\") " pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.549111 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.548999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-sysconfig\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.549111 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-socket-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.549111 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-cni-dir\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.549111 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-conf-dir\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.549111 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549101 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-kubelet\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549108 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-sysconfig\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-run-systemd\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549145 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-cni-dir\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81765229-3f4f-40a1-9f61-ce6b693176b3-host\") pod \"node-ca-sbjhs\" (UID: \"81765229-3f4f-40a1-9f61-ce6b693176b3\") " pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549177 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-conf-dir\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549187 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-socket-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44dn\" (UniqueName: \"kubernetes.io/projected/a2599d11-5c45-411f-af19-4f166bb99e11-kube-api-access-h44dn\") pod \"node-resolver-jdlf6\" (UID: \"a2599d11-5c45-411f-af19-4f166bb99e11\") " pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81765229-3f4f-40a1-9f61-ce6b693176b3-host\") pod \"node-ca-sbjhs\" (UID: \"81765229-3f4f-40a1-9f61-ce6b693176b3\") " pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549232 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-kubelet\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549242 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-run-systemd\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-kubernetes\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-system-cni-dir\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549289 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-kubernetes\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-socket-dir-parent\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.549369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549352 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-system-cni-dir\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-run-k8s-cni-cncf-io\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-cni-bin\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549460 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-run-k8s-cni-cncf-io\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549463 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-socket-dir-parent\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-ovnkube-script-lib\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhtsn\" (UniqueName: \"kubernetes.io/projected/c5beee50-dc70-4fb5-a035-cc771afd231b-kube-api-access-mhtsn\") pod \"iptables-alerter-k4pkt\" (UID: \"c5beee50-dc70-4fb5-a035-cc771afd231b\") " pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-lib-modules\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549528 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-cni-bin\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-device-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-log-socket\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-var-lib-kubelet\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549672 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-lib-modules\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c5beee50-dc70-4fb5-a035-cc771afd231b-iptables-alerter-script\") pod \"iptables-alerter-k4pkt\" (UID: \"c5beee50-dc70-4fb5-a035-cc771afd231b\") " pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-host\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-var-lib-kubelet\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.550052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f025ae2f-0c71-4565-b247-20a5a36792a3-kubelet-config\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549768 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-log-socket\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549779 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-host\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549788 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-var-lib-cni-bin\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-var-lib-kubelet\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549828 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-device-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549845 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f025ae2f-0c71-4565-b247-20a5a36792a3-kubelet-config\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-var-lib-openvswitch\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-var-lib-cni-bin\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nppv\" (UniqueName: \"kubernetes.io/projected/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-kube-api-access-9nppv\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549900 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-var-lib-openvswitch\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549929 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-var-lib-kubelet\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549929 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-var-lib-cni-multus\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-daemon-config\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549961 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-var-lib-cni-multus\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-systemd-units\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.549990 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-system-cni-dir\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.550729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86fa01de-334d-439a-ac57-9897fbc27322-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-systemd-units\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-tuned\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qktx\" (UniqueName: \"kubernetes.io/projected/8586e9b3-11cd-4bf3-950e-6b512230a52e-kube-api-access-8qktx\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-ovnkube-script-lib\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-slash\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be86e7eb-c135-4ef6-aedb-847f63fc4d9f-agent-certs\") pod \"konnectivity-agent-c8mch\" (UID: \"be86e7eb-c135-4ef6-aedb-847f63fc4d9f\") " pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550172 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-slash\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxrmx\" (UniqueName: \"kubernetes.io/projected/b208043e-0f3b-4ef2-b4a2-931a81a82a39-kube-api-access-dxrmx\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-env-overrides\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-os-release\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550318 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86fa01de-334d-439a-ac57-9897fbc27322-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-sysctl-d\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-sysctl-conf\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-os-release\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-hostroot\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550489 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8586e9b3-11cd-4bf3-950e-6b512230a52e-multus-daemon-config\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.551377 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-run-multus-certs\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-run-netns\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550549 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-sysctl-d\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550596 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-sysctl-conf\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550609 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-os-release\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2599d11-5c45-411f-af19-4f166bb99e11-tmp-dir\") pod \"node-resolver-jdlf6\" (UID: \"a2599d11-5c45-411f-af19-4f166bb99e11\") " pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550657 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550662 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-run-multus-certs\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550675 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-run\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550664 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-hostroot\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-run-netns\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/194d51e2-572a-43a3-a88e-8791f1a13bbf-tmp\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550736 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-run\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbtl7\" (UniqueName: \"kubernetes.io/projected/194d51e2-572a-43a3-a88e-8791f1a13bbf-kube-api-access-fbtl7\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550763 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-env-overrides\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550767 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cnprk" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-etc-selinux\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.552243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550935 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-etc-selinux\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550949 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2599d11-5c45-411f-af19-4f166bb99e11-tmp-dir\") pod \"node-resolver-jdlf6\" (UID: \"a2599d11-5c45-411f-af19-4f166bb99e11\") " pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.550985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-sys-fs\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-etc-openvswitch\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551549 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-sys-fs\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-ovnkube-config\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551640 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-ovn-node-metrics-cert\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-etc-kubernetes\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-run-ovn-kubernetes\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-systemd\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-run-ovn\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8586e9b3-11cd-4bf3-950e-6b512230a52e-cni-binary-copy\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-cni-netd\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-cnibin\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.552000 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5beee50-dc70-4fb5-a035-cc771afd231b-host-slash\") pod \"iptables-alerter-k4pkt\" (UID: \"c5beee50-dc70-4fb5-a035-cc771afd231b\") " pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.552191 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-run-ovn\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553151 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.552269 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.552378 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret podName:f025ae2f-0c71-4565-b247-20a5a36792a3 nodeName:}" failed. No retries permitted until 2026-06-12 18:30:58.05235596 +0000 UTC m=+2.991117954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret") pod "global-pull-secret-syncer-4dmzd" (UID: "f025ae2f-0c71-4565-b247-20a5a36792a3") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.552735 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-ovnkube-config\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.552743 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-cni-netd\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.552781 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8586e9b3-11cd-4bf3-950e-6b512230a52e-cni-binary-copy\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.552814 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-etc-kubernetes\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.552845 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-host-run-ovn-kubernetes\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.552880 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-systemd\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.552948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5beee50-dc70-4fb5-a035-cc771afd231b-host-slash\") pod \"iptables-alerter-k4pkt\" (UID: \"c5beee50-dc70-4fb5-a035-cc771afd231b\") " pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.551081 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-etc-openvswitch\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.552992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-sys\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-run-netns\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86fa01de-334d-439a-ac57-9897fbc27322-cni-binary-copy\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553046 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-sys\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtcg9\" (UniqueName: \"kubernetes.io/projected/86fa01de-334d-439a-ac57-9897fbc27322-kube-api-access-dtcg9\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553171 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-host-run-netns\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f025ae2f-0c71-4565-b247-20a5a36792a3-dbus\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:57.553964 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2599d11-5c45-411f-af19-4f166bb99e11-hosts-file\") pod \"node-resolver-jdlf6\" (UID: \"a2599d11-5c45-411f-af19-4f166bb99e11\") " pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcdjl\" (UniqueName: \"kubernetes.io/projected/d08d72a8-3550-4fe7-9823-7382ef593bc2-kube-api-access-rcdjl\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553367 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-cnibin\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-node-log\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be86e7eb-c135-4ef6-aedb-847f63fc4d9f-konnectivity-ca\") pod \"konnectivity-agent-c8mch\" (UID: \"be86e7eb-c135-4ef6-aedb-847f63fc4d9f\") " pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f6jg\" (UniqueName: \"kubernetes.io/projected/81765229-3f4f-40a1-9f61-ce6b693176b3-kube-api-access-6f6jg\") pod \"node-ca-sbjhs\" (UID: \"81765229-3f4f-40a1-9f61-ce6b693176b3\") " pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-modprobe-d\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553628 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngnk\" (UniqueName: \"kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk\") pod \"network-check-target-rzhxp\" (UID: \"f815076e-dca9-4955-b1d3-fd86bb4be28a\") " pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-registration-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553784 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8586e9b3-11cd-4bf3-950e-6b512230a52e-cnibin\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-run-openvswitch\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553855 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-run-openvswitch\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.553859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81765229-3f4f-40a1-9f61-ce6b693176b3-serviceca\") pod \"node-ca-sbjhs\" (UID: \"81765229-3f4f-40a1-9f61-ce6b693176b3\") " pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.554293 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:57.555012 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.554299 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81765229-3f4f-40a1-9f61-ce6b693176b3-serviceca\") pod \"node-ca-sbjhs\" (UID: \"81765229-3f4f-40a1-9f61-ce6b693176b3\") " pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.555772 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.554357 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs podName:d08d72a8-3550-4fe7-9823-7382ef593bc2 nodeName:}" failed. No retries permitted until 2026-06-12 18:30:58.054336899 +0000 UTC m=+2.993098887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs") pod "network-metrics-daemon-zxk4r" (UID: "d08d72a8-3550-4fe7-9823-7382ef593bc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:57.555772 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.554394 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-node-log\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.555772 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.554452 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-modprobe-d\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.555772 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.554766 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b208043e-0f3b-4ef2-b4a2-931a81a82a39-registration-dir\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.555772 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.554865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2599d11-5c45-411f-af19-4f166bb99e11-hosts-file\") pod \"node-resolver-jdlf6\" (UID: \"a2599d11-5c45-411f-af19-4f166bb99e11\") " pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.555772 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.554933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f025ae2f-0c71-4565-b247-20a5a36792a3-dbus\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:57.557122 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.556318 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-ovn-node-metrics-cert\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.557686 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.557664 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/194d51e2-572a-43a3-a88e-8791f1a13bbf-etc-tuned\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.557946 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.557923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/194d51e2-572a-43a3-a88e-8791f1a13bbf-tmp\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.569970 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.569934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qktx\" (UniqueName: \"kubernetes.io/projected/8586e9b3-11cd-4bf3-950e-6b512230a52e-kube-api-access-8qktx\") pod \"multus-pwvdx\" (UID: \"8586e9b3-11cd-4bf3-950e-6b512230a52e\") " pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.571957 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.571910 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhtsn\" (UniqueName: \"kubernetes.io/projected/c5beee50-dc70-4fb5-a035-cc771afd231b-kube-api-access-mhtsn\") pod \"iptables-alerter-k4pkt\" (UID: \"c5beee50-dc70-4fb5-a035-cc771afd231b\") " pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.572061 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.572036 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxrmx\" (UniqueName: \"kubernetes.io/projected/b208043e-0f3b-4ef2-b4a2-931a81a82a39-kube-api-access-dxrmx\") pod \"aws-ebs-csi-driver-node-znzf7\" (UID: \"b208043e-0f3b-4ef2-b4a2-931a81a82a39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.573666 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.573642 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f6jg\" (UniqueName: \"kubernetes.io/projected/81765229-3f4f-40a1-9f61-ce6b693176b3-kube-api-access-6f6jg\") pod \"node-ca-sbjhs\" (UID: \"81765229-3f4f-40a1-9f61-ce6b693176b3\") " pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.574105 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.574078 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbtl7\" (UniqueName: \"kubernetes.io/projected/194d51e2-572a-43a3-a88e-8791f1a13bbf-kube-api-access-fbtl7\") pod \"tuned-w4kfp\" (UID: \"194d51e2-572a-43a3-a88e-8791f1a13bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.574266 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.574249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h44dn\" (UniqueName: \"kubernetes.io/projected/a2599d11-5c45-411f-af19-4f166bb99e11-kube-api-access-h44dn\") pod \"node-resolver-jdlf6\" (UID: \"a2599d11-5c45-411f-af19-4f166bb99e11\") " pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.576840 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.576820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nppv\" (UniqueName: \"kubernetes.io/projected/1f7b8255-8a37-4357-9a7c-4fc2aa60f626-kube-api-access-9nppv\") pod \"ovnkube-node-j48wj\" (UID: \"1f7b8255-8a37-4357-9a7c-4fc2aa60f626\") " pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.582257 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.582238 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:30:57.582338 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.582261 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:30:57.582338 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.582276 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dngnk for pod openshift-network-diagnostics/network-check-target-rzhxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:57.582515 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:57.582341 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk podName:f815076e-dca9-4955-b1d3-fd86bb4be28a nodeName:}" failed. No retries permitted until 2026-06-12 18:30:58.0823233 +0000 UTC m=+3.021085292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dngnk" (UniqueName: "kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk") pod "network-check-target-rzhxp" (UID: "f815076e-dca9-4955-b1d3-fd86bb4be28a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:57.590458 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.590439 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcdjl\" (UniqueName: \"kubernetes.io/projected/d08d72a8-3550-4fe7-9823-7382ef593bc2-kube-api-access-rcdjl\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:30:57.645468 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.645439 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:57.654855 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.654826 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-cnibin\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.654984 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.654869 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86fa01de-334d-439a-ac57-9897fbc27322-cni-binary-copy\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.654984 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.654909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtcg9\" (UniqueName: \"kubernetes.io/projected/86fa01de-334d-439a-ac57-9897fbc27322-kube-api-access-dtcg9\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.654984 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.654941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be86e7eb-c135-4ef6-aedb-847f63fc4d9f-konnectivity-ca\") pod \"konnectivity-agent-c8mch\" (UID: \"be86e7eb-c135-4ef6-aedb-847f63fc4d9f\") " pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:30:57.654984 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.654940 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-cnibin\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655188 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655038 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655188 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-system-cni-dir\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655188 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86fa01de-334d-439a-ac57-9897fbc27322-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655188 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be86e7eb-c135-4ef6-aedb-847f63fc4d9f-agent-certs\") pod \"konnectivity-agent-c8mch\" (UID: \"be86e7eb-c135-4ef6-aedb-847f63fc4d9f\") " pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:30:57.655188 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655132 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-system-cni-dir\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655188 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-os-release\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655188 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86fa01de-334d-439a-ac57-9897fbc27322-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655291 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86fa01de-334d-439a-ac57-9897fbc27322-os-release\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655698 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655684 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be86e7eb-c135-4ef6-aedb-847f63fc4d9f-konnectivity-ca\") pod \"konnectivity-agent-c8mch\" (UID: \"be86e7eb-c135-4ef6-aedb-847f63fc4d9f\") " pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:30:57.655774 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86fa01de-334d-439a-ac57-9897fbc27322-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655774 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655771 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86fa01de-334d-439a-ac57-9897fbc27322-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.655924 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.655888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86fa01de-334d-439a-ac57-9897fbc27322-cni-binary-copy\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.657682 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.657662 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be86e7eb-c135-4ef6-aedb-847f63fc4d9f-agent-certs\") pod \"konnectivity-agent-c8mch\" (UID: \"be86e7eb-c135-4ef6-aedb-847f63fc4d9f\") " pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:30:57.664355 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.664306 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtcg9\" (UniqueName: \"kubernetes.io/projected/86fa01de-334d-439a-ac57-9897fbc27322-kube-api-access-dtcg9\") pod \"multus-additional-cni-plugins-qx8rj\" (UID: \"86fa01de-334d-439a-ac57-9897fbc27322\") " pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.733273 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.733240 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" Jun 12 18:30:57.741678 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.741650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:30:57.751138 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.751118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sbjhs" Jun 12 18:30:57.756481 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.756459 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" Jun 12 18:30:57.762827 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.762805 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pwvdx" Jun 12 18:30:57.770178 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.770152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jdlf6" Jun 12 18:30:57.777150 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.777124 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k4pkt" Jun 12 18:30:57.785447 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.785424 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" Jun 12 18:30:57.790169 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:57.790151 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:30:58.057653 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.057552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:30:58.057799 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:58.057714 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:58.057799 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.057747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:58.057799 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:58.057774 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs podName:d08d72a8-3550-4fe7-9823-7382ef593bc2 nodeName:}" failed. No retries permitted until 2026-06-12 18:30:59.057759563 +0000 UTC m=+3.996521537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs") pod "network-metrics-daemon-zxk4r" (UID: "d08d72a8-3550-4fe7-9823-7382ef593bc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:58.057919 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:58.057822 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:58.057919 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:58.057862 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret podName:f025ae2f-0c71-4565-b247-20a5a36792a3 nodeName:}" failed. No retries permitted until 2026-06-12 18:30:59.057850764 +0000 UTC m=+3.996612770 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret") pod "global-pull-secret-syncer-4dmzd" (UID: "f025ae2f-0c71-4565-b247-20a5a36792a3") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:58.159125 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.159087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngnk\" (UniqueName: \"kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk\") pod \"network-check-target-rzhxp\" (UID: \"f815076e-dca9-4955-b1d3-fd86bb4be28a\") " pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:30:58.159353 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:58.159288 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:30:58.159353 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:58.159315 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:30:58.159353 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:58.159328 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dngnk for pod openshift-network-diagnostics/network-check-target-rzhxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:58.159473 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:58.159403 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk podName:f815076e-dca9-4955-b1d3-fd86bb4be28a nodeName:}" failed. No retries permitted until 2026-06-12 18:30:59.159386048 +0000 UTC m=+4.098148036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dngnk" (UniqueName: "kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk") pod "network-check-target-rzhxp" (UID: "f815076e-dca9-4955-b1d3-fd86bb4be28a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:58.230688 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:58.230662 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7b8255_8a37_4357_9a7c_4fc2aa60f626.slice/crio-83fe3680f62e8b0a0f5a8884ee3180bef811da5a444a053b6d238104b723aedc WatchSource:0}: Error finding container 83fe3680f62e8b0a0f5a8884ee3180bef811da5a444a053b6d238104b723aedc: Status 404 returned error can't find the container with id 83fe3680f62e8b0a0f5a8884ee3180bef811da5a444a053b6d238104b723aedc Jun 12 18:30:58.233233 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:58.233207 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8586e9b3_11cd_4bf3_950e_6b512230a52e.slice/crio-d8309bcb8bcc38519fbac48a128ca800258177289330e44b745f8affd2ea8a9d WatchSource:0}: Error finding container d8309bcb8bcc38519fbac48a128ca800258177289330e44b745f8affd2ea8a9d: Status 404 returned error can't find the container with id d8309bcb8bcc38519fbac48a128ca800258177289330e44b745f8affd2ea8a9d Jun 12 18:30:58.235221 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:58.235196 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194d51e2_572a_43a3_a88e_8791f1a13bbf.slice/crio-4f19e7ff43f8244aa054b585e0f6380ed76323fbae4004f6b73bc54b0a53ed0a WatchSource:0}: Error finding container 4f19e7ff43f8244aa054b585e0f6380ed76323fbae4004f6b73bc54b0a53ed0a: Status 404 returned error can't find the container with id 4f19e7ff43f8244aa054b585e0f6380ed76323fbae4004f6b73bc54b0a53ed0a Jun 12 18:30:58.235928 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:58.235911 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb208043e_0f3b_4ef2_b4a2_931a81a82a39.slice/crio-b82a78ed6648e083c31fc164034ec932fdcaac3971e6e6598f48cf340107e9f9 WatchSource:0}: Error finding container b82a78ed6648e083c31fc164034ec932fdcaac3971e6e6598f48cf340107e9f9: Status 404 returned error can't find the container with id b82a78ed6648e083c31fc164034ec932fdcaac3971e6e6598f48cf340107e9f9 Jun 12 18:30:58.237099 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:30:58.236947 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fa01de_334d_439a_ac57_9897fbc27322.slice/crio-a4d1d4797b5ca3a70b477b2aa3b59fae56bea276a9b9e0ff83379636f230b1d6 WatchSource:0}: Error finding container a4d1d4797b5ca3a70b477b2aa3b59fae56bea276a9b9e0ff83379636f230b1d6: Status 404 returned error can't find the container with id a4d1d4797b5ca3a70b477b2aa3b59fae56bea276a9b9e0ff83379636f230b1d6 Jun 12 18:30:58.497977 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.497950 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:30:58.498283 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:58.498076 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:30:58.507336 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.507306 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" event={"ID":"1f7b8255-8a37-4357-9a7c-4fc2aa60f626","Type":"ContainerStarted","Data":"83fe3680f62e8b0a0f5a8884ee3180bef811da5a444a053b6d238104b723aedc"} Jun 12 18:30:58.509749 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.509720 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" event={"ID":"45cf0217c278b01860a43fa25a90b85c","Type":"ContainerStarted","Data":"373b94df5e2752dcfecdccc22bb795a48e711a4c63b6f4a8fb07441789d39682"} Jun 12 18:30:58.510788 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.510766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k4pkt" event={"ID":"c5beee50-dc70-4fb5-a035-cc771afd231b","Type":"ContainerStarted","Data":"5c70d384c6835fdd42be084b1dcba51045b890094732a070f4b9e01212e0aa8a"} Jun 12 18:30:58.511790 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.511761 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sbjhs" event={"ID":"81765229-3f4f-40a1-9f61-ce6b693176b3","Type":"ContainerStarted","Data":"93c7b76027a678a6f46cff0c50f60d9a29a6a2f9d2eee8e867641fca821caeb2"} Jun 12 18:30:58.512626 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.512601 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jdlf6" event={"ID":"a2599d11-5c45-411f-af19-4f166bb99e11","Type":"ContainerStarted","Data":"452bd299d7f410785bba5b1e62d62461cae0ab91643fecd3e1f5cdbe86898ccb"} Jun 12 18:30:58.513693 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.513672 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" event={"ID":"86fa01de-334d-439a-ac57-9897fbc27322","Type":"ContainerStarted","Data":"a4d1d4797b5ca3a70b477b2aa3b59fae56bea276a9b9e0ff83379636f230b1d6"} Jun 12 18:30:58.514618 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.514595 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pwvdx" event={"ID":"8586e9b3-11cd-4bf3-950e-6b512230a52e","Type":"ContainerStarted","Data":"d8309bcb8bcc38519fbac48a128ca800258177289330e44b745f8affd2ea8a9d"} Jun 12 18:30:58.515967 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.515939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" event={"ID":"28841d03b59641e8a6ba3290e407336a","Type":"ContainerStarted","Data":"f9cd0bda1d4dec5597c6fea9490e1b5a1277c067d2d38ee76bd9902ae94abf11"} Jun 12 18:30:58.517021 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.516969 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c8mch" event={"ID":"be86e7eb-c135-4ef6-aedb-847f63fc4d9f","Type":"ContainerStarted","Data":"99c28cc133a63411093e2526bfb18c28294e7eb9dd3db4d698dd640d53fdee97"} Jun 12 18:30:58.518118 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.518090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" event={"ID":"b208043e-0f3b-4ef2-b4a2-931a81a82a39","Type":"ContainerStarted","Data":"b82a78ed6648e083c31fc164034ec932fdcaac3971e6e6598f48cf340107e9f9"} Jun 12 18:30:58.519177 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.519157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" event={"ID":"194d51e2-572a-43a3-a88e-8791f1a13bbf","Type":"ContainerStarted","Data":"4f19e7ff43f8244aa054b585e0f6380ed76323fbae4004f6b73bc54b0a53ed0a"} Jun 12 18:30:58.541101 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.541025 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-164.ec2.internal" podStartSLOduration=2.541005693 podStartE2EDuration="2.541005693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:30:58.540767979 +0000 UTC m=+3.479529976" watchObservedRunningTime="2026-06-12 18:30:58.541005693 +0000 UTC m=+3.479767694" Jun 12 18:30:58.555681 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.555639 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:25:57 +0000 UTC" deadline="2028-01-19 17:19:30.582299791 +0000 UTC" Jun 12 18:30:58.555681 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:58.555676 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14062h48m32.02662868s" Jun 12 18:30:59.066799 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:59.066757 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:59.066984 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:59.066833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:30:59.082688 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:59.082613 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:59.082847 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:59.082707 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret podName:f025ae2f-0c71-4565-b247-20a5a36792a3 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:01.082686611 +0000 UTC m=+6.021448599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret") pod "global-pull-secret-syncer-4dmzd" (UID: "f025ae2f-0c71-4565-b247-20a5a36792a3") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:59.086590 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:59.083252 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:59.086590 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:59.083322 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs podName:d08d72a8-3550-4fe7-9823-7382ef593bc2 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:01.083292987 +0000 UTC m=+6.022054975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs") pod "network-metrics-daemon-zxk4r" (UID: "d08d72a8-3550-4fe7-9823-7382ef593bc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:59.167619 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:59.167564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngnk\" (UniqueName: \"kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk\") pod \"network-check-target-rzhxp\" (UID: \"f815076e-dca9-4955-b1d3-fd86bb4be28a\") " pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:30:59.167832 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:59.167798 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:30:59.167832 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:59.167823 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:30:59.167974 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:59.167836 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dngnk for pod openshift-network-diagnostics/network-check-target-rzhxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:59.167974 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:59.167897 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk podName:f815076e-dca9-4955-b1d3-fd86bb4be28a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:01.167879042 +0000 UTC m=+6.106641035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dngnk" (UniqueName: "kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk") pod "network-check-target-rzhxp" (UID: "f815076e-dca9-4955-b1d3-fd86bb4be28a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:59.501181 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:59.500718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:30:59.501181 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:59.500847 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:30:59.501181 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:59.500903 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:30:59.501181 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:30:59.501026 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:30:59.537073 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:59.537036 2564 generic.go:356] "Generic (PLEG): container finished" podID="28841d03b59641e8a6ba3290e407336a" containerID="f9cd0bda1d4dec5597c6fea9490e1b5a1277c067d2d38ee76bd9902ae94abf11" exitCode=0 Jun 12 18:30:59.538200 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:59.537971 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" event={"ID":"28841d03b59641e8a6ba3290e407336a","Type":"ContainerDied","Data":"f9cd0bda1d4dec5597c6fea9490e1b5a1277c067d2d38ee76bd9902ae94abf11"} Jun 12 18:30:59.556365 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:59.556290 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:25:57 +0000 UTC" deadline="2027-12-29 09:42:13.036763593 +0000 UTC" Jun 12 18:30:59.556365 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:30:59.556339 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13551h11m13.480428366s" Jun 12 18:31:00.498284 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:00.498241 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:00.498479 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:00.498366 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:00.566705 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:00.566629 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" event={"ID":"28841d03b59641e8a6ba3290e407336a","Type":"ContainerStarted","Data":"bd75355666f8ecafd742fae8dd9c51ddc90fb1205200ab53f2c7d02a2eb2d188"} Jun 12 18:31:00.595243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:00.594708 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-164.ec2.internal" podStartSLOduration=4.594684237 podStartE2EDuration="4.594684237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:00.594027076 +0000 UTC m=+5.532789077" watchObservedRunningTime="2026-06-12 18:31:00.594684237 +0000 UTC m=+5.533446235" Jun 12 18:31:01.086743 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:01.086669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:01.086743 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:01.086731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:01.087232 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:01.086882 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:01.087232 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:01.086943 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs podName:d08d72a8-3550-4fe7-9823-7382ef593bc2 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:05.086924797 +0000 UTC m=+10.025686791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs") pod "network-metrics-daemon-zxk4r" (UID: "d08d72a8-3550-4fe7-9823-7382ef593bc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:01.087412 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:01.087348 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:01.087412 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:01.087407 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret podName:f025ae2f-0c71-4565-b247-20a5a36792a3 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:05.08739136 +0000 UTC m=+10.026153339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret") pod "global-pull-secret-syncer-4dmzd" (UID: "f025ae2f-0c71-4565-b247-20a5a36792a3") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:01.188117 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:01.188081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngnk\" (UniqueName: \"kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk\") pod \"network-check-target-rzhxp\" (UID: \"f815076e-dca9-4955-b1d3-fd86bb4be28a\") " pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:01.188313 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:01.188269 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:31:01.188313 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:01.188294 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:31:01.188313 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:01.188307 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dngnk for pod openshift-network-diagnostics/network-check-target-rzhxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:01.188478 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:01.188364 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk podName:f815076e-dca9-4955-b1d3-fd86bb4be28a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:05.188345783 +0000 UTC m=+10.127107777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dngnk" (UniqueName: "kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk") pod "network-check-target-rzhxp" (UID: "f815076e-dca9-4955-b1d3-fd86bb4be28a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:01.501244 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:01.500654 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:01.501244 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:01.500765 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:01.501244 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:01.501039 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:01.501244 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:01.501153 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:02.498419 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:02.498375 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:02.498950 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:02.498521 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:03.497937 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:03.497878 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:03.498142 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:03.498028 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:03.498464 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:03.497878 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:03.498464 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:03.498406 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:04.498413 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:04.498383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:04.498616 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:04.498513 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:05.122564 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:05.122229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:05.122564 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:05.122284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:05.122564 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:05.122410 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:05.122564 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:05.122418 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:05.122564 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:05.122475 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs podName:d08d72a8-3550-4fe7-9823-7382ef593bc2 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:13.122456129 +0000 UTC m=+18.061218104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs") pod "network-metrics-daemon-zxk4r" (UID: "d08d72a8-3550-4fe7-9823-7382ef593bc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:05.122564 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:05.122537 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret podName:f025ae2f-0c71-4565-b247-20a5a36792a3 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:13.122489108 +0000 UTC m=+18.061251083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret") pod "global-pull-secret-syncer-4dmzd" (UID: "f025ae2f-0c71-4565-b247-20a5a36792a3") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:05.222990 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:05.222951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngnk\" (UniqueName: \"kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk\") pod \"network-check-target-rzhxp\" (UID: \"f815076e-dca9-4955-b1d3-fd86bb4be28a\") " pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:05.223181 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:05.223156 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:31:05.223181 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:05.223180 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:31:05.223291 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:05.223191 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dngnk for pod openshift-network-diagnostics/network-check-target-rzhxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:05.223291 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:05.223247 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk podName:f815076e-dca9-4955-b1d3-fd86bb4be28a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:13.223226956 +0000 UTC m=+18.161989140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dngnk" (UniqueName: "kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk") pod "network-check-target-rzhxp" (UID: "f815076e-dca9-4955-b1d3-fd86bb4be28a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:05.499266 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:05.499153 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:05.499836 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:05.499309 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:05.499836 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:05.499316 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:05.499836 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:05.499416 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:06.498416 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:06.498203 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:06.498416 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:06.498345 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:07.498292 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:07.498108 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:07.498292 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:07.498118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:07.498292 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:07.498256 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:07.498964 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:07.498320 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:08.497914 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:08.497881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:08.498096 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:08.498012 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:09.499071 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:09.498905 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:09.499071 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:09.499041 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:09.499632 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:09.499082 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:09.499632 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:09.499207 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:10.498747 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:10.498719 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:10.498911 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:10.498833 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:11.497879 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:11.497848 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:11.497879 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:11.497865 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:11.498354 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:11.497983 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:11.498743 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:11.498719 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:12.498032 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:12.497991 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:12.498475 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:12.498137 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:13.180816 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:13.180782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:13.180993 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:13.180827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:13.181049 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:13.180998 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:13.181096 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:13.181064 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret podName:f025ae2f-0c71-4565-b247-20a5a36792a3 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:29.181047254 +0000 UTC m=+34.119809228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret") pod "global-pull-secret-syncer-4dmzd" (UID: "f025ae2f-0c71-4565-b247-20a5a36792a3") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:13.181150 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:13.181002 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:13.181210 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:13.181196 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs podName:d08d72a8-3550-4fe7-9823-7382ef593bc2 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:29.181162845 +0000 UTC m=+34.119924841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs") pod "network-metrics-daemon-zxk4r" (UID: "d08d72a8-3550-4fe7-9823-7382ef593bc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:13.281890 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:13.281853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngnk\" (UniqueName: \"kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk\") pod \"network-check-target-rzhxp\" (UID: \"f815076e-dca9-4955-b1d3-fd86bb4be28a\") " pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:13.282067 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:13.282020 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:31:13.282067 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:13.282037 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:31:13.282067 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:13.282047 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dngnk for pod openshift-network-diagnostics/network-check-target-rzhxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:13.282242 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:13.282100 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk podName:f815076e-dca9-4955-b1d3-fd86bb4be28a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:29.282082937 +0000 UTC m=+34.220844927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dngnk" (UniqueName: "kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk") pod "network-check-target-rzhxp" (UID: "f815076e-dca9-4955-b1d3-fd86bb4be28a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:13.498356 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:13.498267 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:13.498356 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:13.498339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:13.498949 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:13.498475 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:13.498949 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:13.498626 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:14.498002 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:14.497970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:14.498173 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:14.498082 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:15.499789 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:15.499714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:15.500288 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:15.499830 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:15.500288 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:15.499884 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:15.500288 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:15.500005 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:16.497793 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:16.497757 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:16.497944 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:16.497871 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:17.499108 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.498836 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:17.499922 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.498836 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:17.499922 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:17.499184 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:17.499922 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:17.499264 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:17.601732 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.601699 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c8mch" event={"ID":"be86e7eb-c135-4ef6-aedb-847f63fc4d9f","Type":"ContainerStarted","Data":"51d0efe6e59a33c83deda067a7166f1775ec2002f5a4654cba59d45df1f1ca22"} Jun 12 18:31:17.603119 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.603096 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" event={"ID":"b208043e-0f3b-4ef2-b4a2-931a81a82a39","Type":"ContainerStarted","Data":"b822917e3dbaa1cbfda9ca8a4f3867112aaf3724e2d7d90ecf368b7691d53708"} Jun 12 18:31:17.604394 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.604369 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" event={"ID":"194d51e2-572a-43a3-a88e-8791f1a13bbf","Type":"ContainerStarted","Data":"e9d09389c3bd09e6911e4f80cee0575ff021b39f1b299a917090cbb7e58af0d5"} Jun 12 18:31:17.606920 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.606901 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:31:17.607210 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.607193 2564 generic.go:356] "Generic (PLEG): container finished" podID="1f7b8255-8a37-4357-9a7c-4fc2aa60f626" containerID="f447f956a3d6e3dee31d7a437ea61fbe00c446dc123c514d11782bc92324e7ef" exitCode=1 Jun 12 18:31:17.607260 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.607250 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" event={"ID":"1f7b8255-8a37-4357-9a7c-4fc2aa60f626","Type":"ContainerStarted","Data":"9c05cf8ac423f20b5f8b0aa0abae0e0df93822bd1fe00c543617060fce813cf2"} Jun 12 18:31:17.607314 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.607304 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" event={"ID":"1f7b8255-8a37-4357-9a7c-4fc2aa60f626","Type":"ContainerStarted","Data":"c9740c7a3492a27862e3d1492bcf93b41f5e6d377db94d97884622311a217a91"} Jun 12 18:31:17.607356 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.607349 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" event={"ID":"1f7b8255-8a37-4357-9a7c-4fc2aa60f626","Type":"ContainerStarted","Data":"b584a1efbfb3fc309bacefe9910822e484356ae45d36fe528ab07749a196776a"} Jun 12 18:31:17.607429 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.607413 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" event={"ID":"1f7b8255-8a37-4357-9a7c-4fc2aa60f626","Type":"ContainerStarted","Data":"1a2caa5a6904ceb86e51c782ef5ea2d59063f2ffab6ad76a7a790383ec77fd96"} Jun 12 18:31:17.607493 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.607472 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" event={"ID":"1f7b8255-8a37-4357-9a7c-4fc2aa60f626","Type":"ContainerDied","Data":"f447f956a3d6e3dee31d7a437ea61fbe00c446dc123c514d11782bc92324e7ef"} Jun 12 18:31:17.607625 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.607603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" event={"ID":"1f7b8255-8a37-4357-9a7c-4fc2aa60f626","Type":"ContainerStarted","Data":"cf47923851820b8461c2e2fac802f80b0f1461e3680b5a3abdc8c7bba0875eec"} Jun 12 18:31:17.608506 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.608486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sbjhs" event={"ID":"81765229-3f4f-40a1-9f61-ce6b693176b3","Type":"ContainerStarted","Data":"f637a10e2dc3a05b4f79dfdc107ea5c4be7fe1b5286b2c915d72ad21d1c8981a"} Jun 12 18:31:17.609744 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.609725 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jdlf6" event={"ID":"a2599d11-5c45-411f-af19-4f166bb99e11","Type":"ContainerStarted","Data":"7d3cc3c58b2861136c3386bb97d1b062109a25f1becd83dd64b3566419545ce3"} Jun 12 18:31:17.611068 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.611048 2564 generic.go:356] "Generic (PLEG): container finished" podID="86fa01de-334d-439a-ac57-9897fbc27322" containerID="e729f7c7b5228707ecfe370dd22b6d8ac3c33cfb99283236de2742368b5752e3" exitCode=0 Jun 12 18:31:17.611143 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.611105 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" event={"ID":"86fa01de-334d-439a-ac57-9897fbc27322","Type":"ContainerDied","Data":"e729f7c7b5228707ecfe370dd22b6d8ac3c33cfb99283236de2742368b5752e3"} Jun 12 18:31:17.612552 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.612534 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pwvdx" event={"ID":"8586e9b3-11cd-4bf3-950e-6b512230a52e","Type":"ContainerStarted","Data":"a7fcd85aed50bbce52f26076aa71b20f0731cafc0f2568e954d01535b4b3d4c2"} Jun 12 18:31:17.619193 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.619155 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c8mch" podStartSLOduration=12.517825394 podStartE2EDuration="22.619143124s" totalImagesPullingTime="10.10131773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:17.618826425 +0000 UTC m=+22.557588422" watchObservedRunningTime="2026-06-12 18:31:17.619143124 +0000 UTC m=+22.557905120" Jun 12 18:31:17.636736 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.636701 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w4kfp" podStartSLOduration=4.31028361 podStartE2EDuration="22.636688673s" totalImagesPullingTime="18.326405063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:17.636276153 +0000 UTC m=+22.575038149" watchObservedRunningTime="2026-06-12 18:31:17.636688673 +0000 UTC m=+22.575450663" Jun 12 18:31:17.652170 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.652136 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pwvdx" podStartSLOduration=4.304955123 podStartE2EDuration="22.652126076s" totalImagesPullingTime="18.347170953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:17.651702379 +0000 UTC m=+22.590464386" watchObservedRunningTime="2026-06-12 18:31:17.652126076 +0000 UTC m=+22.590888072" Jun 12 18:31:17.666630 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.666596 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jdlf6" podStartSLOduration=4.345262891 podStartE2EDuration="22.66656822s" totalImagesPullingTime="18.321305329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:17.666502174 +0000 UTC m=+22.605264183" watchObservedRunningTime="2026-06-12 18:31:17.66656822 +0000 UTC m=+22.605330216" Jun 12 18:31:17.706613 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.706564 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sbjhs" podStartSLOduration=4.387226641 podStartE2EDuration="22.706550575s" totalImagesPullingTime="18.319323934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:17.706192316 +0000 UTC m=+22.644954311" watchObservedRunningTime="2026-06-12 18:31:17.706550575 +0000 UTC m=+22.645312572" Jun 12 18:31:17.963309 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:17.963089 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 18:31:18.498356 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:18.498328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:18.498545 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:18.498447 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:18.499497 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:18.499395 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T18:31:17.963297241Z","UUID":"e0eec873-ef68-4aaf-ab58-f0992d32cbd5","Handler":null,"Name":"","Endpoint":""} Jun 12 18:31:18.501465 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:18.501430 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 18:31:18.501585 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:18.501473 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 18:31:18.616634 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:18.616593 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k4pkt" event={"ID":"c5beee50-dc70-4fb5-a035-cc771afd231b","Type":"ContainerStarted","Data":"adb48be5b8e7cb5ea308dba119bdeb6ab4666de43b3567ea13e1571ad158eb7e"} Jun 12 18:31:18.619336 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:18.619274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" event={"ID":"b208043e-0f3b-4ef2-b4a2-931a81a82a39","Type":"ContainerStarted","Data":"65f41c2603fc606264e2c36da68e6e56d07587df855c70984bbf6f4817df9c85"} Jun 12 18:31:19.498847 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:19.498820 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:19.498960 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:19.498941 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:19.499024 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:19.498998 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:19.499147 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:19.499121 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:19.624279 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:19.624243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" event={"ID":"b208043e-0f3b-4ef2-b4a2-931a81a82a39","Type":"ContainerStarted","Data":"76fe15d41e9d9592cfb5c374ae96225520ce16585b5c70dace8f136a11763b10"} Jun 12 18:31:19.627592 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:19.627556 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:31:19.627945 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:19.627924 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" event={"ID":"1f7b8255-8a37-4357-9a7c-4fc2aa60f626","Type":"ContainerStarted","Data":"6ade740f6e495e26bd2a94510965fa644ab26ae677f11c874735f5bd50d31524"} Jun 12 18:31:19.645785 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:19.645740 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-znzf7" podStartSLOduration=4.296261593 podStartE2EDuration="24.645723846s" totalImagesPullingTime="20.349462253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:19.645477155 +0000 UTC m=+24.584239153" watchObservedRunningTime="2026-06-12 18:31:19.645723846 +0000 UTC m=+24.584485842" Jun 12 18:31:19.646205 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:19.646181 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k4pkt" podStartSLOduration=6.326333447 podStartE2EDuration="24.646175455s" totalImagesPullingTime="18.319842008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:18.642703394 +0000 UTC m=+23.581465394" watchObservedRunningTime="2026-06-12 18:31:19.646175455 +0000 UTC m=+24.584937451" Jun 12 18:31:20.498131 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:20.498099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:20.498337 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:20.498217 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:21.498506 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:21.498474 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:21.499238 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:21.498487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:21.499238 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:21.498636 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:21.499238 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:21.498699 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:22.279920 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:22.279743 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:31:22.280307 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:22.280288 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:31:22.498013 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:22.497985 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:22.498151 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:22.498080 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:22.636669 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:22.636639 2564 generic.go:356] "Generic (PLEG): container finished" podID="86fa01de-334d-439a-ac57-9897fbc27322" containerID="78650764bd3ece267b4fa94ce592bff3250b6d33000a18818acbf1425e5292af" exitCode=0 Jun 12 18:31:22.637089 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:22.636729 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" event={"ID":"86fa01de-334d-439a-ac57-9897fbc27322","Type":"ContainerDied","Data":"78650764bd3ece267b4fa94ce592bff3250b6d33000a18818acbf1425e5292af"} Jun 12 18:31:22.640431 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:22.640408 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:31:22.640807 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:22.640776 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" event={"ID":"1f7b8255-8a37-4357-9a7c-4fc2aa60f626","Type":"ContainerStarted","Data":"bdbad8fbc2b12a40c67db75b59f62f3d036f1392bd254a1e0b37cd5fda8f013d"} Jun 12 18:31:22.641018 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:22.641003 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:31:22.641264 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:22.641245 2564 scope.go:117] "RemoveContainer" containerID="f447f956a3d6e3dee31d7a437ea61fbe00c446dc123c514d11782bc92324e7ef" Jun 12 18:31:22.641426 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:22.641412 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c8mch" Jun 12 18:31:23.498264 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.498118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:23.498358 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.498178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:23.498358 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:23.498341 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:23.498477 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:23.498414 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:23.644729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.644652 2564 generic.go:356] "Generic (PLEG): container finished" podID="86fa01de-334d-439a-ac57-9897fbc27322" containerID="62f979fdda2ae777598a16d0893a9b7e33e5e5409b95becdc7d5bf7a8765b902" exitCode=0 Jun 12 18:31:23.644729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.644713 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" event={"ID":"86fa01de-334d-439a-ac57-9897fbc27322","Type":"ContainerDied","Data":"62f979fdda2ae777598a16d0893a9b7e33e5e5409b95becdc7d5bf7a8765b902"} Jun 12 18:31:23.648559 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.648542 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:31:23.648883 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.648864 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" event={"ID":"1f7b8255-8a37-4357-9a7c-4fc2aa60f626","Type":"ContainerStarted","Data":"f159f9f6eee8b6949f2de58a506b46a4438fc9983d21fd217a202f4398041bfb"} Jun 12 18:31:23.649097 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.649081 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:31:23.649168 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.649157 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:31:23.649220 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.649209 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:31:23.663846 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.663825 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:31:23.664077 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.664066 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:31:23.680504 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.680478 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4dmzd"] Jun 12 18:31:23.680652 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.680597 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:23.680725 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:23.680702 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:23.683641 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.683620 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rzhxp"] Jun 12 18:31:23.683767 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.683714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:23.683815 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:23.683790 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:23.684366 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.684343 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zxk4r"] Jun 12 18:31:23.684446 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.684432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:23.684538 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:23.684519 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:23.690399 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:23.690352 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" podStartSLOduration=10.295893511 podStartE2EDuration="28.690333807s" totalImagesPullingTime="18.394440296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:23.689142476 +0000 UTC m=+28.627904475" watchObservedRunningTime="2026-06-12 18:31:23.690333807 +0000 UTC m=+28.629095804" Jun 12 18:31:24.655651 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:24.655619 2564 generic.go:356] "Generic (PLEG): container finished" podID="86fa01de-334d-439a-ac57-9897fbc27322" containerID="297af538bd81a7a12593553be78b1ee91e45f2c85d46dbe27942121c3c268121" exitCode=0 Jun 12 18:31:24.656201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:24.655706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" event={"ID":"86fa01de-334d-439a-ac57-9897fbc27322","Type":"ContainerDied","Data":"297af538bd81a7a12593553be78b1ee91e45f2c85d46dbe27942121c3c268121"} Jun 12 18:31:25.499295 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:25.499265 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:25.499470 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:25.499352 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:25.499470 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:25.499393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:25.499547 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:25.499524 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:25.499597 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:25.499559 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:25.499683 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:25.499665 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:27.498816 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:27.498781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:27.499276 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:27.498890 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rzhxp" podUID="f815076e-dca9-4955-b1d3-fd86bb4be28a" Jun 12 18:31:27.499276 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:27.498781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:27.499276 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:27.498972 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxk4r" podUID="d08d72a8-3550-4fe7-9823-7382ef593bc2" Jun 12 18:31:27.499276 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:27.498790 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:27.499276 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:27.499044 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dmzd" podUID="f025ae2f-0c71-4565-b247-20a5a36792a3" Jun 12 18:31:29.202322 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.202280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:29.202789 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.202335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:29.202789 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:29.202465 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:29.202789 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:29.202534 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret podName:f025ae2f-0c71-4565-b247-20a5a36792a3 nodeName:}" failed. No retries permitted until 2026-06-12 18:32:01.202514745 +0000 UTC m=+66.141276726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret") pod "global-pull-secret-syncer-4dmzd" (UID: "f025ae2f-0c71-4565-b247-20a5a36792a3") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:29.202789 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:29.202606 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:29.202789 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:29.202667 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs podName:d08d72a8-3550-4fe7-9823-7382ef593bc2 nodeName:}" failed. No retries permitted until 2026-06-12 18:32:01.20265001 +0000 UTC m=+66.141411993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs") pod "network-metrics-daemon-zxk4r" (UID: "d08d72a8-3550-4fe7-9823-7382ef593bc2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:29.303777 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.303593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngnk\" (UniqueName: \"kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk\") pod \"network-check-target-rzhxp\" (UID: \"f815076e-dca9-4955-b1d3-fd86bb4be28a\") " pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:29.303913 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:29.303745 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:31:29.303913 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:29.303859 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:31:29.303913 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:29.303876 2564 projected.go:196] Error preparing data for projected volume kube-api-access-dngnk for pod openshift-network-diagnostics/network-check-target-rzhxp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:29.304025 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:29.303933 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk podName:f815076e-dca9-4955-b1d3-fd86bb4be28a nodeName:}" failed. No retries permitted until 2026-06-12 18:32:01.303917289 +0000 UTC m=+66.242679263 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dngnk" (UniqueName: "kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk") pod "network-check-target-rzhxp" (UID: "f815076e-dca9-4955-b1d3-fd86bb4be28a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:29.400882 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.400852 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-164.ec2.internal" event="NodeReady" Jun 12 18:31:29.401052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.401026 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 18:31:29.480021 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.479897 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mt57m"] Jun 12 18:31:29.507729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.507086 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r89pk"] Jun 12 18:31:29.507729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.507132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:31:29.507729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.507608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:31:29.508688 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.508659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.508965 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.508944 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:31:29.510759 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.510678 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:31:29.510886 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.510764 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-95v5g\"" Jun 12 18:31:29.516596 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.516549 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 18:31:29.516703 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.516678 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 18:31:29.516767 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.516715 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:31:29.516830 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.516768 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:31:29.517072 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.517029 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:31:29.517164 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.517108 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wglwb\"" Jun 12 18:31:29.517164 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.517031 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45p5c\"" Jun 12 18:31:29.522886 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.522868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r89pk" Jun 12 18:31:29.527122 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.527098 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mt57m"] Jun 12 18:31:29.527232 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.527157 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r89pk"] Jun 12 18:31:29.531792 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.531772 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 18:31:29.532210 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.532192 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 18:31:29.532300 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.532233 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nflgq\"" Jun 12 18:31:29.532469 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.532454 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 18:31:29.605614 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.605568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-tmp-dir\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.605614 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.605625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m8jr\" (UniqueName: \"kubernetes.io/projected/e7a5185a-b74c-48c6-94bc-753720b3f316-kube-api-access-8m8jr\") pod \"ingress-canary-r89pk\" (UID: \"e7a5185a-b74c-48c6-94bc-753720b3f316\") " pod="openshift-ingress-canary/ingress-canary-r89pk" Jun 12 18:31:29.605902 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.605668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gbfh\" (UniqueName: \"kubernetes.io/projected/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-kube-api-access-9gbfh\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.605902 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.605801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.605902 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.605838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-config-volume\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.605902 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.605878 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7a5185a-b74c-48c6-94bc-753720b3f316-cert\") pod \"ingress-canary-r89pk\" (UID: \"e7a5185a-b74c-48c6-94bc-753720b3f316\") " pod="openshift-ingress-canary/ingress-canary-r89pk" Jun 12 18:31:29.707127 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.707095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gbfh\" (UniqueName: \"kubernetes.io/projected/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-kube-api-access-9gbfh\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.707313 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.707146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.707313 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.707180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-config-volume\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.707313 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.707208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7a5185a-b74c-48c6-94bc-753720b3f316-cert\") pod \"ingress-canary-r89pk\" (UID: \"e7a5185a-b74c-48c6-94bc-753720b3f316\") " pod="openshift-ingress-canary/ingress-canary-r89pk" Jun 12 18:31:29.707313 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.707269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-tmp-dir\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.707313 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.707294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m8jr\" (UniqueName: \"kubernetes.io/projected/e7a5185a-b74c-48c6-94bc-753720b3f316-kube-api-access-8m8jr\") pod \"ingress-canary-r89pk\" (UID: \"e7a5185a-b74c-48c6-94bc-753720b3f316\") " pod="openshift-ingress-canary/ingress-canary-r89pk" Jun 12 18:31:29.707617 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:29.707322 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:31:29.707617 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:29.707392 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls podName:f28ec3a4-90e7-45b1-b508-6bb325f89d5a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:30.207371562 +0000 UTC m=+35.146133542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls") pod "dns-default-mt57m" (UID: "f28ec3a4-90e7-45b1-b508-6bb325f89d5a") : secret "dns-default-metrics-tls" not found Jun 12 18:31:29.707826 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.707800 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-tmp-dir\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.707988 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.707964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-config-volume\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.711973 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.711952 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7a5185a-b74c-48c6-94bc-753720b3f316-cert\") pod \"ingress-canary-r89pk\" (UID: \"e7a5185a-b74c-48c6-94bc-753720b3f316\") " pod="openshift-ingress-canary/ingress-canary-r89pk" Jun 12 18:31:29.716424 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.716375 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gbfh\" (UniqueName: \"kubernetes.io/projected/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-kube-api-access-9gbfh\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:29.716762 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.716739 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m8jr\" (UniqueName: \"kubernetes.io/projected/e7a5185a-b74c-48c6-94bc-753720b3f316-kube-api-access-8m8jr\") pod \"ingress-canary-r89pk\" (UID: \"e7a5185a-b74c-48c6-94bc-753720b3f316\") " pod="openshift-ingress-canary/ingress-canary-r89pk" Jun 12 18:31:29.848367 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:29.848250 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r89pk" Jun 12 18:31:30.210501 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:30.210461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:30.211074 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:30.210630 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:31:30.211074 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:30.210699 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls podName:f28ec3a4-90e7-45b1-b508-6bb325f89d5a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:31.210681009 +0000 UTC m=+36.149442983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls") pod "dns-default-mt57m" (UID: "f28ec3a4-90e7-45b1-b508-6bb325f89d5a") : secret "dns-default-metrics-tls" not found Jun 12 18:31:30.771176 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:30.771145 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r89pk"] Jun 12 18:31:30.852973 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:31:30.852897 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a5185a_b74c_48c6_94bc_753720b3f316.slice/crio-05898aaece2e577b9c748501215950222aa3bf5270b47ce984f0fe7a8e1ae4ab WatchSource:0}: Error finding container 05898aaece2e577b9c748501215950222aa3bf5270b47ce984f0fe7a8e1ae4ab: Status 404 returned error can't find the container with id 05898aaece2e577b9c748501215950222aa3bf5270b47ce984f0fe7a8e1ae4ab Jun 12 18:31:31.220371 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.220200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:31.220371 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:31.220360 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:31:31.220816 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:31.220430 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls podName:f28ec3a4-90e7-45b1-b508-6bb325f89d5a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:33.220414165 +0000 UTC m=+38.159176142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls") pod "dns-default-mt57m" (UID: "f28ec3a4-90e7-45b1-b508-6bb325f89d5a") : secret "dns-default-metrics-tls" not found Jun 12 18:31:31.306977 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.306947 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kw7b5"] Jun 12 18:31:31.323848 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.323816 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.326995 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.326969 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h7n2m\"" Jun 12 18:31:31.327913 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.327891 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 18:31:31.328046 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.327891 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 18:31:31.328046 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.327967 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 18:31:31.328046 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.328012 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 18:31:31.355273 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.355247 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kw7b5"] Jun 12 18:31:31.422494 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.422461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3fb8581b-3c09-4d63-b32a-a02bce513351-crio-socket\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.422669 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.422514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.422669 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.422555 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fb8581b-3c09-4d63-b32a-a02bce513351-data-volume\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.422669 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.422631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zfpd\" (UniqueName: \"kubernetes.io/projected/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-api-access-8zfpd\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.422669 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.422654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.523233 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.523138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.523233 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.523196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3fb8581b-3c09-4d63-b32a-a02bce513351-crio-socket\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.523477 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.523241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.523477 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.523285 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fb8581b-3c09-4d63-b32a-a02bce513351-data-volume\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.523477 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:31.523298 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:31:31.523477 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.523353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zfpd\" (UniqueName: \"kubernetes.io/projected/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-api-access-8zfpd\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.523477 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:31.523379 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:32.023362161 +0000 UTC m=+36.962124168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : configmap "kube-rbac-proxy" not found Jun 12 18:31:31.523477 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:31.523406 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:31.523477 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:31.523471 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:32.023454401 +0000 UTC m=+36.962216376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:31.523879 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.523490 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3fb8581b-3c09-4d63-b32a-a02bce513351-crio-socket\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.524068 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.524048 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fb8581b-3c09-4d63-b32a-a02bce513351-data-volume\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.543512 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.543479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zfpd\" (UniqueName: \"kubernetes.io/projected/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-api-access-8zfpd\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:31.677797 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.677758 2564 generic.go:356] "Generic (PLEG): container finished" podID="86fa01de-334d-439a-ac57-9897fbc27322" containerID="6908eb181bd595a5549b8c5dafea32ab92615dce087825ba229c1400da9e6f0c" exitCode=0 Jun 12 18:31:31.677984 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.677838 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" event={"ID":"86fa01de-334d-439a-ac57-9897fbc27322","Type":"ContainerDied","Data":"6908eb181bd595a5549b8c5dafea32ab92615dce087825ba229c1400da9e6f0c"} Jun 12 18:31:31.679356 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:31.679328 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r89pk" event={"ID":"e7a5185a-b74c-48c6-94bc-753720b3f316","Type":"ContainerStarted","Data":"05898aaece2e577b9c748501215950222aa3bf5270b47ce984f0fe7a8e1ae4ab"} Jun 12 18:31:32.027935 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.027902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:32.028123 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.027969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:32.028123 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:32.028068 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:31:32.028232 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:32.028152 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:33.028131027 +0000 UTC m=+37.966893009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : configmap "kube-rbac-proxy" not found Jun 12 18:31:32.028232 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:32.028153 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:32.028232 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:32.028217 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:33.02820072 +0000 UTC m=+37.966962695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:32.684611 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.684562 2564 generic.go:356] "Generic (PLEG): container finished" podID="86fa01de-334d-439a-ac57-9897fbc27322" containerID="7c429b2a49c222e6e30bf11583be4018a7221127a8073f5e6cb63de1315e1699" exitCode=0 Jun 12 18:31:32.684611 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.684604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" event={"ID":"86fa01de-334d-439a-ac57-9897fbc27322","Type":"ContainerDied","Data":"7c429b2a49c222e6e30bf11583be4018a7221127a8073f5e6cb63de1315e1699"} Jun 12 18:31:32.732765 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.732737 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s"] Jun 12 18:31:32.744182 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.744159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s" Jun 12 18:31:32.747062 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.746865 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 12 18:31:32.747062 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.746882 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 12 18:31:32.747467 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.747066 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lvbsn\"" Jun 12 18:31:32.748141 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.748120 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s"] Jun 12 18:31:32.833831 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.833808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdcs8\" (UniqueName: \"kubernetes.io/projected/3bc3f6e3-f4f3-4531-84f3-7708c96786c9-kube-api-access-hdcs8\") pod \"migrator-d4bcd4867-vc92s\" (UID: \"3bc3f6e3-f4f3-4531-84f3-7708c96786c9\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s" Jun 12 18:31:32.935342 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.935262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdcs8\" (UniqueName: \"kubernetes.io/projected/3bc3f6e3-f4f3-4531-84f3-7708c96786c9-kube-api-access-hdcs8\") pod \"migrator-d4bcd4867-vc92s\" (UID: \"3bc3f6e3-f4f3-4531-84f3-7708c96786c9\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s" Jun 12 18:31:32.943379 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:32.943353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdcs8\" (UniqueName: \"kubernetes.io/projected/3bc3f6e3-f4f3-4531-84f3-7708c96786c9-kube-api-access-hdcs8\") pod \"migrator-d4bcd4867-vc92s\" (UID: \"3bc3f6e3-f4f3-4531-84f3-7708c96786c9\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s" Jun 12 18:31:33.036338 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.036301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:33.036556 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.036350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:33.036660 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:33.036628 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:33.036754 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:33.036730 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:35.036699588 +0000 UTC m=+39.975461627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:33.036821 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:33.036766 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:31:33.036873 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:33.036822 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:35.036800975 +0000 UTC m=+39.975562968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : configmap "kube-rbac-proxy" not found Jun 12 18:31:33.054378 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.054345 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s" Jun 12 18:31:33.150501 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.150295 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jdlf6_a2599d11-5c45-411f-af19-4f166bb99e11/dns-node-resolver/0.log" Jun 12 18:31:33.208662 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.208628 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s"] Jun 12 18:31:33.214063 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:31:33.214032 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc3f6e3_f4f3_4531_84f3_7708c96786c9.slice/crio-7821863f93e6f11db48aff31c964fad912bd3b5064dc75f20fad436069dfd27f WatchSource:0}: Error finding container 7821863f93e6f11db48aff31c964fad912bd3b5064dc75f20fad436069dfd27f: Status 404 returned error can't find the container with id 7821863f93e6f11db48aff31c964fad912bd3b5064dc75f20fad436069dfd27f Jun 12 18:31:33.237992 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.237968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:33.238130 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:33.238076 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:31:33.238130 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:33.238124 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls podName:f28ec3a4-90e7-45b1-b508-6bb325f89d5a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:37.23810986 +0000 UTC m=+42.176871834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls") pod "dns-default-mt57m" (UID: "f28ec3a4-90e7-45b1-b508-6bb325f89d5a") : secret "dns-default-metrics-tls" not found Jun 12 18:31:33.687958 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.687928 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s" event={"ID":"3bc3f6e3-f4f3-4531-84f3-7708c96786c9","Type":"ContainerStarted","Data":"7821863f93e6f11db48aff31c964fad912bd3b5064dc75f20fad436069dfd27f"} Jun 12 18:31:33.689300 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.689272 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r89pk" event={"ID":"e7a5185a-b74c-48c6-94bc-753720b3f316","Type":"ContainerStarted","Data":"3bf283d5fd28f84a2afac24bfe12fdc04898b1cb35a212a60fa29411dd2f4848"} Jun 12 18:31:33.692203 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.692180 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" event={"ID":"86fa01de-334d-439a-ac57-9897fbc27322","Type":"ContainerStarted","Data":"9b9f47b18178e6a0088697251b32aa8176c515a429e4f96bdb1136fd8aba2f8e"} Jun 12 18:31:33.705223 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.705182 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r89pk" podStartSLOduration=2.7981520399999997 podStartE2EDuration="4.705155167s" totalImagesPullingTime="1.907003127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:33.70473253 +0000 UTC m=+38.643494527" watchObservedRunningTime="2026-06-12 18:31:33.705155167 +0000 UTC m=+38.643917173" Jun 12 18:31:33.727536 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.727494 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qx8rj" podStartSLOduration=8.887958919999999 podStartE2EDuration="38.727480588s" totalImagesPullingTime="29.839521668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:33.726326299 +0000 UTC m=+38.665088294" watchObservedRunningTime="2026-06-12 18:31:33.727480588 +0000 UTC m=+38.666242584" Jun 12 18:31:33.932014 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.931972 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-s5fgt"] Jun 12 18:31:33.938173 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.938111 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:33.940814 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.940790 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-v572j\"" Jun 12 18:31:33.940954 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.940789 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 12 18:31:33.940954 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.940790 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 12 18:31:33.940954 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.940792 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 12 18:31:33.941780 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.941759 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 12 18:31:33.946106 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:33.946044 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-s5fgt"] Jun 12 18:31:34.045540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.045506 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dbed466a-5f4f-4a95-9e61-e0d0212837a1-signing-key\") pod \"service-ca-7b994bc59-s5fgt\" (UID: \"dbed466a-5f4f-4a95-9e61-e0d0212837a1\") " pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:34.045736 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.045673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dbed466a-5f4f-4a95-9e61-e0d0212837a1-signing-cabundle\") pod \"service-ca-7b994bc59-s5fgt\" (UID: \"dbed466a-5f4f-4a95-9e61-e0d0212837a1\") " pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:34.045736 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.045697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vd82\" (UniqueName: \"kubernetes.io/projected/dbed466a-5f4f-4a95-9e61-e0d0212837a1-kube-api-access-8vd82\") pod \"service-ca-7b994bc59-s5fgt\" (UID: \"dbed466a-5f4f-4a95-9e61-e0d0212837a1\") " pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:34.146904 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.146868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dbed466a-5f4f-4a95-9e61-e0d0212837a1-signing-cabundle\") pod \"service-ca-7b994bc59-s5fgt\" (UID: \"dbed466a-5f4f-4a95-9e61-e0d0212837a1\") " pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:34.147132 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.146911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vd82\" (UniqueName: \"kubernetes.io/projected/dbed466a-5f4f-4a95-9e61-e0d0212837a1-kube-api-access-8vd82\") pod \"service-ca-7b994bc59-s5fgt\" (UID: \"dbed466a-5f4f-4a95-9e61-e0d0212837a1\") " pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:34.147132 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.146937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dbed466a-5f4f-4a95-9e61-e0d0212837a1-signing-key\") pod \"service-ca-7b994bc59-s5fgt\" (UID: \"dbed466a-5f4f-4a95-9e61-e0d0212837a1\") " pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:34.147591 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.147552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dbed466a-5f4f-4a95-9e61-e0d0212837a1-signing-cabundle\") pod \"service-ca-7b994bc59-s5fgt\" (UID: \"dbed466a-5f4f-4a95-9e61-e0d0212837a1\") " pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:34.150169 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.150144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dbed466a-5f4f-4a95-9e61-e0d0212837a1-signing-key\") pod \"service-ca-7b994bc59-s5fgt\" (UID: \"dbed466a-5f4f-4a95-9e61-e0d0212837a1\") " pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:34.155376 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.155354 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vd82\" (UniqueName: \"kubernetes.io/projected/dbed466a-5f4f-4a95-9e61-e0d0212837a1-kube-api-access-8vd82\") pod \"service-ca-7b994bc59-s5fgt\" (UID: \"dbed466a-5f4f-4a95-9e61-e0d0212837a1\") " pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:34.249991 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.249915 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" Jun 12 18:31:34.349397 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.349371 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sbjhs_81765229-3f4f-40a1-9f61-ce6b693176b3/node-ca/0.log" Jun 12 18:31:34.607219 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.607188 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-s5fgt"] Jun 12 18:31:34.612400 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:31:34.612375 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbed466a_5f4f_4a95_9e61_e0d0212837a1.slice/crio-8d1517bba6384a98fd97cc0a7e0a16eaaf20fc3a8d13893b176fe504b329ceab WatchSource:0}: Error finding container 8d1517bba6384a98fd97cc0a7e0a16eaaf20fc3a8d13893b176fe504b329ceab: Status 404 returned error can't find the container with id 8d1517bba6384a98fd97cc0a7e0a16eaaf20fc3a8d13893b176fe504b329ceab Jun 12 18:31:34.695304 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:34.695271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" event={"ID":"dbed466a-5f4f-4a95-9e61-e0d0212837a1","Type":"ContainerStarted","Data":"8d1517bba6384a98fd97cc0a7e0a16eaaf20fc3a8d13893b176fe504b329ceab"} Jun 12 18:31:35.052487 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:35.052458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:35.052643 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:35.052510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:35.052643 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:35.052617 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:31:35.052643 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:35.052635 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:35.052799 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:35.052678 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:39.052666031 +0000 UTC m=+43.991428005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:35.052799 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:35.052699 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:39.052692358 +0000 UTC m=+43.991454331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : configmap "kube-rbac-proxy" not found Jun 12 18:31:35.147095 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:35.147068 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r89pk_e7a5185a-b74c-48c6-94bc-753720b3f316/serve-healthcheck-canary/0.log" Jun 12 18:31:35.700267 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:35.700223 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s" event={"ID":"3bc3f6e3-f4f3-4531-84f3-7708c96786c9","Type":"ContainerStarted","Data":"a48d584b1539f3e5610811b110d253fb9a24dd95a2a13823072ec75459ab064b"} Jun 12 18:31:35.700819 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:35.700290 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s" event={"ID":"3bc3f6e3-f4f3-4531-84f3-7708c96786c9","Type":"ContainerStarted","Data":"9d8c51472010deabe010b9d6a4bd696b02c01a96933428af7094f19f95e040c2"} Jun 12 18:31:35.732631 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:35.732556 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-vc92s" podStartSLOduration=2.134131765 podStartE2EDuration="3.732535734s" totalImagesPullingTime="1.598403969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:35.731597016 +0000 UTC m=+40.670359012" watchObservedRunningTime="2026-06-12 18:31:35.732535734 +0000 UTC m=+40.671297732" Jun 12 18:31:37.270249 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:37.270158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:37.270709 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:37.270282 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:31:37.270709 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:37.270336 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls podName:f28ec3a4-90e7-45b1-b508-6bb325f89d5a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:45.270321666 +0000 UTC m=+50.209083640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls") pod "dns-default-mt57m" (UID: "f28ec3a4-90e7-45b1-b508-6bb325f89d5a") : secret "dns-default-metrics-tls" not found Jun 12 18:31:37.706526 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:37.706488 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" event={"ID":"dbed466a-5f4f-4a95-9e61-e0d0212837a1","Type":"ContainerStarted","Data":"1e7f0be3f5db91c9025a1d0f7cab9de54b8de4f9108d2f8f7083f1b9170cc50f"} Jun 12 18:31:37.724034 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:37.723985 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-s5fgt" podStartSLOduration=2.431278356 podStartE2EDuration="4.723972232s" totalImagesPullingTime="2.292693876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:37.723819752 +0000 UTC m=+42.662581749" watchObservedRunningTime="2026-06-12 18:31:37.723972232 +0000 UTC m=+42.662734206" Jun 12 18:31:39.086860 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:39.086821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:39.087213 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:39.086895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:39.087213 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:39.086962 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:31:39.087213 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:39.087010 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:39.087213 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:39.087047 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:47.08702506 +0000 UTC m=+52.025787043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : configmap "kube-rbac-proxy" not found Jun 12 18:31:39.087213 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:39.087066 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:47.087057562 +0000 UTC m=+52.025819541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:45.337156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:45.337115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:45.340437 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:45.340415 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28ec3a4-90e7-45b1-b508-6bb325f89d5a-metrics-tls\") pod \"dns-default-mt57m\" (UID: \"f28ec3a4-90e7-45b1-b508-6bb325f89d5a\") " pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:45.436909 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:45.436872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:45.593172 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:45.593095 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mt57m"] Jun 12 18:31:45.595765 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:31:45.595739 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28ec3a4_90e7_45b1_b508_6bb325f89d5a.slice/crio-b6ddcc824a21c7e2d3f37f820838dc8ddd93e3fb672f73a4fac4b6ef2dda48d1 WatchSource:0}: Error finding container b6ddcc824a21c7e2d3f37f820838dc8ddd93e3fb672f73a4fac4b6ef2dda48d1: Status 404 returned error can't find the container with id b6ddcc824a21c7e2d3f37f820838dc8ddd93e3fb672f73a4fac4b6ef2dda48d1 Jun 12 18:31:45.727233 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:45.727200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mt57m" event={"ID":"f28ec3a4-90e7-45b1-b508-6bb325f89d5a","Type":"ContainerStarted","Data":"b6ddcc824a21c7e2d3f37f820838dc8ddd93e3fb672f73a4fac4b6ef2dda48d1"} Jun 12 18:31:47.152915 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:47.152864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:47.153327 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:47.152934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:47.153327 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:47.153120 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:47.153327 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:31:47.153194 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls podName:3fb8581b-3c09-4d63-b32a-a02bce513351 nodeName:}" failed. No retries permitted until 2026-06-12 18:32:03.153176423 +0000 UTC m=+68.091938417 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw7b5" (UID: "3fb8581b-3c09-4d63-b32a-a02bce513351") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:47.153504 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:47.153480 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fb8581b-3c09-4d63-b32a-a02bce513351-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:31:48.737264 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:48.737221 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mt57m" event={"ID":"f28ec3a4-90e7-45b1-b508-6bb325f89d5a","Type":"ContainerStarted","Data":"60ff109236b91362ce2ddbd5122c491a1f710e7aa5535cbbcd377c1df705067a"} Jun 12 18:31:48.737670 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:48.737322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mt57m" event={"ID":"f28ec3a4-90e7-45b1-b508-6bb325f89d5a","Type":"ContainerStarted","Data":"256a36b6c1737be79e3fbf5fe9612e8e7df0c0206ee8e43948135cd87a543e5f"} Jun 12 18:31:48.737670 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:48.737353 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:48.764344 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:48.764283 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mt57m" podStartSLOduration=17.748058587 podStartE2EDuration="19.764265934s" totalImagesPullingTime="2.016207347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:48.764265482 +0000 UTC m=+53.703027482" watchObservedRunningTime="2026-06-12 18:31:48.764265934 +0000 UTC m=+53.703027928" Jun 12 18:31:55.456337 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.456302 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd"] Jun 12 18:31:55.463851 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.463829 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.469616 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.469590 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 18:31:55.469616 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.469612 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 12 18:31:55.469897 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.469880 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 18:31:55.470308 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.470286 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 12 18:31:55.470417 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.470320 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 18:31:55.470417 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.470397 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 12 18:31:55.470611 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.470397 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 12 18:31:55.477747 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.477726 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd"] Jun 12 18:31:55.512542 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.512518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-hub\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.512542 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.512546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-ca\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.512718 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.512591 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/896cbbdf-a439-483a-977c-09a6185e14f3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.512718 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.512620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtdpb\" (UniqueName: \"kubernetes.io/projected/896cbbdf-a439-483a-977c-09a6185e14f3-kube-api-access-jtdpb\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.512718 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.512647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.512718 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.512661 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.613553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.613524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-hub\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.613553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.613554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-ca\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.613772 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.613614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/896cbbdf-a439-483a-977c-09a6185e14f3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.613772 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.613641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtdpb\" (UniqueName: \"kubernetes.io/projected/896cbbdf-a439-483a-977c-09a6185e14f3-kube-api-access-jtdpb\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.613772 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.613676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.613772 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.613700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.614630 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.614599 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/896cbbdf-a439-483a-977c-09a6185e14f3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.616139 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.616102 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-ca\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.616272 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.616226 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-hub\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.616272 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.616246 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.616272 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.616251 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/896cbbdf-a439-483a-977c-09a6185e14f3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.626199 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.626172 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtdpb\" (UniqueName: \"kubernetes.io/projected/896cbbdf-a439-483a-977c-09a6185e14f3-kube-api-access-jtdpb\") pod \"cluster-proxy-proxy-agent-5f99586f6b-rmvrd\" (UID: \"896cbbdf-a439-483a-977c-09a6185e14f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.668507 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.668479 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j48wj" Jun 12 18:31:55.784869 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.784782 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" Jun 12 18:31:55.918536 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:55.918505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd"] Jun 12 18:31:55.922497 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:31:55.922473 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod896cbbdf_a439_483a_977c_09a6185e14f3.slice/crio-5ea64e726302f0597547cbe7ee19b9e3b2173c88101e901fc5a4014d6ee22290 WatchSource:0}: Error finding container 5ea64e726302f0597547cbe7ee19b9e3b2173c88101e901fc5a4014d6ee22290: Status 404 returned error can't find the container with id 5ea64e726302f0597547cbe7ee19b9e3b2173c88101e901fc5a4014d6ee22290 Jun 12 18:31:56.761976 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:56.761913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" event={"ID":"896cbbdf-a439-483a-977c-09a6185e14f3","Type":"ContainerStarted","Data":"5ea64e726302f0597547cbe7ee19b9e3b2173c88101e901fc5a4014d6ee22290"} Jun 12 18:31:58.742749 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:58.742719 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mt57m" Jun 12 18:31:59.775033 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:59.774998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" event={"ID":"896cbbdf-a439-483a-977c-09a6185e14f3","Type":"ContainerStarted","Data":"ff21642939797554412836dcadb705e05bbcec3de6b39ee11dd775e22f443eb4"} Jun 12 18:31:59.775424 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:59.775049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" event={"ID":"896cbbdf-a439-483a-977c-09a6185e14f3","Type":"ContainerStarted","Data":"c41814aa0810e1fbec0e2208b9af76f6ab77caa35443cb4ddf1ec50d883a62ee"} Jun 12 18:31:59.775424 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:59.775065 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" event={"ID":"896cbbdf-a439-483a-977c-09a6185e14f3","Type":"ContainerStarted","Data":"e2aedc8ea4afe22d5e8ade2fa0b1ad988bae9d7f7738094ead72c952c2b1a53e"} Jun 12 18:31:59.821372 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:31:59.821186 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f99586f6b-rmvrd" podStartSLOduration=1.5390445499999998 podStartE2EDuration="4.821164511s" totalImagesPullingTime="3.282119961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:59.820249774 +0000 UTC m=+64.759011770" watchObservedRunningTime="2026-06-12 18:31:59.821164511 +0000 UTC m=+64.759926507" Jun 12 18:32:01.262035 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.261986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:32:01.262035 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.262042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:32:01.266129 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.266108 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:32:01.267159 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.267142 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:32:01.275307 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.275284 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08d72a8-3550-4fe7-9823-7382ef593bc2-metrics-certs\") pod \"network-metrics-daemon-zxk4r\" (UID: \"d08d72a8-3550-4fe7-9823-7382ef593bc2\") " pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:32:01.275459 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.275390 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f025ae2f-0c71-4565-b247-20a5a36792a3-original-pull-secret\") pod \"global-pull-secret-syncer-4dmzd\" (UID: \"f025ae2f-0c71-4565-b247-20a5a36792a3\") " pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:32:01.324879 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.324842 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-95v5g\"" Jun 12 18:32:01.332635 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.332612 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxk4r" Jun 12 18:32:01.342562 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.342536 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dmzd" Jun 12 18:32:01.362696 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.362673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngnk\" (UniqueName: \"kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk\") pod \"network-check-target-rzhxp\" (UID: \"f815076e-dca9-4955-b1d3-fd86bb4be28a\") " pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:32:01.365408 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.365384 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:32:01.375384 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.375361 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:32:01.386180 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.386148 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dngnk\" (UniqueName: \"kubernetes.io/projected/f815076e-dca9-4955-b1d3-fd86bb4be28a-kube-api-access-dngnk\") pod \"network-check-target-rzhxp\" (UID: \"f815076e-dca9-4955-b1d3-fd86bb4be28a\") " pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:32:01.492569 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.492538 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-94twc"] Jun 12 18:32:01.499861 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:32:01.499825 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08d72a8_3550_4fe7_9823_7382ef593bc2.slice/crio-5f962bae7f009a5129f7d5d51016df2dd8798e1a284d0d760c03a2eaf7658dba WatchSource:0}: Error finding container 5f962bae7f009a5129f7d5d51016df2dd8798e1a284d0d760c03a2eaf7658dba: Status 404 returned error can't find the container with id 5f962bae7f009a5129f7d5d51016df2dd8798e1a284d0d760c03a2eaf7658dba Jun 12 18:32:01.526021 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.525946 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zxk4r"] Jun 12 18:32:01.526021 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.525994 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-94twc"] Jun 12 18:32:01.526372 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.526347 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.529344 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:32:01.529299 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf025ae2f_0c71_4565_b247_20a5a36792a3.slice/crio-fb0181de16a375c74d962b28cbb997167985ad8cd02caf7309a96e9a3f3e7f20 WatchSource:0}: Error finding container fb0181de16a375c74d962b28cbb997167985ad8cd02caf7309a96e9a3f3e7f20: Status 404 returned error can't find the container with id fb0181de16a375c74d962b28cbb997167985ad8cd02caf7309a96e9a3f3e7f20 Jun 12 18:32:01.530252 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.530195 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 12 18:32:01.530545 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.530529 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 18:32:01.530832 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.530814 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4dmzd"] Jun 12 18:32:01.531005 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.530989 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-clcbg\"" Jun 12 18:32:01.531167 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.531137 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 18:32:01.531602 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.531567 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 12 18:32:01.531706 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.531568 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 18:32:01.564123 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.564085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2c5c17-0de2-461a-87ba-2b94877fba7d-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.564302 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.564140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2c5c17-0de2-461a-87ba-2b94877fba7d-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.564302 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.564164 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae2c5c17-0de2-461a-87ba-2b94877fba7d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.564302 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.564226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6h76\" (UniqueName: \"kubernetes.io/projected/ae2c5c17-0de2-461a-87ba-2b94877fba7d-kube-api-access-q6h76\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.632602 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.632557 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wglwb\"" Jun 12 18:32:01.640820 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.640800 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:32:01.664821 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.664791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2c5c17-0de2-461a-87ba-2b94877fba7d-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.664950 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.664839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae2c5c17-0de2-461a-87ba-2b94877fba7d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.664950 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.664894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6h76\" (UniqueName: \"kubernetes.io/projected/ae2c5c17-0de2-461a-87ba-2b94877fba7d-kube-api-access-q6h76\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.664950 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:32:01.664924 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 12 18:32:01.665102 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:32:01.664984 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2c5c17-0de2-461a-87ba-2b94877fba7d-prometheus-operator-tls podName:ae2c5c17-0de2-461a-87ba-2b94877fba7d nodeName:}" failed. No retries permitted until 2026-06-12 18:32:02.164966105 +0000 UTC m=+67.103728093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ae2c5c17-0de2-461a-87ba-2b94877fba7d-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-94twc" (UID: "ae2c5c17-0de2-461a-87ba-2b94877fba7d") : secret "prometheus-operator-tls" not found Jun 12 18:32:01.665102 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.664924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2c5c17-0de2-461a-87ba-2b94877fba7d-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.665555 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.665533 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae2c5c17-0de2-461a-87ba-2b94877fba7d-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.667310 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.667288 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae2c5c17-0de2-461a-87ba-2b94877fba7d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.675445 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.675424 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6h76\" (UniqueName: \"kubernetes.io/projected/ae2c5c17-0de2-461a-87ba-2b94877fba7d-kube-api-access-q6h76\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:01.782140 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.782048 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxk4r" event={"ID":"d08d72a8-3550-4fe7-9823-7382ef593bc2","Type":"ContainerStarted","Data":"5f962bae7f009a5129f7d5d51016df2dd8798e1a284d0d760c03a2eaf7658dba"} Jun 12 18:32:01.783081 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.783058 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4dmzd" event={"ID":"f025ae2f-0c71-4565-b247-20a5a36792a3","Type":"ContainerStarted","Data":"fb0181de16a375c74d962b28cbb997167985ad8cd02caf7309a96e9a3f3e7f20"} Jun 12 18:32:01.785809 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:01.785784 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rzhxp"] Jun 12 18:32:01.788877 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:32:01.788852 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf815076e_dca9_4955_b1d3_fd86bb4be28a.slice/crio-aae9c550803353b935626ac974fd2fe7195588c0e95185bd9bcc61b1e52017f0 WatchSource:0}: Error finding container aae9c550803353b935626ac974fd2fe7195588c0e95185bd9bcc61b1e52017f0: Status 404 returned error can't find the container with id aae9c550803353b935626ac974fd2fe7195588c0e95185bd9bcc61b1e52017f0 Jun 12 18:32:02.169717 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:02.169673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2c5c17-0de2-461a-87ba-2b94877fba7d-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:02.172238 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:02.172211 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2c5c17-0de2-461a-87ba-2b94877fba7d-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-94twc\" (UID: \"ae2c5c17-0de2-461a-87ba-2b94877fba7d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:02.437400 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:02.437303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" Jun 12 18:32:02.642284 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:02.642245 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-94twc"] Jun 12 18:32:02.645681 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:32:02.645647 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2c5c17_0de2_461a_87ba_2b94877fba7d.slice/crio-565cbc3ec35924e44369986793243352f570996dbed531dc1027d496269f3dd7 WatchSource:0}: Error finding container 565cbc3ec35924e44369986793243352f570996dbed531dc1027d496269f3dd7: Status 404 returned error can't find the container with id 565cbc3ec35924e44369986793243352f570996dbed531dc1027d496269f3dd7 Jun 12 18:32:02.787899 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:02.787806 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" event={"ID":"ae2c5c17-0de2-461a-87ba-2b94877fba7d","Type":"ContainerStarted","Data":"565cbc3ec35924e44369986793243352f570996dbed531dc1027d496269f3dd7"} Jun 12 18:32:02.789167 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:02.789110 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rzhxp" event={"ID":"f815076e-dca9-4955-b1d3-fd86bb4be28a","Type":"ContainerStarted","Data":"aae9c550803353b935626ac974fd2fe7195588c0e95185bd9bcc61b1e52017f0"} Jun 12 18:32:03.178417 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:03.178388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:32:03.181272 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:03.181219 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fb8581b-3c09-4d63-b32a-a02bce513351-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw7b5\" (UID: \"3fb8581b-3c09-4d63-b32a-a02bce513351\") " pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:32:03.437700 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:03.437665 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h7n2m\"" Jun 12 18:32:03.444042 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:03.444009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kw7b5" Jun 12 18:32:03.625074 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:03.625036 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kw7b5"] Jun 12 18:32:03.629028 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:32:03.628981 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb8581b_3c09_4d63_b32a_a02bce513351.slice/crio-8bd347c5031669d85468a39f6a0cb359506b5dd66345863ba4cbd24979d521a8 WatchSource:0}: Error finding container 8bd347c5031669d85468a39f6a0cb359506b5dd66345863ba4cbd24979d521a8: Status 404 returned error can't find the container with id 8bd347c5031669d85468a39f6a0cb359506b5dd66345863ba4cbd24979d521a8 Jun 12 18:32:03.797110 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:03.796842 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxk4r" event={"ID":"d08d72a8-3550-4fe7-9823-7382ef593bc2","Type":"ContainerStarted","Data":"ca5de033d13789b72e07ef02da30b8cff4c36c63bd7650c723fd0eb5e0a7d115"} Jun 12 18:32:03.797110 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:03.796921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxk4r" event={"ID":"d08d72a8-3550-4fe7-9823-7382ef593bc2","Type":"ContainerStarted","Data":"c00a53e8b52181e7285f3a4327a84d7367f2fa27cfd9a7a0f699f2b37d52a84b"} Jun 12 18:32:03.799141 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:03.799060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kw7b5" event={"ID":"3fb8581b-3c09-4d63-b32a-a02bce513351","Type":"ContainerStarted","Data":"8bd347c5031669d85468a39f6a0cb359506b5dd66345863ba4cbd24979d521a8"} Jun 12 18:32:03.818018 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:03.817205 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zxk4r" podStartSLOduration=67.46422862 podStartE2EDuration="1m8.817179196s" totalImagesPullingTime="1.352950576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:03.816248968 +0000 UTC m=+68.755010965" watchObservedRunningTime="2026-06-12 18:32:03.817179196 +0000 UTC m=+68.755941194" Jun 12 18:32:07.815288 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:07.815241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4dmzd" event={"ID":"f025ae2f-0c71-4565-b247-20a5a36792a3","Type":"ContainerStarted","Data":"9df53a45b175a95f8d0f5fc34cde49b5ae30c0af3d73e5d70d0a49ccc2b30798"} Jun 12 18:32:07.817127 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:07.817093 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" event={"ID":"ae2c5c17-0de2-461a-87ba-2b94877fba7d","Type":"ContainerStarted","Data":"caea54bb2fb0c3c8dfc6a5b73370a5887a7472be263226eadc44ae40d410c2ef"} Jun 12 18:32:07.818761 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:07.818728 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rzhxp" event={"ID":"f815076e-dca9-4955-b1d3-fd86bb4be28a","Type":"ContainerStarted","Data":"6043f1483cf832c59318355cdf88ea170f0f7423108a04069e6a05e5ecc03bf5"} Jun 12 18:32:07.818897 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:07.818878 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:32:07.831097 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:07.831040 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4dmzd" podStartSLOduration=67.39348714 podStartE2EDuration="1m12.831022695s" totalImagesPullingTime="5.437535555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:07.830407045 +0000 UTC m=+72.769169065" watchObservedRunningTime="2026-06-12 18:32:07.831022695 +0000 UTC m=+72.769784670" Jun 12 18:32:07.846979 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:07.846923 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rzhxp" podStartSLOduration=67.667115751 podStartE2EDuration="1m12.846902794s" totalImagesPullingTime="5.179787043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:07.845356131 +0000 UTC m=+72.784118127" watchObservedRunningTime="2026-06-12 18:32:07.846902794 +0000 UTC m=+72.785664790" Jun 12 18:32:09.827497 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:09.827452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" event={"ID":"ae2c5c17-0de2-461a-87ba-2b94877fba7d","Type":"ContainerStarted","Data":"4b32e40fb3bd837aac25827e69b428b77a24ab5f667f788d8307b8a764b530ee"} Jun 12 18:32:09.829540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:09.829498 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kw7b5" event={"ID":"3fb8581b-3c09-4d63-b32a-a02bce513351","Type":"ContainerStarted","Data":"358ba5380b207c349f2d45fcc7b014b3bb62ed4f57c748c6ad3f1ec140101107"} Jun 12 18:32:09.847356 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:09.847307 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-94twc" podStartSLOduration=4.741222706 podStartE2EDuration="8.847290583s" totalImagesPullingTime="4.106067877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:09.846654907 +0000 UTC m=+74.785416902" watchObservedRunningTime="2026-06-12 18:32:09.847290583 +0000 UTC m=+74.786052579" Jun 12 18:32:10.835320 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:10.835271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kw7b5" event={"ID":"3fb8581b-3c09-4d63-b32a-a02bce513351","Type":"ContainerStarted","Data":"9063220a8378bb308748988b6992532f74218500d2b831879f6013dccaeef66d"} Jun 12 18:32:11.840979 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:11.840936 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kw7b5" event={"ID":"3fb8581b-3c09-4d63-b32a-a02bce513351","Type":"ContainerStarted","Data":"1b93fb51cee0c10832bb5e1a78861942d458302aff0a09581b22f7efc2f8312a"} Jun 12 18:32:11.864171 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:11.864114 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kw7b5" podStartSLOduration=33.295049092 podStartE2EDuration="40.864091947s" totalImagesPullingTime="7.569042855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:31:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:11.86192846 +0000 UTC m=+76.800690459" watchObservedRunningTime="2026-06-12 18:32:11.864091947 +0000 UTC m=+76.802853946" Jun 12 18:32:11.906149 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:11.906113 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d9w9r"] Jun 12 18:32:11.909305 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:11.909281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:11.912117 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:11.912087 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 18:32:11.912514 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:11.912490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d2n24\"" Jun 12 18:32:11.912642 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:11.912548 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 18:32:11.913038 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:11.913021 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 18:32:12.046386 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.046351 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-accelerators-collector-config\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.046611 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.046402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-textfile\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.046611 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.046423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23a2e901-422e-4af4-bd8a-5812d444e617-sys\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.046611 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.046440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/23a2e901-422e-4af4-bd8a-5812d444e617-root\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.046611 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.046510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-tls\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.046611 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.046540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23a2e901-422e-4af4-bd8a-5812d444e617-metrics-client-ca\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.046611 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.046561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.046930 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.046617 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-wtmp\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.046930 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.046653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trvb4\" (UniqueName: \"kubernetes.io/projected/23a2e901-422e-4af4-bd8a-5812d444e617-kube-api-access-trvb4\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.147740 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-textfile\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.147927 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23a2e901-422e-4af4-bd8a-5812d444e617-sys\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.147927 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/23a2e901-422e-4af4-bd8a-5812d444e617-root\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.147927 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-tls\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.147927 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23a2e901-422e-4af4-bd8a-5812d444e617-metrics-client-ca\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.147927 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.147927 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147856 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23a2e901-422e-4af4-bd8a-5812d444e617-sys\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.147927 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-wtmp\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.147927 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147871 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/23a2e901-422e-4af4-bd8a-5812d444e617-root\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.147927 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trvb4\" (UniqueName: \"kubernetes.io/projected/23a2e901-422e-4af4-bd8a-5812d444e617-kube-api-access-trvb4\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.148378 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.147943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-accelerators-collector-config\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.148378 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.148129 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-textfile\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.148378 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.148317 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-wtmp\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.148557 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.148492 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-accelerators-collector-config\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.148557 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.148519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23a2e901-422e-4af4-bd8a-5812d444e617-metrics-client-ca\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.150173 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.150147 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-tls\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.150267 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.150176 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23a2e901-422e-4af4-bd8a-5812d444e617-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.157425 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.157403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trvb4\" (UniqueName: \"kubernetes.io/projected/23a2e901-422e-4af4-bd8a-5812d444e617-kube-api-access-trvb4\") pod \"node-exporter-d9w9r\" (UID: \"23a2e901-422e-4af4-bd8a-5812d444e617\") " pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.218941 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.218909 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d9w9r" Jun 12 18:32:12.230717 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:32:12.230692 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a2e901_422e_4af4_bd8a_5812d444e617.slice/crio-ef58ee5da4929250b0ca42ed802725ec7c068413a50716f1f31669ff722d2456 WatchSource:0}: Error finding container ef58ee5da4929250b0ca42ed802725ec7c068413a50716f1f31669ff722d2456: Status 404 returned error can't find the container with id ef58ee5da4929250b0ca42ed802725ec7c068413a50716f1f31669ff722d2456 Jun 12 18:32:12.852055 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:12.852005 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9w9r" event={"ID":"23a2e901-422e-4af4-bd8a-5812d444e617","Type":"ContainerStarted","Data":"ef58ee5da4929250b0ca42ed802725ec7c068413a50716f1f31669ff722d2456"} Jun 12 18:32:13.857484 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.857450 2564 generic.go:356] "Generic (PLEG): container finished" podID="23a2e901-422e-4af4-bd8a-5812d444e617" containerID="a1986774049b5efb1c9223c4486d3e57e847a57167eab9a30f144bbea4ce2191" exitCode=0 Jun 12 18:32:13.857915 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.857491 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9w9r" event={"ID":"23a2e901-422e-4af4-bd8a-5812d444e617","Type":"ContainerDied","Data":"a1986774049b5efb1c9223c4486d3e57e847a57167eab9a30f144bbea4ce2191"} Jun 12 18:32:13.933363 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.933339 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b99fd6554-64f44"] Jun 12 18:32:13.936909 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.936892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:13.940133 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.940112 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 12 18:32:13.940417 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.940399 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 12 18:32:13.940494 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.940443 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 12 18:32:13.940494 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.940399 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pf8zr\"" Jun 12 18:32:13.940788 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.940764 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 12 18:32:13.940851 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.940808 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 12 18:32:13.940907 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.940806 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2i7scv68jp1nh\"" Jun 12 18:32:13.961280 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:13.961260 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b99fd6554-64f44"] Jun 12 18:32:14.075326 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.075296 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.075326 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.075338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ce97233-3964-4805-8c5c-843bb790d1f2-metrics-client-ca\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.075541 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.075380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-tls\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.075541 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.075422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.075541 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.075443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wpks\" (UniqueName: \"kubernetes.io/projected/1ce97233-3964-4805-8c5c-843bb790d1f2-kube-api-access-2wpks\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.075541 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.075472 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.075541 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.075489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.075541 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.075530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-grpc-tls\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.176458 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.176418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ce97233-3964-4805-8c5c-843bb790d1f2-metrics-client-ca\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.176644 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.176467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-tls\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.176644 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.176499 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.176729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.176683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wpks\" (UniqueName: \"kubernetes.io/projected/1ce97233-3964-4805-8c5c-843bb790d1f2-kube-api-access-2wpks\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.176773 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.176728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.176810 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.176791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.176900 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.176843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-grpc-tls\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.176900 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.176880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.177462 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.177313 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ce97233-3964-4805-8c5c-843bb790d1f2-metrics-client-ca\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.179124 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.179098 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.179318 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.179296 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-grpc-tls\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.179413 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.179398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-tls\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.179413 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.179404 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.179543 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.179523 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.179722 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.179705 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ce97233-3964-4805-8c5c-843bb790d1f2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.188491 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.188471 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wpks\" (UniqueName: \"kubernetes.io/projected/1ce97233-3964-4805-8c5c-843bb790d1f2-kube-api-access-2wpks\") pod \"thanos-querier-7b99fd6554-64f44\" (UID: \"1ce97233-3964-4805-8c5c-843bb790d1f2\") " pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.270464 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.270438 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:14.407344 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.406595 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b99fd6554-64f44"] Jun 12 18:32:14.408925 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:32:14.408899 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce97233_3964_4805_8c5c_843bb790d1f2.slice/crio-38fb430a4a7a1777793ff829f385e7d0586d37d29c2fdb021ce61c6766bfe433 WatchSource:0}: Error finding container 38fb430a4a7a1777793ff829f385e7d0586d37d29c2fdb021ce61c6766bfe433: Status 404 returned error can't find the container with id 38fb430a4a7a1777793ff829f385e7d0586d37d29c2fdb021ce61c6766bfe433 Jun 12 18:32:14.863009 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.862968 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" event={"ID":"1ce97233-3964-4805-8c5c-843bb790d1f2","Type":"ContainerStarted","Data":"38fb430a4a7a1777793ff829f385e7d0586d37d29c2fdb021ce61c6766bfe433"} Jun 12 18:32:14.865037 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.865011 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9w9r" event={"ID":"23a2e901-422e-4af4-bd8a-5812d444e617","Type":"ContainerStarted","Data":"8ab97e7aa12a3d0d525773bf6a5a0657620bc2c8df68d199c4f553a9bd2cc6b3"} Jun 12 18:32:14.865163 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.865062 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d9w9r" event={"ID":"23a2e901-422e-4af4-bd8a-5812d444e617","Type":"ContainerStarted","Data":"b3525357c87f5ead1844af7743f5022b912778c605bbd6c3aa4383f2a7ee876f"} Jun 12 18:32:14.887859 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:14.887820 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d9w9r" podStartSLOduration=2.8660499550000003 podStartE2EDuration="3.887805044s" totalImagesPullingTime="956.749711ms" totalInitContainerRuntime="65.005378ms" isStatefulPod=true podCreationTimestamp="2026-06-12 18:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:14.886794058 +0000 UTC m=+79.825556068" watchObservedRunningTime="2026-06-12 18:32:14.887805044 +0000 UTC m=+79.826567063" Jun 12 18:32:16.875625 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:16.875565 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" event={"ID":"1ce97233-3964-4805-8c5c-843bb790d1f2","Type":"ContainerStarted","Data":"c94e4d3d2ca5baacb64b65a88c62b8585d6e4b47bc71b223fea6b17d5ad34c5c"} Jun 12 18:32:16.876068 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:16.875688 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" event={"ID":"1ce97233-3964-4805-8c5c-843bb790d1f2","Type":"ContainerStarted","Data":"be2481afb20847c0562e8d33a4f00b43abe22aa52a570f43a65879d8a03c20ea"} Jun 12 18:32:16.876068 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:16.875719 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" event={"ID":"1ce97233-3964-4805-8c5c-843bb790d1f2","Type":"ContainerStarted","Data":"054d93a027232ec6d501cd78f860c321b4e734021161e456deb53aa07a45de6c"} Jun 12 18:32:18.885518 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:18.885481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" event={"ID":"1ce97233-3964-4805-8c5c-843bb790d1f2","Type":"ContainerStarted","Data":"72fe6d641c22fadca8b86fe0f6fd3ea21d4742b69286ed2b62d4ea1b5b088444"} Jun 12 18:32:18.885916 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:18.885551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" event={"ID":"1ce97233-3964-4805-8c5c-843bb790d1f2","Type":"ContainerStarted","Data":"1a0285944946a73d0240235a8471b034079afeaf533e226703ac650022be5f4b"} Jun 12 18:32:18.885916 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:18.885595 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" event={"ID":"1ce97233-3964-4805-8c5c-843bb790d1f2","Type":"ContainerStarted","Data":"850b7d1b8574bc42ca01b3efe75b270d7c9f45f444949d0eb645e1368c209c00"} Jun 12 18:32:18.885916 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:18.885630 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:18.914048 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:18.913997 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" podStartSLOduration=2.371375878 podStartE2EDuration="5.913981787s" totalImagesPullingTime="3.542605909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:32:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:18.911756377 +0000 UTC m=+83.850518365" watchObservedRunningTime="2026-06-12 18:32:18.913981787 +0000 UTC m=+83.852743783" Jun 12 18:32:24.895350 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:24.895317 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b99fd6554-64f44" Jun 12 18:32:38.825139 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:32:38.825108 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rzhxp" Jun 12 18:35:55.458073 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:35:55.458041 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:35:55.458562 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:35:55.458112 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:35:55.460540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:35:55.460519 2564 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 18:36:44.280699 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.280615 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2cr9q"] Jun 12 18:36:44.283424 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.283409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2cr9q" Jun 12 18:36:44.285949 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.285907 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 18:36:44.286090 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.285971 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ggbjz\"" Jun 12 18:36:44.286997 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.286975 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 18:36:44.294339 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.294316 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2cr9q"] Jun 12 18:36:44.305264 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.305247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c595379-58b0-4e41-89fc-75219623a629-bound-sa-token\") pod \"cert-manager-59c77684cc-2cr9q\" (UID: \"4c595379-58b0-4e41-89fc-75219623a629\") " pod="cert-manager/cert-manager-59c77684cc-2cr9q" Jun 12 18:36:44.305355 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.305293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7mnb\" (UniqueName: \"kubernetes.io/projected/4c595379-58b0-4e41-89fc-75219623a629-kube-api-access-p7mnb\") pod \"cert-manager-59c77684cc-2cr9q\" (UID: \"4c595379-58b0-4e41-89fc-75219623a629\") " pod="cert-manager/cert-manager-59c77684cc-2cr9q" Jun 12 18:36:44.405667 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.405631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7mnb\" (UniqueName: \"kubernetes.io/projected/4c595379-58b0-4e41-89fc-75219623a629-kube-api-access-p7mnb\") pod \"cert-manager-59c77684cc-2cr9q\" (UID: \"4c595379-58b0-4e41-89fc-75219623a629\") " pod="cert-manager/cert-manager-59c77684cc-2cr9q" Jun 12 18:36:44.405865 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.405683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c595379-58b0-4e41-89fc-75219623a629-bound-sa-token\") pod \"cert-manager-59c77684cc-2cr9q\" (UID: \"4c595379-58b0-4e41-89fc-75219623a629\") " pod="cert-manager/cert-manager-59c77684cc-2cr9q" Jun 12 18:36:44.417127 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.417097 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7mnb\" (UniqueName: \"kubernetes.io/projected/4c595379-58b0-4e41-89fc-75219623a629-kube-api-access-p7mnb\") pod \"cert-manager-59c77684cc-2cr9q\" (UID: \"4c595379-58b0-4e41-89fc-75219623a629\") " pod="cert-manager/cert-manager-59c77684cc-2cr9q" Jun 12 18:36:44.417414 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.417397 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c595379-58b0-4e41-89fc-75219623a629-bound-sa-token\") pod \"cert-manager-59c77684cc-2cr9q\" (UID: \"4c595379-58b0-4e41-89fc-75219623a629\") " pod="cert-manager/cert-manager-59c77684cc-2cr9q" Jun 12 18:36:44.592442 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.592353 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2cr9q" Jun 12 18:36:44.723180 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.723149 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2cr9q"] Jun 12 18:36:44.726262 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:36:44.726233 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c595379_58b0_4e41_89fc_75219623a629.slice/crio-021982e962ede7c7260c7b603b6470d1825f1b0acc52aa7d2ee4c16dfc59fa8b WatchSource:0}: Error finding container 021982e962ede7c7260c7b603b6470d1825f1b0acc52aa7d2ee4c16dfc59fa8b: Status 404 returned error can't find the container with id 021982e962ede7c7260c7b603b6470d1825f1b0acc52aa7d2ee4c16dfc59fa8b Jun 12 18:36:44.728153 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.728139 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:36:44.774422 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:44.774386 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2cr9q" event={"ID":"4c595379-58b0-4e41-89fc-75219623a629","Type":"ContainerStarted","Data":"021982e962ede7c7260c7b603b6470d1825f1b0acc52aa7d2ee4c16dfc59fa8b"} Jun 12 18:36:46.191301 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.191263 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv"] Jun 12 18:36:46.195034 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.195005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" Jun 12 18:36:46.198032 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.198003 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:36:46.198352 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.198332 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 18:36:46.199288 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.199266 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vj2t6\"" Jun 12 18:36:46.214547 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.214500 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv"] Jun 12 18:36:46.219136 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.219111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdtcg\" (UniqueName: \"kubernetes.io/projected/5df8465e-64bf-4838-ab01-b413b0705973-kube-api-access-jdtcg\") pod \"openshift-lws-operator-fd8ccff4c-lghgv\" (UID: \"5df8465e-64bf-4838-ab01-b413b0705973\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" Jun 12 18:36:46.219250 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.219167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5df8465e-64bf-4838-ab01-b413b0705973-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lghgv\" (UID: \"5df8465e-64bf-4838-ab01-b413b0705973\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" Jun 12 18:36:46.320408 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.320360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdtcg\" (UniqueName: \"kubernetes.io/projected/5df8465e-64bf-4838-ab01-b413b0705973-kube-api-access-jdtcg\") pod \"openshift-lws-operator-fd8ccff4c-lghgv\" (UID: \"5df8465e-64bf-4838-ab01-b413b0705973\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" Jun 12 18:36:46.320617 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.320443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5df8465e-64bf-4838-ab01-b413b0705973-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lghgv\" (UID: \"5df8465e-64bf-4838-ab01-b413b0705973\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" Jun 12 18:36:46.320894 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.320846 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5df8465e-64bf-4838-ab01-b413b0705973-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lghgv\" (UID: \"5df8465e-64bf-4838-ab01-b413b0705973\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" Jun 12 18:36:46.331567 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.331545 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdtcg\" (UniqueName: \"kubernetes.io/projected/5df8465e-64bf-4838-ab01-b413b0705973-kube-api-access-jdtcg\") pod \"openshift-lws-operator-fd8ccff4c-lghgv\" (UID: \"5df8465e-64bf-4838-ab01-b413b0705973\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" Jun 12 18:36:46.507005 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:46.506926 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" Jun 12 18:36:47.919075 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:47.919048 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv"] Jun 12 18:36:47.922273 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:36:47.922246 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5df8465e_64bf_4838_ab01_b413b0705973.slice/crio-ecaa988d3d77b8c400584fa23ce6cebffada66628cb35080ace4cdd85e7f629f WatchSource:0}: Error finding container ecaa988d3d77b8c400584fa23ce6cebffada66628cb35080ace4cdd85e7f629f: Status 404 returned error can't find the container with id ecaa988d3d77b8c400584fa23ce6cebffada66628cb35080ace4cdd85e7f629f Jun 12 18:36:48.792363 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:48.792322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2cr9q" event={"ID":"4c595379-58b0-4e41-89fc-75219623a629","Type":"ContainerStarted","Data":"4fcb5dca2180a391ef62498d97d5c05d181caac663eee0da6d0af90cd1fba2f7"} Jun 12 18:36:48.793681 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:48.793649 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" event={"ID":"5df8465e-64bf-4838-ab01-b413b0705973","Type":"ContainerStarted","Data":"ecaa988d3d77b8c400584fa23ce6cebffada66628cb35080ace4cdd85e7f629f"} Jun 12 18:36:48.815525 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:48.815384 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2cr9q" podStartSLOduration=1.686156338 podStartE2EDuration="4.815362035s" totalImagesPullingTime="3.129205697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:36:48.813589577 +0000 UTC m=+353.752351567" watchObservedRunningTime="2026-06-12 18:36:48.815362035 +0000 UTC m=+353.754124031" Jun 12 18:36:50.803248 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:50.803212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" event={"ID":"5df8465e-64bf-4838-ab01-b413b0705973","Type":"ContainerStarted","Data":"5412d7141b3dfc655d3c5d46ae5964949551696194b8b1f9779036e325149a00"} Jun 12 18:36:50.824214 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:36:50.824157 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lghgv" podStartSLOduration=2.051417539 podStartE2EDuration="4.824141972s" totalImagesPullingTime="2.772724433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:36:50.822631315 +0000 UTC m=+355.761393311" watchObservedRunningTime="2026-06-12 18:36:50.824141972 +0000 UTC m=+355.762903969" Jun 12 18:37:07.283589 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.283531 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp"] Jun 12 18:37:07.287119 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.287096 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.290947 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.290922 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 18:37:07.291096 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.291028 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 18:37:07.291242 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.291229 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 18:37:07.291293 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.291239 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 18:37:07.291379 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.291363 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dz8cx\"" Jun 12 18:37:07.327675 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.327645 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp"] Jun 12 18:37:07.379221 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.379195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks7hj\" (UniqueName: \"kubernetes.io/projected/8883cd3d-8dd2-442d-9b63-c7d935b1e996-kube-api-access-ks7hj\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.379386 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.379232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8883cd3d-8dd2-442d-9b63-c7d935b1e996-manifests\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.379386 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.379252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8883cd3d-8dd2-442d-9b63-c7d935b1e996-tmp\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.379386 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.379362 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8883cd3d-8dd2-442d-9b63-c7d935b1e996-webhook-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.379545 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.379404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8883cd3d-8dd2-442d-9b63-c7d935b1e996-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.480185 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.480152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8883cd3d-8dd2-442d-9b63-c7d935b1e996-tmp\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.480366 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.480198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8883cd3d-8dd2-442d-9b63-c7d935b1e996-webhook-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.480366 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.480222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8883cd3d-8dd2-442d-9b63-c7d935b1e996-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.480366 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.480277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks7hj\" (UniqueName: \"kubernetes.io/projected/8883cd3d-8dd2-442d-9b63-c7d935b1e996-kube-api-access-ks7hj\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.480366 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.480313 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8883cd3d-8dd2-442d-9b63-c7d935b1e996-manifests\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.480723 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.480687 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8883cd3d-8dd2-442d-9b63-c7d935b1e996-manifests\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.482526 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.482501 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8883cd3d-8dd2-442d-9b63-c7d935b1e996-tmp\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.482780 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.482762 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8883cd3d-8dd2-442d-9b63-c7d935b1e996-webhook-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.482891 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.482871 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8883cd3d-8dd2-442d-9b63-c7d935b1e996-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.507714 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.507689 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks7hj\" (UniqueName: \"kubernetes.io/projected/8883cd3d-8dd2-442d-9b63-c7d935b1e996-kube-api-access-ks7hj\") pod \"opendatahub-operator-controller-manager-666df475c6-2lhqp\" (UID: \"8883cd3d-8dd2-442d-9b63-c7d935b1e996\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.597874 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.597783 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:07.798315 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.798283 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp"] Jun 12 18:37:07.801546 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:37:07.801518 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8883cd3d_8dd2_442d_9b63_c7d935b1e996.slice/crio-0a4be23b9764b191b1fe5b7df7a597eee3a65dcf7c563fd95417943562964c72 WatchSource:0}: Error finding container 0a4be23b9764b191b1fe5b7df7a597eee3a65dcf7c563fd95417943562964c72: Status 404 returned error can't find the container with id 0a4be23b9764b191b1fe5b7df7a597eee3a65dcf7c563fd95417943562964c72 Jun 12 18:37:07.862204 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:07.862137 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" event={"ID":"8883cd3d-8dd2-442d-9b63-c7d935b1e996","Type":"ContainerStarted","Data":"0a4be23b9764b191b1fe5b7df7a597eee3a65dcf7c563fd95417943562964c72"} Jun 12 18:37:10.877658 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:10.877615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" event={"ID":"8883cd3d-8dd2-442d-9b63-c7d935b1e996","Type":"ContainerStarted","Data":"7cd6568396e4b071a084c8fc622a7cf94f78e1d5f64ca2186b60f2e2e0e50550"} Jun 12 18:37:11.883084 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:11.883048 2564 generic.go:356] "Generic (PLEG): container finished" podID="8883cd3d-8dd2-442d-9b63-c7d935b1e996" containerID="7cd6568396e4b071a084c8fc622a7cf94f78e1d5f64ca2186b60f2e2e0e50550" exitCode=0 Jun 12 18:37:11.883463 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:11.883100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" event={"ID":"8883cd3d-8dd2-442d-9b63-c7d935b1e996","Type":"ContainerDied","Data":"7cd6568396e4b071a084c8fc622a7cf94f78e1d5f64ca2186b60f2e2e0e50550"} Jun 12 18:37:12.889704 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:12.889668 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" event={"ID":"8883cd3d-8dd2-442d-9b63-c7d935b1e996","Type":"ContainerStarted","Data":"92bcb8b38c14f97e91cef15e531c9a6fb332298296940177df9d1e672b41c141"} Jun 12 18:37:12.890164 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:12.889802 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:12.919827 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:12.919782 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" podStartSLOduration=1.736946125 podStartE2EDuration="5.919765976s" totalImagesPullingTime="3.239006371s" totalInitContainerRuntime="943.81348ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:12.918139595 +0000 UTC m=+377.856901591" watchObservedRunningTime="2026-06-12 18:37:12.919765976 +0000 UTC m=+377.858527971" Jun 12 18:37:23.896548 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:23.896516 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-2lhqp" Jun 12 18:37:27.022864 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.022826 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75986b966d-w88b4"] Jun 12 18:37:27.030643 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.030611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.033383 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.033361 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6f49g\"" Jun 12 18:37:27.033501 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.033361 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 18:37:27.035339 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.035315 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 18:37:27.035453 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.035427 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 18:37:27.036707 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.036691 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 18:37:27.043784 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.043762 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75986b966d-w88b4"] Jun 12 18:37:27.094461 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.094432 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tgjjp"] Jun 12 18:37:27.096774 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.096749 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:27.100892 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.100870 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-56pph\"" Jun 12 18:37:27.101202 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.101184 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 12 18:37:27.119874 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.119847 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tgjjp"] Jun 12 18:37:27.135291 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.135256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81b7d87e-7a95-40f8-b41c-358f7968f0ef-tmp\") pod \"kube-auth-proxy-75986b966d-w88b4\" (UID: \"81b7d87e-7a95-40f8-b41c-358f7968f0ef\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.135458 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.135301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b7d87e-7a95-40f8-b41c-358f7968f0ef-tls-certs\") pod \"kube-auth-proxy-75986b966d-w88b4\" (UID: \"81b7d87e-7a95-40f8-b41c-358f7968f0ef\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.135458 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.135333 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f85xv\" (UniqueName: \"kubernetes.io/projected/81b7d87e-7a95-40f8-b41c-358f7968f0ef-kube-api-access-f85xv\") pod \"kube-auth-proxy-75986b966d-w88b4\" (UID: \"81b7d87e-7a95-40f8-b41c-358f7968f0ef\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.236083 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.236041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81b7d87e-7a95-40f8-b41c-358f7968f0ef-tmp\") pod \"kube-auth-proxy-75986b966d-w88b4\" (UID: \"81b7d87e-7a95-40f8-b41c-358f7968f0ef\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.236278 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.236107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b7d87e-7a95-40f8-b41c-358f7968f0ef-tls-certs\") pod \"kube-auth-proxy-75986b966d-w88b4\" (UID: \"81b7d87e-7a95-40f8-b41c-358f7968f0ef\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.236278 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.236141 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f85xv\" (UniqueName: \"kubernetes.io/projected/81b7d87e-7a95-40f8-b41c-358f7968f0ef-kube-api-access-f85xv\") pod \"kube-auth-proxy-75986b966d-w88b4\" (UID: \"81b7d87e-7a95-40f8-b41c-358f7968f0ef\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.236278 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.236215 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwrdz\" (UniqueName: \"kubernetes.io/projected/5472a034-37e1-47f1-af86-467ba7860816-kube-api-access-dwrdz\") pod \"odh-model-controller-6dc94f689f-tgjjp\" (UID: \"5472a034-37e1-47f1-af86-467ba7860816\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:27.236278 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:37:27.236230 2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 12 18:37:27.236278 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.236262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5472a034-37e1-47f1-af86-467ba7860816-cert\") pod \"odh-model-controller-6dc94f689f-tgjjp\" (UID: \"5472a034-37e1-47f1-af86-467ba7860816\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:27.236544 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:37:27.236301 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b7d87e-7a95-40f8-b41c-358f7968f0ef-tls-certs podName:81b7d87e-7a95-40f8-b41c-358f7968f0ef nodeName:}" failed. No retries permitted until 2026-06-12 18:37:27.736279461 +0000 UTC m=+392.675041435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/81b7d87e-7a95-40f8-b41c-358f7968f0ef-tls-certs") pod "kube-auth-proxy-75986b966d-w88b4" (UID: "81b7d87e-7a95-40f8-b41c-358f7968f0ef") : secret "kube-auth-proxy-tls" not found Jun 12 18:37:27.238843 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.238807 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81b7d87e-7a95-40f8-b41c-358f7968f0ef-tmp\") pod \"kube-auth-proxy-75986b966d-w88b4\" (UID: \"81b7d87e-7a95-40f8-b41c-358f7968f0ef\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.247708 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.247680 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f85xv\" (UniqueName: \"kubernetes.io/projected/81b7d87e-7a95-40f8-b41c-358f7968f0ef-kube-api-access-f85xv\") pod \"kube-auth-proxy-75986b966d-w88b4\" (UID: \"81b7d87e-7a95-40f8-b41c-358f7968f0ef\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.337243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.337149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwrdz\" (UniqueName: \"kubernetes.io/projected/5472a034-37e1-47f1-af86-467ba7860816-kube-api-access-dwrdz\") pod \"odh-model-controller-6dc94f689f-tgjjp\" (UID: \"5472a034-37e1-47f1-af86-467ba7860816\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:27.337243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.337200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5472a034-37e1-47f1-af86-467ba7860816-cert\") pod \"odh-model-controller-6dc94f689f-tgjjp\" (UID: \"5472a034-37e1-47f1-af86-467ba7860816\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:27.337462 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:37:27.337320 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 12 18:37:27.337462 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:37:27.337388 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5472a034-37e1-47f1-af86-467ba7860816-cert podName:5472a034-37e1-47f1-af86-467ba7860816 nodeName:}" failed. No retries permitted until 2026-06-12 18:37:27.837369439 +0000 UTC m=+392.776131427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5472a034-37e1-47f1-af86-467ba7860816-cert") pod "odh-model-controller-6dc94f689f-tgjjp" (UID: "5472a034-37e1-47f1-af86-467ba7860816") : secret "odh-model-controller-webhook-cert" not found Jun 12 18:37:27.349393 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.349353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwrdz\" (UniqueName: \"kubernetes.io/projected/5472a034-37e1-47f1-af86-467ba7860816-kube-api-access-dwrdz\") pod \"odh-model-controller-6dc94f689f-tgjjp\" (UID: \"5472a034-37e1-47f1-af86-467ba7860816\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:27.740144 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.740102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b7d87e-7a95-40f8-b41c-358f7968f0ef-tls-certs\") pod \"kube-auth-proxy-75986b966d-w88b4\" (UID: \"81b7d87e-7a95-40f8-b41c-358f7968f0ef\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.742826 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.742792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b7d87e-7a95-40f8-b41c-358f7968f0ef-tls-certs\") pod \"kube-auth-proxy-75986b966d-w88b4\" (UID: \"81b7d87e-7a95-40f8-b41c-358f7968f0ef\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.841554 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.841512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5472a034-37e1-47f1-af86-467ba7860816-cert\") pod \"odh-model-controller-6dc94f689f-tgjjp\" (UID: \"5472a034-37e1-47f1-af86-467ba7860816\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:27.841785 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:37:27.841711 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 12 18:37:27.841849 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:37:27.841792 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5472a034-37e1-47f1-af86-467ba7860816-cert podName:5472a034-37e1-47f1-af86-467ba7860816 nodeName:}" failed. No retries permitted until 2026-06-12 18:37:28.841769769 +0000 UTC m=+393.780531751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5472a034-37e1-47f1-af86-467ba7860816-cert") pod "odh-model-controller-6dc94f689f-tgjjp" (UID: "5472a034-37e1-47f1-af86-467ba7860816") : secret "odh-model-controller-webhook-cert" not found Jun 12 18:37:27.942655 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.942618 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" Jun 12 18:37:27.987763 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.987720 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cthxv"] Jun 12 18:37:27.991019 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.990627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-cthxv" Jun 12 18:37:27.994215 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:27.994153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 12 18:37:28.002842 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.002773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cthxv"] Jun 12 18:37:28.101266 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.101237 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75986b966d-w88b4"] Jun 12 18:37:28.103176 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:37:28.103149 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b7d87e_7a95_40f8_b41c_358f7968f0ef.slice/crio-6d1a974510a34dcb10e6f6dd8ad0c8b1e12e6e367c3c027fa87303b87ed7f8cf WatchSource:0}: Error finding container 6d1a974510a34dcb10e6f6dd8ad0c8b1e12e6e367c3c027fa87303b87ed7f8cf: Status 404 returned error can't find the container with id 6d1a974510a34dcb10e6f6dd8ad0c8b1e12e6e367c3c027fa87303b87ed7f8cf Jun 12 18:37:28.143435 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.143403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278c6f74-28d9-4904-ab46-84fe8e8bf066-tls-certs\") pod \"model-serving-api-5dd488fc48-cthxv\" (UID: \"278c6f74-28d9-4904-ab46-84fe8e8bf066\") " pod="opendatahub/model-serving-api-5dd488fc48-cthxv" Jun 12 18:37:28.143605 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.143460 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rlht\" (UniqueName: \"kubernetes.io/projected/278c6f74-28d9-4904-ab46-84fe8e8bf066-kube-api-access-4rlht\") pod \"model-serving-api-5dd488fc48-cthxv\" (UID: \"278c6f74-28d9-4904-ab46-84fe8e8bf066\") " pod="opendatahub/model-serving-api-5dd488fc48-cthxv" Jun 12 18:37:28.244977 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.244889 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278c6f74-28d9-4904-ab46-84fe8e8bf066-tls-certs\") pod \"model-serving-api-5dd488fc48-cthxv\" (UID: \"278c6f74-28d9-4904-ab46-84fe8e8bf066\") " pod="opendatahub/model-serving-api-5dd488fc48-cthxv" Jun 12 18:37:28.244977 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.244943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rlht\" (UniqueName: \"kubernetes.io/projected/278c6f74-28d9-4904-ab46-84fe8e8bf066-kube-api-access-4rlht\") pod \"model-serving-api-5dd488fc48-cthxv\" (UID: \"278c6f74-28d9-4904-ab46-84fe8e8bf066\") " pod="opendatahub/model-serving-api-5dd488fc48-cthxv" Jun 12 18:37:28.247703 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.247673 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278c6f74-28d9-4904-ab46-84fe8e8bf066-tls-certs\") pod \"model-serving-api-5dd488fc48-cthxv\" (UID: \"278c6f74-28d9-4904-ab46-84fe8e8bf066\") " pod="opendatahub/model-serving-api-5dd488fc48-cthxv" Jun 12 18:37:28.255806 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.255773 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rlht\" (UniqueName: \"kubernetes.io/projected/278c6f74-28d9-4904-ab46-84fe8e8bf066-kube-api-access-4rlht\") pod \"model-serving-api-5dd488fc48-cthxv\" (UID: \"278c6f74-28d9-4904-ab46-84fe8e8bf066\") " pod="opendatahub/model-serving-api-5dd488fc48-cthxv" Jun 12 18:37:28.309660 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.309623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-cthxv" Jun 12 18:37:28.451892 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.451859 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cthxv"] Jun 12 18:37:28.453073 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:37:28.453041 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278c6f74_28d9_4904_ab46_84fe8e8bf066.slice/crio-f185f87c27e35112ce83c4501fd4a303fbd78950c2c2a067718d0859da3aac21 WatchSource:0}: Error finding container f185f87c27e35112ce83c4501fd4a303fbd78950c2c2a067718d0859da3aac21: Status 404 returned error can't find the container with id f185f87c27e35112ce83c4501fd4a303fbd78950c2c2a067718d0859da3aac21 Jun 12 18:37:28.850847 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.850811 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5472a034-37e1-47f1-af86-467ba7860816-cert\") pod \"odh-model-controller-6dc94f689f-tgjjp\" (UID: \"5472a034-37e1-47f1-af86-467ba7860816\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:28.853910 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.853858 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5472a034-37e1-47f1-af86-467ba7860816-cert\") pod \"odh-model-controller-6dc94f689f-tgjjp\" (UID: \"5472a034-37e1-47f1-af86-467ba7860816\") " pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:28.906950 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.906911 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:28.960264 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.959536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-cthxv" event={"ID":"278c6f74-28d9-4904-ab46-84fe8e8bf066","Type":"ContainerStarted","Data":"f185f87c27e35112ce83c4501fd4a303fbd78950c2c2a067718d0859da3aac21"} Jun 12 18:37:28.963784 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:28.963738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" event={"ID":"81b7d87e-7a95-40f8-b41c-358f7968f0ef","Type":"ContainerStarted","Data":"6d1a974510a34dcb10e6f6dd8ad0c8b1e12e6e367c3c027fa87303b87ed7f8cf"} Jun 12 18:37:29.085919 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:29.085830 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tgjjp"] Jun 12 18:37:29.099608 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:37:29.099555 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5472a034_37e1_47f1_af86_467ba7860816.slice/crio-43c7177b35b70ed66833b1d0197560a1605c5683f04df3c9b90c2e72fb0187cd WatchSource:0}: Error finding container 43c7177b35b70ed66833b1d0197560a1605c5683f04df3c9b90c2e72fb0187cd: Status 404 returned error can't find the container with id 43c7177b35b70ed66833b1d0197560a1605c5683f04df3c9b90c2e72fb0187cd Jun 12 18:37:29.972881 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:29.972728 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" event={"ID":"5472a034-37e1-47f1-af86-467ba7860816","Type":"ContainerStarted","Data":"43c7177b35b70ed66833b1d0197560a1605c5683f04df3c9b90c2e72fb0187cd"} Jun 12 18:37:33.994941 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:33.994900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-cthxv" event={"ID":"278c6f74-28d9-4904-ab46-84fe8e8bf066","Type":"ContainerStarted","Data":"b012ff2bc1ae7861317d07e028dbef0f2f67814fba8cb07667c0b6d6f07d87ce"} Jun 12 18:37:33.995388 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:33.995007 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-cthxv" Jun 12 18:37:33.996626 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:33.996567 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" event={"ID":"81b7d87e-7a95-40f8-b41c-358f7968f0ef","Type":"ContainerStarted","Data":"c5a3c5f1327407becb28d5df8821d997d04bb6cd56ac29591adb02ad37875bcb"} Jun 12 18:37:33.998119 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:33.998091 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" event={"ID":"5472a034-37e1-47f1-af86-467ba7860816","Type":"ContainerStarted","Data":"8aebe4dd0d836e4f24b15da60d026a4ff8289ea75740829d29659f268f0fef92"} Jun 12 18:37:33.998246 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:33.998217 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:34.017471 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:34.017419 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-cthxv" podStartSLOduration=2.4011847570000002 podStartE2EDuration="7.017405179s" totalImagesPullingTime="4.616220422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:34.016035477 +0000 UTC m=+398.954797475" watchObservedRunningTime="2026-06-12 18:37:34.017405179 +0000 UTC m=+398.956167175" Jun 12 18:37:34.040743 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:34.040695 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75986b966d-w88b4" podStartSLOduration=3.081495931 podStartE2EDuration="8.04068149s" totalImagesPullingTime="4.959185559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:34.039665169 +0000 UTC m=+398.978427178" watchObservedRunningTime="2026-06-12 18:37:34.04068149 +0000 UTC m=+398.979443499" Jun 12 18:37:34.056946 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:34.056888 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" podStartSLOduration=3.046276802 podStartE2EDuration="7.056866453s" totalImagesPullingTime="4.010589651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:34.056606443 +0000 UTC m=+398.995368440" watchObservedRunningTime="2026-06-12 18:37:34.056866453 +0000 UTC m=+398.995628453" Jun 12 18:37:38.979368 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:38.979332 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-m6dhf"] Jun 12 18:37:38.983180 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:38.983158 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh"] Jun 12 18:37:38.983330 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:38.983289 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:37:38.986654 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:38.986636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:37:38.989328 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:38.989304 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 12 18:37:38.989444 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:38.989345 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 12 18:37:38.989444 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:38.989350 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kfdp5\"" Jun 12 18:37:38.989696 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:38.989676 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2vf4v\"" Jun 12 18:37:39.001080 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.001057 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-m6dhf"] Jun 12 18:37:39.006443 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.006418 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh"] Jun 12 18:37:39.040898 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.040862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8q78\" (UniqueName: \"kubernetes.io/projected/c5383c8c-c2bc-4c04-b87f-9da56a035372-kube-api-access-s8q78\") pod \"llmisvc-controller-manager-864bfd7bc9-66bsh\" (UID: \"c5383c8c-c2bc-4c04-b87f-9da56a035372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:37:39.041062 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.040908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5383c8c-c2bc-4c04-b87f-9da56a035372-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-66bsh\" (UID: \"c5383c8c-c2bc-4c04-b87f-9da56a035372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:37:39.041062 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.040947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt2ff\" (UniqueName: \"kubernetes.io/projected/14318ef0-d91f-436e-bd20-11e88ea5be6e-kube-api-access-wt2ff\") pod \"kserve-controller-manager-69fc866d76-m6dhf\" (UID: \"14318ef0-d91f-436e-bd20-11e88ea5be6e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:37:39.041062 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.040978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14318ef0-d91f-436e-bd20-11e88ea5be6e-cert\") pod \"kserve-controller-manager-69fc866d76-m6dhf\" (UID: \"14318ef0-d91f-436e-bd20-11e88ea5be6e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:37:39.142159 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.142121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5383c8c-c2bc-4c04-b87f-9da56a035372-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-66bsh\" (UID: \"c5383c8c-c2bc-4c04-b87f-9da56a035372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:37:39.142441 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.142421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt2ff\" (UniqueName: \"kubernetes.io/projected/14318ef0-d91f-436e-bd20-11e88ea5be6e-kube-api-access-wt2ff\") pod \"kserve-controller-manager-69fc866d76-m6dhf\" (UID: \"14318ef0-d91f-436e-bd20-11e88ea5be6e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:37:39.142613 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.142597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14318ef0-d91f-436e-bd20-11e88ea5be6e-cert\") pod \"kserve-controller-manager-69fc866d76-m6dhf\" (UID: \"14318ef0-d91f-436e-bd20-11e88ea5be6e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:37:39.142770 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:37:39.142296 2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 12 18:37:39.142916 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:37:39.142904 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5383c8c-c2bc-4c04-b87f-9da56a035372-cert podName:c5383c8c-c2bc-4c04-b87f-9da56a035372 nodeName:}" failed. No retries permitted until 2026-06-12 18:37:39.642881129 +0000 UTC m=+404.581643118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5383c8c-c2bc-4c04-b87f-9da56a035372-cert") pod "llmisvc-controller-manager-864bfd7bc9-66bsh" (UID: "c5383c8c-c2bc-4c04-b87f-9da56a035372") : secret "llmisvc-webhook-server-cert" not found Jun 12 18:37:39.143068 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:37:39.142708 2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 12 18:37:39.143068 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:37:39.143051 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14318ef0-d91f-436e-bd20-11e88ea5be6e-cert podName:14318ef0-d91f-436e-bd20-11e88ea5be6e nodeName:}" failed. No retries permitted until 2026-06-12 18:37:39.64303789 +0000 UTC m=+404.581799868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14318ef0-d91f-436e-bd20-11e88ea5be6e-cert") pod "kserve-controller-manager-69fc866d76-m6dhf" (UID: "14318ef0-d91f-436e-bd20-11e88ea5be6e") : secret "kserve-webhook-server-cert" not found Jun 12 18:37:39.143250 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.143234 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8q78\" (UniqueName: \"kubernetes.io/projected/c5383c8c-c2bc-4c04-b87f-9da56a035372-kube-api-access-s8q78\") pod \"llmisvc-controller-manager-864bfd7bc9-66bsh\" (UID: \"c5383c8c-c2bc-4c04-b87f-9da56a035372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:37:39.158515 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.158483 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt2ff\" (UniqueName: \"kubernetes.io/projected/14318ef0-d91f-436e-bd20-11e88ea5be6e-kube-api-access-wt2ff\") pod \"kserve-controller-manager-69fc866d76-m6dhf\" (UID: \"14318ef0-d91f-436e-bd20-11e88ea5be6e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:37:39.158515 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.158493 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8q78\" (UniqueName: \"kubernetes.io/projected/c5383c8c-c2bc-4c04-b87f-9da56a035372-kube-api-access-s8q78\") pod \"llmisvc-controller-manager-864bfd7bc9-66bsh\" (UID: \"c5383c8c-c2bc-4c04-b87f-9da56a035372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:37:39.647957 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.647923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14318ef0-d91f-436e-bd20-11e88ea5be6e-cert\") pod \"kserve-controller-manager-69fc866d76-m6dhf\" (UID: \"14318ef0-d91f-436e-bd20-11e88ea5be6e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:37:39.648131 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.647985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5383c8c-c2bc-4c04-b87f-9da56a035372-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-66bsh\" (UID: \"c5383c8c-c2bc-4c04-b87f-9da56a035372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:37:39.650328 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.650310 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5383c8c-c2bc-4c04-b87f-9da56a035372-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-66bsh\" (UID: \"c5383c8c-c2bc-4c04-b87f-9da56a035372\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:37:39.650459 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.650437 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14318ef0-d91f-436e-bd20-11e88ea5be6e-cert\") pod \"kserve-controller-manager-69fc866d76-m6dhf\" (UID: \"14318ef0-d91f-436e-bd20-11e88ea5be6e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:37:39.895022 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.894986 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:37:39.902184 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:39.902162 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:37:40.033369 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:40.033164 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-m6dhf"] Jun 12 18:37:40.036018 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:37:40.035994 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14318ef0_d91f_436e_bd20_11e88ea5be6e.slice/crio-3b851981affe96f55d34bcc67d14819c9afb9770b6e97c77efc2fba702e1b023 WatchSource:0}: Error finding container 3b851981affe96f55d34bcc67d14819c9afb9770b6e97c77efc2fba702e1b023: Status 404 returned error can't find the container with id 3b851981affe96f55d34bcc67d14819c9afb9770b6e97c77efc2fba702e1b023 Jun 12 18:37:40.053796 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:40.053766 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh"] Jun 12 18:37:40.056224 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:37:40.056194 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc5383c8c_c2bc_4c04_b87f_9da56a035372.slice/crio-e51954892921c90fe95d1c68e80d202ed5315f386ddfdb645a8c94ca4eaf8717 WatchSource:0}: Error finding container e51954892921c90fe95d1c68e80d202ed5315f386ddfdb645a8c94ca4eaf8717: Status 404 returned error can't find the container with id e51954892921c90fe95d1c68e80d202ed5315f386ddfdb645a8c94ca4eaf8717 Jun 12 18:37:41.035663 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:41.035618 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" event={"ID":"c5383c8c-c2bc-4c04-b87f-9da56a035372","Type":"ContainerStarted","Data":"e51954892921c90fe95d1c68e80d202ed5315f386ddfdb645a8c94ca4eaf8717"} Jun 12 18:37:41.037113 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:41.037075 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" event={"ID":"14318ef0-d91f-436e-bd20-11e88ea5be6e","Type":"ContainerStarted","Data":"3b851981affe96f55d34bcc67d14819c9afb9770b6e97c77efc2fba702e1b023"} Jun 12 18:37:43.049292 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:43.049255 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" event={"ID":"14318ef0-d91f-436e-bd20-11e88ea5be6e","Type":"ContainerStarted","Data":"04394412204d6505c78ce68e8a2b8594ba9558fce9b1dd48b7b447ff98c6115c"} Jun 12 18:37:43.049782 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:43.049411 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:37:43.085982 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:43.085930 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" podStartSLOduration=2.6693800210000003 podStartE2EDuration="5.085914509s" totalImagesPullingTime="2.416534488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:43.083779483 +0000 UTC m=+408.022541479" watchObservedRunningTime="2026-06-12 18:37:43.085914509 +0000 UTC m=+408.024676504" Jun 12 18:37:44.056648 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:44.056556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" event={"ID":"c5383c8c-c2bc-4c04-b87f-9da56a035372","Type":"ContainerStarted","Data":"a897f07358a649c0852fac8e5a118be68d6c3d86b0259c89b75e036d151529d0"} Jun 12 18:37:44.057341 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:44.057314 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:37:44.092963 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:44.092914 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" podStartSLOduration=3.029908272 podStartE2EDuration="6.092897534s" totalImagesPullingTime="3.062989262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:44.092119767 +0000 UTC m=+409.030881764" watchObservedRunningTime="2026-06-12 18:37:44.092897534 +0000 UTC m=+409.031659531" Jun 12 18:37:45.004230 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:45.004195 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-tgjjp" Jun 12 18:37:45.006557 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:45.006488 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-cthxv" Jun 12 18:37:47.166187 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.166151 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx"] Jun 12 18:37:47.174626 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.174566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" Jun 12 18:37:47.180157 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.180129 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 12 18:37:47.180302 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.180164 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 12 18:37:47.180302 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.180175 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-jrj6r\"" Jun 12 18:37:47.192268 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.192242 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx"] Jun 12 18:37:47.218813 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.218784 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f4812fda-d329-4935-83f6-6430a26cfd6f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fc8zx\" (UID: \"f4812fda-d329-4935-83f6-6430a26cfd6f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" Jun 12 18:37:47.218944 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.218830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k977r\" (UniqueName: \"kubernetes.io/projected/f4812fda-d329-4935-83f6-6430a26cfd6f-kube-api-access-k977r\") pod \"servicemesh-operator3-57f65f65fb-fc8zx\" (UID: \"f4812fda-d329-4935-83f6-6430a26cfd6f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" Jun 12 18:37:47.320291 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.320250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f4812fda-d329-4935-83f6-6430a26cfd6f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fc8zx\" (UID: \"f4812fda-d329-4935-83f6-6430a26cfd6f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" Jun 12 18:37:47.320468 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.320304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k977r\" (UniqueName: \"kubernetes.io/projected/f4812fda-d329-4935-83f6-6430a26cfd6f-kube-api-access-k977r\") pod \"servicemesh-operator3-57f65f65fb-fc8zx\" (UID: \"f4812fda-d329-4935-83f6-6430a26cfd6f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" Jun 12 18:37:47.322890 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.322872 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f4812fda-d329-4935-83f6-6430a26cfd6f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-fc8zx\" (UID: \"f4812fda-d329-4935-83f6-6430a26cfd6f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" Jun 12 18:37:47.330988 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.330967 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k977r\" (UniqueName: \"kubernetes.io/projected/f4812fda-d329-4935-83f6-6430a26cfd6f-kube-api-access-k977r\") pod \"servicemesh-operator3-57f65f65fb-fc8zx\" (UID: \"f4812fda-d329-4935-83f6-6430a26cfd6f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" Jun 12 18:37:47.483523 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.483430 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" Jun 12 18:37:47.631408 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:47.631373 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx"] Jun 12 18:37:47.634773 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:37:47.634731 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4812fda_d329_4935_83f6_6430a26cfd6f.slice/crio-3bb178ba453ed0e11623d6e012e257ccb5d1dd44170eb2d211a6752715022f46 WatchSource:0}: Error finding container 3bb178ba453ed0e11623d6e012e257ccb5d1dd44170eb2d211a6752715022f46: Status 404 returned error can't find the container with id 3bb178ba453ed0e11623d6e012e257ccb5d1dd44170eb2d211a6752715022f46 Jun 12 18:37:48.075252 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:48.075219 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" event={"ID":"f4812fda-d329-4935-83f6-6430a26cfd6f","Type":"ContainerStarted","Data":"3bb178ba453ed0e11623d6e012e257ccb5d1dd44170eb2d211a6752715022f46"} Jun 12 18:37:51.091613 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.091555 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" event={"ID":"f4812fda-d329-4935-83f6-6430a26cfd6f","Type":"ContainerStarted","Data":"089f03465916648a8506032506f852790bf0c1cdfe310fcbac53ae9253f0b14f"} Jun 12 18:37:51.092022 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.091663 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" Jun 12 18:37:51.509322 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.509268 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" podStartSLOduration=1.932899923 podStartE2EDuration="4.509250596s" totalImagesPullingTime="2.576350673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:51.144331576 +0000 UTC m=+416.083093576" watchObservedRunningTime="2026-06-12 18:37:51.509250596 +0000 UTC m=+416.448012593" Jun 12 18:37:51.509699 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.509492 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8"] Jun 12 18:37:51.512914 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.512896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.516135 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.516111 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 12 18:37:51.516260 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.516132 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 12 18:37:51.516260 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.516111 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 12 18:37:51.516260 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.516137 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c7sc9\"" Jun 12 18:37:51.516260 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.516152 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 18:37:51.529236 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.529207 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8"] Jun 12 18:37:51.559225 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.559192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vfvm\" (UniqueName: \"kubernetes.io/projected/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-kube-api-access-4vfvm\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.559225 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.559230 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.559427 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.559247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.559427 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.559278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.559427 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.559340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.559427 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.559368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.559427 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.559391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.660787 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.660748 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vfvm\" (UniqueName: \"kubernetes.io/projected/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-kube-api-access-4vfvm\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.660992 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.660801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.660992 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.660829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.660992 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.660863 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.660992 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.660907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.660992 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.660940 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.660992 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.660968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.661710 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.661673 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.663488 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.663442 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.663855 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.663830 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.663855 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.663852 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.663990 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.663882 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.670685 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.670656 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vfvm\" (UniqueName: \"kubernetes.io/projected/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-kube-api-access-4vfvm\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.670953 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.670933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c330b5-cc1f-4fcf-ab54-b55067cb3462-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-lfqh8\" (UID: \"d5c330b5-cc1f-4fcf-ab54-b55067cb3462\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.823537 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.823420 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:51.974619 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:51.974593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8"] Jun 12 18:37:51.977066 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:37:51.977037 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c330b5_cc1f_4fcf_ab54_b55067cb3462.slice/crio-d21fe911105de2f8d015aed4a9e9a4e750fcc11df14dd88d0f6c4bc855345576 WatchSource:0}: Error finding container d21fe911105de2f8d015aed4a9e9a4e750fcc11df14dd88d0f6c4bc855345576: Status 404 returned error can't find the container with id d21fe911105de2f8d015aed4a9e9a4e750fcc11df14dd88d0f6c4bc855345576 Jun 12 18:37:52.097725 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:52.097627 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" event={"ID":"d5c330b5-cc1f-4fcf-ab54-b55067cb3462","Type":"ContainerStarted","Data":"d21fe911105de2f8d015aed4a9e9a4e750fcc11df14dd88d0f6c4bc855345576"} Jun 12 18:37:54.586818 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:54.586768 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 18:37:54.587111 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:54.586858 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 18:37:55.112401 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:55.112365 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" event={"ID":"d5c330b5-cc1f-4fcf-ab54-b55067cb3462","Type":"ContainerStarted","Data":"f8a28173f1213e90fafe5c9e58ab1897785e1d9671cc4d018c762ee93456fadd"} Jun 12 18:37:55.112647 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:55.112539 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:37:55.114243 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:55.114218 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-lfqh8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 12 18:37:55.114306 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:55.114272 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" podUID="d5c330b5-cc1f-4fcf-ab54-b55067cb3462" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:37:55.135118 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:55.135067 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" podStartSLOduration=1.52781826 podStartE2EDuration="4.135051262s" totalImagesPullingTime="2.607233002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:55.133153267 +0000 UTC m=+420.071915265" watchObservedRunningTime="2026-06-12 18:37:55.135051262 +0000 UTC m=+420.073813257" Jun 12 18:37:56.117553 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:56.117518 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-lfqh8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 12 18:37:56.117938 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:56.117598 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" podUID="d5c330b5-cc1f-4fcf-ab54-b55067cb3462" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:37:59.118758 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:37:59.118726 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lfqh8" Jun 12 18:38:00.308641 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.308602 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-84db6bf484-tzwlj"] Jun 12 18:38:00.313182 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.313156 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" Jun 12 18:38:00.317120 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.317099 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 18:38:00.317415 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.317399 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zjf6r\"" Jun 12 18:38:00.340163 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.340120 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-84db6bf484-tzwlj"] Jun 12 18:38:00.433823 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.433781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c8n6\" (UniqueName: \"kubernetes.io/projected/711e6619-8f92-4181-86da-55d0ade6404a-kube-api-access-9c8n6\") pod \"dashboard-redirect-84db6bf484-tzwlj\" (UID: \"711e6619-8f92-4181-86da-55d0ade6404a\") " pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" Jun 12 18:38:00.433996 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.433902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/711e6619-8f92-4181-86da-55d0ade6404a-redirect-config\") pod \"dashboard-redirect-84db6bf484-tzwlj\" (UID: \"711e6619-8f92-4181-86da-55d0ade6404a\") " pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" Jun 12 18:38:00.534952 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.534904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c8n6\" (UniqueName: \"kubernetes.io/projected/711e6619-8f92-4181-86da-55d0ade6404a-kube-api-access-9c8n6\") pod \"dashboard-redirect-84db6bf484-tzwlj\" (UID: \"711e6619-8f92-4181-86da-55d0ade6404a\") " pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" Jun 12 18:38:00.535112 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.534998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/711e6619-8f92-4181-86da-55d0ade6404a-redirect-config\") pod \"dashboard-redirect-84db6bf484-tzwlj\" (UID: \"711e6619-8f92-4181-86da-55d0ade6404a\") " pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" Jun 12 18:38:00.535674 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.535655 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/711e6619-8f92-4181-86da-55d0ade6404a-redirect-config\") pod \"dashboard-redirect-84db6bf484-tzwlj\" (UID: \"711e6619-8f92-4181-86da-55d0ade6404a\") " pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" Jun 12 18:38:00.542430 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.542403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c8n6\" (UniqueName: \"kubernetes.io/projected/711e6619-8f92-4181-86da-55d0ade6404a-kube-api-access-9c8n6\") pod \"dashboard-redirect-84db6bf484-tzwlj\" (UID: \"711e6619-8f92-4181-86da-55d0ade6404a\") " pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" Jun 12 18:38:00.623201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.623116 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" Jun 12 18:38:00.747218 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:00.747193 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-84db6bf484-tzwlj"] Jun 12 18:38:00.749539 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:38:00.749503 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711e6619_8f92_4181_86da_55d0ade6404a.slice/crio-6e8e64f75850eb4891c78fc35f089a006d6bce4a5da5d4fbc02a994f721209b3 WatchSource:0}: Error finding container 6e8e64f75850eb4891c78fc35f089a006d6bce4a5da5d4fbc02a994f721209b3: Status 404 returned error can't find the container with id 6e8e64f75850eb4891c78fc35f089a006d6bce4a5da5d4fbc02a994f721209b3 Jun 12 18:38:01.139620 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:01.139560 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" event={"ID":"711e6619-8f92-4181-86da-55d0ade6404a","Type":"ContainerStarted","Data":"6e8e64f75850eb4891c78fc35f089a006d6bce4a5da5d4fbc02a994f721209b3"} Jun 12 18:38:02.100031 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:02.100000 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-fc8zx" Jun 12 18:38:04.155427 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:04.155393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" event={"ID":"711e6619-8f92-4181-86da-55d0ade6404a","Type":"ContainerStarted","Data":"ec10cbe787f2a062d8137fc3806c416650a57f7a94f8f50fd517e99b7b809e81"} Jun 12 18:38:04.173214 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:04.173164 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-84db6bf484-tzwlj" podStartSLOduration=1.351797714 podStartE2EDuration="4.17314846s" totalImagesPullingTime="2.821350746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:04.171762361 +0000 UTC m=+429.110524360" watchObservedRunningTime="2026-06-12 18:38:04.17314846 +0000 UTC m=+429.111910490" Jun 12 18:38:14.062325 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:14.062248 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-m6dhf" Jun 12 18:38:15.064209 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:38:15.064179 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-66bsh" Jun 12 18:39:11.448689 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.448655 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb"] Jun 12 18:39:11.451994 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.451976 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:11.454709 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.454681 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 18:39:11.455742 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.455723 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-76z7h\"" Jun 12 18:39:11.455832 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.455725 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 18:39:11.464638 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.464615 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb"] Jun 12 18:39:11.617307 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.617272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmzf5\" (UniqueName: \"kubernetes.io/projected/b9af61c7-3bd3-4964-8ef3-5158a5dcb60f-kube-api-access-qmzf5\") pod \"limitador-operator-controller-manager-859d7b78bd-2n9qb\" (UID: \"b9af61c7-3bd3-4964-8ef3-5158a5dcb60f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:11.718175 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.718091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzf5\" (UniqueName: \"kubernetes.io/projected/b9af61c7-3bd3-4964-8ef3-5158a5dcb60f-kube-api-access-qmzf5\") pod \"limitador-operator-controller-manager-859d7b78bd-2n9qb\" (UID: \"b9af61c7-3bd3-4964-8ef3-5158a5dcb60f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:11.726106 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.726080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmzf5\" (UniqueName: \"kubernetes.io/projected/b9af61c7-3bd3-4964-8ef3-5158a5dcb60f-kube-api-access-qmzf5\") pod \"limitador-operator-controller-manager-859d7b78bd-2n9qb\" (UID: \"b9af61c7-3bd3-4964-8ef3-5158a5dcb60f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:11.761661 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.761634 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:11.890215 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:11.890179 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb"] Jun 12 18:39:11.894940 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:39:11.894910 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9af61c7_3bd3_4964_8ef3_5158a5dcb60f.slice/crio-1c78a9d5f6a94b92b5786617b0634c0a5ec1c624e05de8350ba2019d21c5df4d WatchSource:0}: Error finding container 1c78a9d5f6a94b92b5786617b0634c0a5ec1c624e05de8350ba2019d21c5df4d: Status 404 returned error can't find the container with id 1c78a9d5f6a94b92b5786617b0634c0a5ec1c624e05de8350ba2019d21c5df4d Jun 12 18:39:12.453111 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:12.453075 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" event={"ID":"b9af61c7-3bd3-4964-8ef3-5158a5dcb60f","Type":"ContainerStarted","Data":"1c78a9d5f6a94b92b5786617b0634c0a5ec1c624e05de8350ba2019d21c5df4d"} Jun 12 18:39:14.464831 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:14.464794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" event={"ID":"b9af61c7-3bd3-4964-8ef3-5158a5dcb60f","Type":"ContainerStarted","Data":"9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0"} Jun 12 18:39:14.465233 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:14.465043 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:14.484891 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:14.484847 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" podStartSLOduration=1.592072837 podStartE2EDuration="3.484833311s" totalImagesPullingTime="1.892760474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:39:14.483558606 +0000 UTC m=+499.422320606" watchObservedRunningTime="2026-06-12 18:39:14.484833311 +0000 UTC m=+499.423595307" Jun 12 18:39:25.470540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:25.470510 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:29.119784 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.119748 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb"] Jun 12 18:39:29.120165 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.119978 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" podUID="b9af61c7-3bd3-4964-8ef3-5158a5dcb60f" containerName="manager" containerID="cri-o://9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0" gracePeriod=2 Jun 12 18:39:29.138169 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.138143 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb"] Jun 12 18:39:29.140081 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:39:29.140050 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b9af61c7-3bd3-4964-8ef3-5158a5dcb60f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-2n9qb\": pods \"limitador-operator-controller-manager-859d7b78bd-2n9qb\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:29.162878 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.162852 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4"] Jun 12 18:39:29.163176 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.163163 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9af61c7-3bd3-4964-8ef3-5158a5dcb60f" containerName="manager" Jun 12 18:39:29.163246 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.163176 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9af61c7-3bd3-4964-8ef3-5158a5dcb60f" containerName="manager" Jun 12 18:39:29.163246 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.163241 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9af61c7-3bd3-4964-8ef3-5158a5dcb60f" containerName="manager" Jun 12 18:39:29.167053 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.167030 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4" Jun 12 18:39:29.169552 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:39:29.169519 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2n9qb\" is forbidden: User \"system:node:ip-10-0-143-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-164.ec2.internal' and this object" podUID="b9af61c7-3bd3-4964-8ef3-5158a5dcb60f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:29.181187 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.181159 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4"] Jun 12 18:39:29.256287 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.256253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shh7j\" (UniqueName: \"kubernetes.io/projected/d6960ab3-48fb-4ed9-8767-9ff53c596db6-kube-api-access-shh7j\") pod \"limitador-operator-controller-manager-859d7b78bd-6w9n4\" (UID: \"d6960ab3-48fb-4ed9-8767-9ff53c596db6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4" Jun 12 18:39:29.356764 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.356739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shh7j\" (UniqueName: \"kubernetes.io/projected/d6960ab3-48fb-4ed9-8767-9ff53c596db6-kube-api-access-shh7j\") pod \"limitador-operator-controller-manager-859d7b78bd-6w9n4\" (UID: \"d6960ab3-48fb-4ed9-8767-9ff53c596db6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4" Jun 12 18:39:29.362845 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.362826 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:29.365817 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:39:29.365792 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2n9qb\" is forbidden: User \"system:node:ip-10-0-143-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-164.ec2.internal' and this object" podUID="b9af61c7-3bd3-4964-8ef3-5158a5dcb60f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:29.371902 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.371853 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shh7j\" (UniqueName: \"kubernetes.io/projected/d6960ab3-48fb-4ed9-8767-9ff53c596db6-kube-api-access-shh7j\") pod \"limitador-operator-controller-manager-859d7b78bd-6w9n4\" (UID: \"d6960ab3-48fb-4ed9-8767-9ff53c596db6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4" Jun 12 18:39:29.457110 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.457058 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmzf5\" (UniqueName: \"kubernetes.io/projected/b9af61c7-3bd3-4964-8ef3-5158a5dcb60f-kube-api-access-qmzf5\") pod \"b9af61c7-3bd3-4964-8ef3-5158a5dcb60f\" (UID: \"b9af61c7-3bd3-4964-8ef3-5158a5dcb60f\") " Jun 12 18:39:29.459289 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.459261 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9af61c7-3bd3-4964-8ef3-5158a5dcb60f-kube-api-access-qmzf5" (OuterVolumeSpecName: "kube-api-access-qmzf5") pod "b9af61c7-3bd3-4964-8ef3-5158a5dcb60f" (UID: "b9af61c7-3bd3-4964-8ef3-5158a5dcb60f"). InnerVolumeSpecName "kube-api-access-qmzf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:39:29.490438 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.490400 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4" Jun 12 18:39:29.504375 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.504350 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9af61c7-3bd3-4964-8ef3-5158a5dcb60f" path="/var/lib/kubelet/pods/b9af61c7-3bd3-4964-8ef3-5158a5dcb60f/volumes" Jun 12 18:39:29.537703 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.537664 2564 generic.go:356] "Generic (PLEG): container finished" podID="b9af61c7-3bd3-4964-8ef3-5158a5dcb60f" containerID="9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0" exitCode=0 Jun 12 18:39:29.537703 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.537704 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9qb" Jun 12 18:39:29.537949 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.537769 2564 scope.go:117] "RemoveContainer" containerID="9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0" Jun 12 18:39:29.548212 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.548190 2564 scope.go:117] "RemoveContainer" containerID="9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0" Jun 12 18:39:29.548597 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:39:29.548554 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0\": container with ID starting with 9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0 not found: ID does not exist" containerID="9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0" Jun 12 18:39:29.548683 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.548609 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0"} err="failed to get container status \"9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0\": rpc error: code = NotFound desc = could not find container \"9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0\": container with ID starting with 9b606b94aacb347ad6c32d9e707b115651476a98ebe37d6748cbc33a965f07e0 not found: ID does not exist" Jun 12 18:39:29.558317 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.558128 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmzf5\" (UniqueName: \"kubernetes.io/projected/b9af61c7-3bd3-4964-8ef3-5158a5dcb60f-kube-api-access-qmzf5\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\"" Jun 12 18:39:29.633102 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:29.633013 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4"] Jun 12 18:39:29.637515 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:39:29.637487 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6960ab3_48fb_4ed9_8767_9ff53c596db6.slice/crio-72b2f9f290a18bd02956e83da0ca85a906406cfad9d8cb7a5d9dac636494dcdd WatchSource:0}: Error finding container 72b2f9f290a18bd02956e83da0ca85a906406cfad9d8cb7a5d9dac636494dcdd: Status 404 returned error can't find the container with id 72b2f9f290a18bd02956e83da0ca85a906406cfad9d8cb7a5d9dac636494dcdd Jun 12 18:39:30.545088 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:30.545052 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4" event={"ID":"d6960ab3-48fb-4ed9-8767-9ff53c596db6","Type":"ContainerStarted","Data":"6d9a24327df57e880e9c64c92bf9d8c52d15a5f3da440c4ca75dc415470d307e"} Jun 12 18:39:30.545497 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:30.545100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4" event={"ID":"d6960ab3-48fb-4ed9-8767-9ff53c596db6","Type":"ContainerStarted","Data":"72b2f9f290a18bd02956e83da0ca85a906406cfad9d8cb7a5d9dac636494dcdd"} Jun 12 18:39:30.545497 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:30.545182 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4" Jun 12 18:39:30.578952 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:30.578904 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4" podStartSLOduration=1.578889934 podStartE2EDuration="1.578889934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:39:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:39:30.577255637 +0000 UTC m=+515.516017633" watchObservedRunningTime="2026-06-12 18:39:30.578889934 +0000 UTC m=+515.517651931" Jun 12 18:39:41.551651 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:39:41.551616 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6w9n4" Jun 12 18:40:03.469467 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:03.469435 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2pvfv"] Jun 12 18:40:03.474036 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:03.474002 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2pvfv" Jun 12 18:40:03.476312 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:03.476288 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2pvfv"] Jun 12 18:40:03.476474 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:03.476435 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nd8lj\"" Jun 12 18:40:03.520593 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:03.520533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9vnd\" (UniqueName: \"kubernetes.io/projected/cec45f30-6acf-4201-957e-0ba733a94d3a-kube-api-access-p9vnd\") pod \"authorino-75d556bd77-2pvfv\" (UID: \"cec45f30-6acf-4201-957e-0ba733a94d3a\") " pod="kuadrant-system/authorino-75d556bd77-2pvfv" Jun 12 18:40:03.621956 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:03.621919 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9vnd\" (UniqueName: \"kubernetes.io/projected/cec45f30-6acf-4201-957e-0ba733a94d3a-kube-api-access-p9vnd\") pod \"authorino-75d556bd77-2pvfv\" (UID: \"cec45f30-6acf-4201-957e-0ba733a94d3a\") " pod="kuadrant-system/authorino-75d556bd77-2pvfv" Jun 12 18:40:03.630955 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:03.630924 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9vnd\" (UniqueName: \"kubernetes.io/projected/cec45f30-6acf-4201-957e-0ba733a94d3a-kube-api-access-p9vnd\") pod \"authorino-75d556bd77-2pvfv\" (UID: \"cec45f30-6acf-4201-957e-0ba733a94d3a\") " pod="kuadrant-system/authorino-75d556bd77-2pvfv" Jun 12 18:40:03.784117 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:03.784031 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2pvfv" Jun 12 18:40:03.919782 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:03.919753 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2pvfv"] Jun 12 18:40:03.922444 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:40:03.922418 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcec45f30_6acf_4201_957e_0ba733a94d3a.slice/crio-378a4dedd7a4eacf3264412c4b6dcfd24e0b449368d3440172a973b4e5990d74 WatchSource:0}: Error finding container 378a4dedd7a4eacf3264412c4b6dcfd24e0b449368d3440172a973b4e5990d74: Status 404 returned error can't find the container with id 378a4dedd7a4eacf3264412c4b6dcfd24e0b449368d3440172a973b4e5990d74 Jun 12 18:40:04.706393 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:04.706354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2pvfv" event={"ID":"cec45f30-6acf-4201-957e-0ba733a94d3a","Type":"ContainerStarted","Data":"378a4dedd7a4eacf3264412c4b6dcfd24e0b449368d3440172a973b4e5990d74"} Jun 12 18:40:07.722915 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:07.722878 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2pvfv" event={"ID":"cec45f30-6acf-4201-957e-0ba733a94d3a","Type":"ContainerStarted","Data":"91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8"} Jun 12 18:40:07.738151 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:07.738099 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2pvfv" podStartSLOduration=1.6859167529999999 podStartE2EDuration="4.738081829s" totalImagesPullingTime="3.052165076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:40:07.737146541 +0000 UTC m=+552.675908538" watchObservedRunningTime="2026-06-12 18:40:07.738081829 +0000 UTC m=+552.676843836" Jun 12 18:40:55.486621 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:55.486587 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:40:55.487180 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:40:55.486653 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:41:36.315652 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.315610 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-4cdh9"] Jun 12 18:41:36.319180 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.319155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4cdh9" Jun 12 18:41:36.321679 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.321656 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 12 18:41:36.327693 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.327669 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-4cdh9"] Jun 12 18:41:36.363271 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.363243 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-4cdh9"] Jun 12 18:41:36.363505 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:41:36.363485 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-b74f8 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-b74f8 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-4cdh9" podUID="4915e55f-e338-4517-a55b-9798af5918ee" Jun 12 18:41:36.401565 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.401529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4915e55f-e338-4517-a55b-9798af5918ee-tls-cert\") pod \"authorino-76877994-4cdh9\" (UID: \"4915e55f-e338-4517-a55b-9798af5918ee\") " pod="kuadrant-system/authorino-76877994-4cdh9" Jun 12 18:41:36.403492 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.401686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b74f8\" (UniqueName: \"kubernetes.io/projected/4915e55f-e338-4517-a55b-9798af5918ee-kube-api-access-b74f8\") pod \"authorino-76877994-4cdh9\" (UID: \"4915e55f-e338-4517-a55b-9798af5918ee\") " pod="kuadrant-system/authorino-76877994-4cdh9" Jun 12 18:41:36.502394 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.502356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b74f8\" (UniqueName: \"kubernetes.io/projected/4915e55f-e338-4517-a55b-9798af5918ee-kube-api-access-b74f8\") pod \"authorino-76877994-4cdh9\" (UID: \"4915e55f-e338-4517-a55b-9798af5918ee\") " pod="kuadrant-system/authorino-76877994-4cdh9" Jun 12 18:41:36.502591 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.502415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4915e55f-e338-4517-a55b-9798af5918ee-tls-cert\") pod \"authorino-76877994-4cdh9\" (UID: \"4915e55f-e338-4517-a55b-9798af5918ee\") " pod="kuadrant-system/authorino-76877994-4cdh9" Jun 12 18:41:36.504796 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.504767 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4915e55f-e338-4517-a55b-9798af5918ee-tls-cert\") pod \"authorino-76877994-4cdh9\" (UID: \"4915e55f-e338-4517-a55b-9798af5918ee\") " pod="kuadrant-system/authorino-76877994-4cdh9" Jun 12 18:41:36.511410 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:36.511385 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b74f8\" (UniqueName: \"kubernetes.io/projected/4915e55f-e338-4517-a55b-9798af5918ee-kube-api-access-b74f8\") pod \"authorino-76877994-4cdh9\" (UID: \"4915e55f-e338-4517-a55b-9798af5918ee\") " pod="kuadrant-system/authorino-76877994-4cdh9" Jun 12 18:41:37.119734 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:37.119704 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4cdh9" Jun 12 18:41:37.126510 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:37.126488 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4cdh9" Jun 12 18:41:37.205926 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:37.205902 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4915e55f-e338-4517-a55b-9798af5918ee-tls-cert\") pod \"4915e55f-e338-4517-a55b-9798af5918ee\" (UID: \"4915e55f-e338-4517-a55b-9798af5918ee\") " Jun 12 18:41:37.206070 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:37.205953 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b74f8\" (UniqueName: \"kubernetes.io/projected/4915e55f-e338-4517-a55b-9798af5918ee-kube-api-access-b74f8\") pod \"4915e55f-e338-4517-a55b-9798af5918ee\" (UID: \"4915e55f-e338-4517-a55b-9798af5918ee\") " Jun 12 18:41:37.208006 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:37.207975 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4915e55f-e338-4517-a55b-9798af5918ee-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4915e55f-e338-4517-a55b-9798af5918ee" (UID: "4915e55f-e338-4517-a55b-9798af5918ee"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:41:37.208120 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:37.208044 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4915e55f-e338-4517-a55b-9798af5918ee-kube-api-access-b74f8" (OuterVolumeSpecName: "kube-api-access-b74f8") pod "4915e55f-e338-4517-a55b-9798af5918ee" (UID: "4915e55f-e338-4517-a55b-9798af5918ee"). InnerVolumeSpecName "kube-api-access-b74f8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:41:37.307287 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:37.307253 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4915e55f-e338-4517-a55b-9798af5918ee-tls-cert\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\"" Jun 12 18:41:37.307287 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:37.307279 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b74f8\" (UniqueName: \"kubernetes.io/projected/4915e55f-e338-4517-a55b-9798af5918ee-kube-api-access-b74f8\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\"" Jun 12 18:41:38.124043 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:38.124011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4cdh9" Jun 12 18:41:38.153822 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:38.153757 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-4cdh9"] Jun 12 18:41:38.155566 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:38.155539 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-4cdh9"] Jun 12 18:41:38.236028 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:38.235998 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2pvfv"] Jun 12 18:41:38.236194 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:38.236177 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2pvfv" podUID="cec45f30-6acf-4201-957e-0ba733a94d3a" containerName="authorino" containerID="cri-o://91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8" gracePeriod=30 Jun 12 18:41:38.472789 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:38.472765 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2pvfv" Jun 12 18:41:38.613880 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:38.613848 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9vnd\" (UniqueName: \"kubernetes.io/projected/cec45f30-6acf-4201-957e-0ba733a94d3a-kube-api-access-p9vnd\") pod \"cec45f30-6acf-4201-957e-0ba733a94d3a\" (UID: \"cec45f30-6acf-4201-957e-0ba733a94d3a\") " Jun 12 18:41:38.615856 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:38.615832 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cec45f30-6acf-4201-957e-0ba733a94d3a-kube-api-access-p9vnd" (OuterVolumeSpecName: "kube-api-access-p9vnd") pod "cec45f30-6acf-4201-957e-0ba733a94d3a" (UID: "cec45f30-6acf-4201-957e-0ba733a94d3a"). InnerVolumeSpecName "kube-api-access-p9vnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:41:38.714549 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:38.714464 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9vnd\" (UniqueName: \"kubernetes.io/projected/cec45f30-6acf-4201-957e-0ba733a94d3a-kube-api-access-p9vnd\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\"" Jun 12 18:41:39.129741 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.129655 2564 generic.go:356] "Generic (PLEG): container finished" podID="cec45f30-6acf-4201-957e-0ba733a94d3a" containerID="91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8" exitCode=0 Jun 12 18:41:39.129741 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.129693 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2pvfv" Jun 12 18:41:39.130191 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.129739 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2pvfv" event={"ID":"cec45f30-6acf-4201-957e-0ba733a94d3a","Type":"ContainerDied","Data":"91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8"} Jun 12 18:41:39.130191 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.129776 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2pvfv" event={"ID":"cec45f30-6acf-4201-957e-0ba733a94d3a","Type":"ContainerDied","Data":"378a4dedd7a4eacf3264412c4b6dcfd24e0b449368d3440172a973b4e5990d74"} Jun 12 18:41:39.130191 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.129793 2564 scope.go:117] "RemoveContainer" containerID="91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8" Jun 12 18:41:39.138060 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.138045 2564 scope.go:117] "RemoveContainer" containerID="91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8" Jun 12 18:41:39.138300 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:41:39.138283 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8\": container with ID starting with 91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8 not found: ID does not exist" containerID="91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8" Jun 12 18:41:39.138347 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.138306 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8"} err="failed to get container status \"91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8\": rpc error: code = NotFound desc = could not find container \"91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8\": container with ID starting with 91bb6be4667c6b4d44370059c1851d92f986f2d514101f75cb7d68a6eb0701d8 not found: ID does not exist" Jun 12 18:41:39.149702 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.149682 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2pvfv"] Jun 12 18:41:39.153812 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.153792 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2pvfv"] Jun 12 18:41:39.503778 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.503743 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4915e55f-e338-4517-a55b-9798af5918ee" path="/var/lib/kubelet/pods/4915e55f-e338-4517-a55b-9798af5918ee/volumes" Jun 12 18:41:39.503986 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:39.503973 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cec45f30-6acf-4201-957e-0ba733a94d3a" path="/var/lib/kubelet/pods/cec45f30-6acf-4201-957e-0ba733a94d3a/volumes" Jun 12 18:41:41.678923 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.678888 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8679995464-5wmrz"] Jun 12 18:41:41.679292 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.679206 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cec45f30-6acf-4201-957e-0ba733a94d3a" containerName="authorino" Jun 12 18:41:41.679292 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.679217 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cec45f30-6acf-4201-957e-0ba733a94d3a" containerName="authorino" Jun 12 18:41:41.679292 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.679273 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cec45f30-6acf-4201-957e-0ba733a94d3a" containerName="authorino" Jun 12 18:41:41.683470 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.683454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:41.686114 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.686095 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 18:41:41.686350 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.686334 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 18:41:41.686586 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.686555 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lsx5w\"" Jun 12 18:41:41.701761 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.701729 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8679995464-5wmrz"] Jun 12 18:41:41.737447 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.737396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqzf5\" (UniqueName: \"kubernetes.io/projected/065a4053-419b-4a64-bd47-7d24bf177249-kube-api-access-bqzf5\") pod \"maas-controller-8679995464-5wmrz\" (UID: \"065a4053-419b-4a64-bd47-7d24bf177249\") " pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:41.737627 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.737464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/065a4053-419b-4a64-bd47-7d24bf177249-webhook-cert\") pod \"maas-controller-8679995464-5wmrz\" (UID: \"065a4053-419b-4a64-bd47-7d24bf177249\") " pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:41.838722 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.838682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzf5\" (UniqueName: \"kubernetes.io/projected/065a4053-419b-4a64-bd47-7d24bf177249-kube-api-access-bqzf5\") pod \"maas-controller-8679995464-5wmrz\" (UID: \"065a4053-419b-4a64-bd47-7d24bf177249\") " pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:41.838895 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.838730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/065a4053-419b-4a64-bd47-7d24bf177249-webhook-cert\") pod \"maas-controller-8679995464-5wmrz\" (UID: \"065a4053-419b-4a64-bd47-7d24bf177249\") " pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:41.841164 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.841144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/065a4053-419b-4a64-bd47-7d24bf177249-webhook-cert\") pod \"maas-controller-8679995464-5wmrz\" (UID: \"065a4053-419b-4a64-bd47-7d24bf177249\") " pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:41.844992 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.844967 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56bd9c798f-kjtjf"] Jun 12 18:41:41.848841 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.848822 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56bd9c798f-kjtjf" Jun 12 18:41:41.849899 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.849876 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqzf5\" (UniqueName: \"kubernetes.io/projected/065a4053-419b-4a64-bd47-7d24bf177249-kube-api-access-bqzf5\") pod \"maas-controller-8679995464-5wmrz\" (UID: \"065a4053-419b-4a64-bd47-7d24bf177249\") " pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:41.855713 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.855691 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56bd9c798f-kjtjf"] Jun 12 18:41:41.940038 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.939960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltcg4\" (UniqueName: \"kubernetes.io/projected/fc4610a5-79ad-47a9-be3b-58dbff94089b-kube-api-access-ltcg4\") pod \"maas-controller-56bd9c798f-kjtjf\" (UID: \"fc4610a5-79ad-47a9-be3b-58dbff94089b\") " pod="opendatahub/maas-controller-56bd9c798f-kjtjf" Jun 12 18:41:41.940038 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.940022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4610a5-79ad-47a9-be3b-58dbff94089b-webhook-cert\") pod \"maas-controller-56bd9c798f-kjtjf\" (UID: \"fc4610a5-79ad-47a9-be3b-58dbff94089b\") " pod="opendatahub/maas-controller-56bd9c798f-kjtjf" Jun 12 18:41:41.994408 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:41.994381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:42.041482 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:42.041442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4610a5-79ad-47a9-be3b-58dbff94089b-webhook-cert\") pod \"maas-controller-56bd9c798f-kjtjf\" (UID: \"fc4610a5-79ad-47a9-be3b-58dbff94089b\") " pod="opendatahub/maas-controller-56bd9c798f-kjtjf" Jun 12 18:41:42.041667 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:42.041534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltcg4\" (UniqueName: \"kubernetes.io/projected/fc4610a5-79ad-47a9-be3b-58dbff94089b-kube-api-access-ltcg4\") pod \"maas-controller-56bd9c798f-kjtjf\" (UID: \"fc4610a5-79ad-47a9-be3b-58dbff94089b\") " pod="opendatahub/maas-controller-56bd9c798f-kjtjf" Jun 12 18:41:42.044898 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:42.044697 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4610a5-79ad-47a9-be3b-58dbff94089b-webhook-cert\") pod \"maas-controller-56bd9c798f-kjtjf\" (UID: \"fc4610a5-79ad-47a9-be3b-58dbff94089b\") " pod="opendatahub/maas-controller-56bd9c798f-kjtjf" Jun 12 18:41:42.050678 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:42.050647 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltcg4\" (UniqueName: \"kubernetes.io/projected/fc4610a5-79ad-47a9-be3b-58dbff94089b-kube-api-access-ltcg4\") pod \"maas-controller-56bd9c798f-kjtjf\" (UID: \"fc4610a5-79ad-47a9-be3b-58dbff94089b\") " pod="opendatahub/maas-controller-56bd9c798f-kjtjf" Jun 12 18:41:42.125050 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:42.125015 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8679995464-5wmrz"] Jun 12 18:41:42.128718 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:41:42.128693 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065a4053_419b_4a64_bd47_7d24bf177249.slice/crio-7ee4b68c3b273f646212d1ceefdbf6918b9220cb0fe4f11a0173f68928892240 WatchSource:0}: Error finding container 7ee4b68c3b273f646212d1ceefdbf6918b9220cb0fe4f11a0173f68928892240: Status 404 returned error can't find the container with id 7ee4b68c3b273f646212d1ceefdbf6918b9220cb0fe4f11a0173f68928892240 Jun 12 18:41:42.144428 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:42.144403 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8679995464-5wmrz" event={"ID":"065a4053-419b-4a64-bd47-7d24bf177249","Type":"ContainerStarted","Data":"7ee4b68c3b273f646212d1ceefdbf6918b9220cb0fe4f11a0173f68928892240"} Jun 12 18:41:42.167669 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:42.167638 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56bd9c798f-kjtjf" Jun 12 18:41:42.298438 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:42.298413 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56bd9c798f-kjtjf"] Jun 12 18:41:42.300688 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:41:42.300661 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc4610a5_79ad_47a9_be3b_58dbff94089b.slice/crio-33bad4d3a47b18f8b9fa0aab9c6d9707f6d8e590b7b7b37b24a7dcf748807aea WatchSource:0}: Error finding container 33bad4d3a47b18f8b9fa0aab9c6d9707f6d8e590b7b7b37b24a7dcf748807aea: Status 404 returned error can't find the container with id 33bad4d3a47b18f8b9fa0aab9c6d9707f6d8e590b7b7b37b24a7dcf748807aea Jun 12 18:41:43.151427 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:43.151386 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56bd9c798f-kjtjf" event={"ID":"fc4610a5-79ad-47a9-be3b-58dbff94089b","Type":"ContainerStarted","Data":"33bad4d3a47b18f8b9fa0aab9c6d9707f6d8e590b7b7b37b24a7dcf748807aea"} Jun 12 18:41:44.157920 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:44.157888 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56bd9c798f-kjtjf" event={"ID":"fc4610a5-79ad-47a9-be3b-58dbff94089b","Type":"ContainerStarted","Data":"673f369236cb633d59f9d1f2ad7a795a39167796b379e84b2383888833b0b788"} Jun 12 18:41:44.158336 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:44.158072 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56bd9c798f-kjtjf" Jun 12 18:41:44.159765 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:44.159726 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8679995464-5wmrz" event={"ID":"065a4053-419b-4a64-bd47-7d24bf177249","Type":"ContainerStarted","Data":"370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc"} Jun 12 18:41:44.159898 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:44.159852 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:44.175818 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:44.175777 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56bd9c798f-kjtjf" podStartSLOduration=1.419062044 podStartE2EDuration="3.175763208s" totalImagesPullingTime="1.756701164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:41:44.174342431 +0000 UTC m=+649.113104428" watchObservedRunningTime="2026-06-12 18:41:44.175763208 +0000 UTC m=+649.114525258" Jun 12 18:41:44.193373 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:44.193328 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8679995464-5wmrz" podStartSLOduration=1.260838827 podStartE2EDuration="3.19331524s" totalImagesPullingTime="1.932476413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:41:44.192740057 +0000 UTC m=+649.131502053" watchObservedRunningTime="2026-06-12 18:41:44.19331524 +0000 UTC m=+649.132077236" Jun 12 18:41:55.169396 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.169360 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:55.169884 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.169445 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56bd9c798f-kjtjf" Jun 12 18:41:55.225054 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.225021 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8679995464-5wmrz"] Jun 12 18:41:55.225245 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.225224 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8679995464-5wmrz" podUID="065a4053-419b-4a64-bd47-7d24bf177249" containerName="manager" containerID="cri-o://370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc" gracePeriod=30 Jun 12 18:41:55.471740 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.471709 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:55.556657 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.556630 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/065a4053-419b-4a64-bd47-7d24bf177249-webhook-cert\") pod \"065a4053-419b-4a64-bd47-7d24bf177249\" (UID: \"065a4053-419b-4a64-bd47-7d24bf177249\") " Jun 12 18:41:55.556776 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.556692 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqzf5\" (UniqueName: \"kubernetes.io/projected/065a4053-419b-4a64-bd47-7d24bf177249-kube-api-access-bqzf5\") pod \"065a4053-419b-4a64-bd47-7d24bf177249\" (UID: \"065a4053-419b-4a64-bd47-7d24bf177249\") " Jun 12 18:41:55.558778 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.558752 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/065a4053-419b-4a64-bd47-7d24bf177249-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "065a4053-419b-4a64-bd47-7d24bf177249" (UID: "065a4053-419b-4a64-bd47-7d24bf177249"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:41:55.558888 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.558849 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/065a4053-419b-4a64-bd47-7d24bf177249-kube-api-access-bqzf5" (OuterVolumeSpecName: "kube-api-access-bqzf5") pod "065a4053-419b-4a64-bd47-7d24bf177249" (UID: "065a4053-419b-4a64-bd47-7d24bf177249"). InnerVolumeSpecName "kube-api-access-bqzf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:41:55.657396 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.657366 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/065a4053-419b-4a64-bd47-7d24bf177249-webhook-cert\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\"" Jun 12 18:41:55.657396 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:55.657388 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqzf5\" (UniqueName: \"kubernetes.io/projected/065a4053-419b-4a64-bd47-7d24bf177249-kube-api-access-bqzf5\") on node \"ip-10-0-143-164.ec2.internal\" DevicePath \"\"" Jun 12 18:41:56.219608 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:56.219558 2564 generic.go:356] "Generic (PLEG): container finished" podID="065a4053-419b-4a64-bd47-7d24bf177249" containerID="370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc" exitCode=0 Jun 12 18:41:56.220007 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:56.219624 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8679995464-5wmrz" Jun 12 18:41:56.220007 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:56.219641 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8679995464-5wmrz" event={"ID":"065a4053-419b-4a64-bd47-7d24bf177249","Type":"ContainerDied","Data":"370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc"} Jun 12 18:41:56.220007 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:56.219696 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8679995464-5wmrz" event={"ID":"065a4053-419b-4a64-bd47-7d24bf177249","Type":"ContainerDied","Data":"7ee4b68c3b273f646212d1ceefdbf6918b9220cb0fe4f11a0173f68928892240"} Jun 12 18:41:56.220007 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:56.219722 2564 scope.go:117] "RemoveContainer" containerID="370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc" Jun 12 18:41:56.228743 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:56.228531 2564 scope.go:117] "RemoveContainer" containerID="370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc" Jun 12 18:41:56.228858 ip-10-0-143-164 kubenswrapper[2564]: E0612 18:41:56.228839 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc\": container with ID starting with 370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc not found: ID does not exist" containerID="370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc" Jun 12 18:41:56.228905 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:56.228865 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc"} err="failed to get container status \"370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc\": rpc error: code = NotFound desc = could not find container \"370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc\": container with ID starting with 370eec322af96339578daf584bd1c835a9a831f4a8c25a5e20f8289df9d909bc not found: ID does not exist" Jun 12 18:41:56.242960 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:56.242930 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8679995464-5wmrz"] Jun 12 18:41:56.247347 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:56.247319 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8679995464-5wmrz"] Jun 12 18:41:57.504204 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:41:57.504167 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="065a4053-419b-4a64-bd47-7d24bf177249" path="/var/lib/kubelet/pods/065a4053-419b-4a64-bd47-7d24bf177249/volumes" Jun 12 18:42:15.491347 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.491300 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-54cf544994-qbzbl"] Jun 12 18:42:15.492226 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.492200 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="065a4053-419b-4a64-bd47-7d24bf177249" containerName="manager" Jun 12 18:42:15.492279 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.492230 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="065a4053-419b-4a64-bd47-7d24bf177249" containerName="manager" Jun 12 18:42:15.492325 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.492315 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="065a4053-419b-4a64-bd47-7d24bf177249" containerName="manager" Jun 12 18:42:15.496371 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.496355 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.499269 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.499243 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 12 18:42:15.499392 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.499284 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w96b\"" Jun 12 18:42:15.505541 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.505519 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-54cf544994-qbzbl"] Jun 12 18:42:15.621041 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.621001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5wgz\" (UniqueName: \"kubernetes.io/projected/99c5ca4b-b63e-4f31-ac01-53b9874a2e8d-kube-api-access-g5wgz\") pod \"maas-api-54cf544994-qbzbl\" (UID: \"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d\") " pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.621237 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.621121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99c5ca4b-b63e-4f31-ac01-53b9874a2e8d-maas-api-tls\") pod \"maas-api-54cf544994-qbzbl\" (UID: \"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d\") " pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.621237 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.621157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99c5ca4b-b63e-4f31-ac01-53b9874a2e8d-openshift-service-ca\") pod \"maas-api-54cf544994-qbzbl\" (UID: \"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d\") " pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.722348 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.722310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99c5ca4b-b63e-4f31-ac01-53b9874a2e8d-maas-api-tls\") pod \"maas-api-54cf544994-qbzbl\" (UID: \"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d\") " pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.722529 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.722362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99c5ca4b-b63e-4f31-ac01-53b9874a2e8d-openshift-service-ca\") pod \"maas-api-54cf544994-qbzbl\" (UID: \"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d\") " pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.722529 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.722415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5wgz\" (UniqueName: \"kubernetes.io/projected/99c5ca4b-b63e-4f31-ac01-53b9874a2e8d-kube-api-access-g5wgz\") pod \"maas-api-54cf544994-qbzbl\" (UID: \"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d\") " pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.723265 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.723235 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99c5ca4b-b63e-4f31-ac01-53b9874a2e8d-openshift-service-ca\") pod \"maas-api-54cf544994-qbzbl\" (UID: \"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d\") " pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.725168 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.725145 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99c5ca4b-b63e-4f31-ac01-53b9874a2e8d-maas-api-tls\") pod \"maas-api-54cf544994-qbzbl\" (UID: \"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d\") " pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.729860 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.729842 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5wgz\" (UniqueName: \"kubernetes.io/projected/99c5ca4b-b63e-4f31-ac01-53b9874a2e8d-kube-api-access-g5wgz\") pod \"maas-api-54cf544994-qbzbl\" (UID: \"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d\") " pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.809798 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.809729 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:15.955234 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.955200 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-54cf544994-qbzbl"] Jun 12 18:42:15.959325 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:42:15.959276 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c5ca4b_b63e_4f31_ac01_53b9874a2e8d.slice/crio-ebbabebe1fa5e030d6ce84a831807d8b43072a3d257aa03b902a3ffd3348f0e3 WatchSource:0}: Error finding container ebbabebe1fa5e030d6ce84a831807d8b43072a3d257aa03b902a3ffd3348f0e3: Status 404 returned error can't find the container with id ebbabebe1fa5e030d6ce84a831807d8b43072a3d257aa03b902a3ffd3348f0e3 Jun 12 18:42:15.960698 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.960679 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:42:15.967390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.967366 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-pv87d"] Jun 12 18:42:15.973468 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.973449 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-pv87d" Jun 12 18:42:15.975818 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.975797 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 18:42:15.979390 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:15.979370 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-pv87d"] Jun 12 18:42:16.010315 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.010292 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-b4s45"] Jun 12 18:42:16.014500 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.014481 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-b4s45" Jun 12 18:42:16.017052 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.017031 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7jm2n\"" Jun 12 18:42:16.025681 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.025660 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-b4s45"] Jun 12 18:42:16.126110 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.126019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn7bg\" (UniqueName: \"kubernetes.io/projected/536af7b9-5128-4a42-8c15-7079a66fe5b8-kube-api-access-cn7bg\") pod \"payload-processing-699b6cd6c-b4s45\" (UID: \"536af7b9-5128-4a42-8c15-7079a66fe5b8\") " pod="openshift-ingress/payload-processing-699b6cd6c-b4s45" Jun 12 18:42:16.126262 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.126178 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7j4f\" (UniqueName: \"kubernetes.io/projected/c3945cd8-4ae8-4392-81f9-9920e0f6702b-kube-api-access-k7j4f\") pod \"payload-pre-processing-579785bc64-pv87d\" (UID: \"c3945cd8-4ae8-4392-81f9-9920e0f6702b\") " pod="openshift-ingress/payload-pre-processing-579785bc64-pv87d" Jun 12 18:42:16.227348 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.227311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn7bg\" (UniqueName: \"kubernetes.io/projected/536af7b9-5128-4a42-8c15-7079a66fe5b8-kube-api-access-cn7bg\") pod \"payload-processing-699b6cd6c-b4s45\" (UID: \"536af7b9-5128-4a42-8c15-7079a66fe5b8\") " pod="openshift-ingress/payload-processing-699b6cd6c-b4s45" Jun 12 18:42:16.227552 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.227463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7j4f\" (UniqueName: \"kubernetes.io/projected/c3945cd8-4ae8-4392-81f9-9920e0f6702b-kube-api-access-k7j4f\") pod \"payload-pre-processing-579785bc64-pv87d\" (UID: \"c3945cd8-4ae8-4392-81f9-9920e0f6702b\") " pod="openshift-ingress/payload-pre-processing-579785bc64-pv87d" Jun 12 18:42:16.235844 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.235817 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn7bg\" (UniqueName: \"kubernetes.io/projected/536af7b9-5128-4a42-8c15-7079a66fe5b8-kube-api-access-cn7bg\") pod \"payload-processing-699b6cd6c-b4s45\" (UID: \"536af7b9-5128-4a42-8c15-7079a66fe5b8\") " pod="openshift-ingress/payload-processing-699b6cd6c-b4s45" Jun 12 18:42:16.235953 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.235927 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7j4f\" (UniqueName: \"kubernetes.io/projected/c3945cd8-4ae8-4392-81f9-9920e0f6702b-kube-api-access-k7j4f\") pod \"payload-pre-processing-579785bc64-pv87d\" (UID: \"c3945cd8-4ae8-4392-81f9-9920e0f6702b\") " pod="openshift-ingress/payload-pre-processing-579785bc64-pv87d" Jun 12 18:42:16.286041 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.286010 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-pv87d" Jun 12 18:42:16.312758 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.312728 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-54cf544994-qbzbl" event={"ID":"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d","Type":"ContainerStarted","Data":"ebbabebe1fa5e030d6ce84a831807d8b43072a3d257aa03b902a3ffd3348f0e3"} Jun 12 18:42:16.325011 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.324983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-b4s45" Jun 12 18:42:16.425830 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.425801 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-pv87d"] Jun 12 18:42:16.427784 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:42:16.427757 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3945cd8_4ae8_4392_81f9_9920e0f6702b.slice/crio-50016818aba682e59560201ae9b840d0bcb544cbcc3731abc67fce487664c5a6 WatchSource:0}: Error finding container 50016818aba682e59560201ae9b840d0bcb544cbcc3731abc67fce487664c5a6: Status 404 returned error can't find the container with id 50016818aba682e59560201ae9b840d0bcb544cbcc3731abc67fce487664c5a6 Jun 12 18:42:16.467157 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:16.467133 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-b4s45"] Jun 12 18:42:16.469840 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:42:16.469813 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536af7b9_5128_4a42_8c15_7079a66fe5b8.slice/crio-57643ff60a0d30cf414779d1c8b62a6d9da5790b70c7b77d35b8ea46e8a5e7a8 WatchSource:0}: Error finding container 57643ff60a0d30cf414779d1c8b62a6d9da5790b70c7b77d35b8ea46e8a5e7a8: Status 404 returned error can't find the container with id 57643ff60a0d30cf414779d1c8b62a6d9da5790b70c7b77d35b8ea46e8a5e7a8 Jun 12 18:42:17.322811 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:17.322738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-pv87d" event={"ID":"c3945cd8-4ae8-4392-81f9-9920e0f6702b","Type":"ContainerStarted","Data":"50016818aba682e59560201ae9b840d0bcb544cbcc3731abc67fce487664c5a6"} Jun 12 18:42:17.324841 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:17.324779 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-b4s45" event={"ID":"536af7b9-5128-4a42-8c15-7079a66fe5b8","Type":"ContainerStarted","Data":"57643ff60a0d30cf414779d1c8b62a6d9da5790b70c7b77d35b8ea46e8a5e7a8"} Jun 12 18:42:18.332042 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:18.332006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-54cf544994-qbzbl" event={"ID":"99c5ca4b-b63e-4f31-ac01-53b9874a2e8d","Type":"ContainerStarted","Data":"fb3cea864b96f5ae4b14576d920424a9f9a3452bfe7a0e5694ceeb745ba2dcfd"} Jun 12 18:42:18.332454 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:18.332151 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:18.355281 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:18.355232 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-54cf544994-qbzbl" podStartSLOduration=1.488147217 podStartE2EDuration="3.355210264s" totalImagesPullingTime="1.867063047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:18.347441963 +0000 UTC m=+683.286203988" watchObservedRunningTime="2026-06-12 18:42:18.355210264 +0000 UTC m=+683.293972282" Jun 12 18:42:19.339172 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:19.339080 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-pv87d" event={"ID":"c3945cd8-4ae8-4392-81f9-9920e0f6702b","Type":"ContainerStarted","Data":"c9f0dc88c3ce23ebb6bae0659692b31b929b90607e8df2e4246cbd400e5d6089"} Jun 12 18:42:19.339634 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:19.339321 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-pv87d" Jun 12 18:42:19.341240 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:19.341203 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-b4s45" event={"ID":"536af7b9-5128-4a42-8c15-7079a66fe5b8","Type":"ContainerStarted","Data":"470f59bc7e82607424c2739039bc8f35e2432864f4eaa2c4e1eba0dfe785050a"} Jun 12 18:42:19.355903 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:19.355847 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-pv87d" podStartSLOduration=1.713343981 podStartE2EDuration="4.355828364s" totalImagesPullingTime="2.642484383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:19.355326731 +0000 UTC m=+684.294088730" watchObservedRunningTime="2026-06-12 18:42:19.355828364 +0000 UTC m=+684.294590362" Jun 12 18:42:19.372647 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:19.372606 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-b4s45" podStartSLOduration=1.765669599 podStartE2EDuration="4.372590373s" totalImagesPullingTime="2.606920774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:19.370956648 +0000 UTC m=+684.309718666" watchObservedRunningTime="2026-06-12 18:42:19.372590373 +0000 UTC m=+684.311352361" Jun 12 18:42:20.346135 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:20.346102 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-b4s45" Jun 12 18:42:24.346914 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:24.346883 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-54cf544994-qbzbl" Jun 12 18:42:30.348368 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:30.348336 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-pv87d" Jun 12 18:42:31.353895 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:42:31.353868 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-b4s45" Jun 12 18:45:06.089200 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.089166 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58684747d7-qss6m"] Jun 12 18:45:06.092450 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.092434 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.095037 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.095019 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 12 18:45:06.095160 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.095019 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 12 18:45:06.096005 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.095988 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nd8lj\"" Jun 12 18:45:06.099908 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.099510 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58684747d7-qss6m"] Jun 12 18:45:06.233386 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.233343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d226f0d-c67e-46ed-bfbd-f56c438226a9-tls-cert\") pod \"authorino-58684747d7-qss6m\" (UID: \"7d226f0d-c67e-46ed-bfbd-f56c438226a9\") " pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.233386 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.233384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt94p\" (UniqueName: \"kubernetes.io/projected/7d226f0d-c67e-46ed-bfbd-f56c438226a9-kube-api-access-rt94p\") pod \"authorino-58684747d7-qss6m\" (UID: \"7d226f0d-c67e-46ed-bfbd-f56c438226a9\") " pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.233652 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.233542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d226f0d-c67e-46ed-bfbd-f56c438226a9-oidc-ca\") pod \"authorino-58684747d7-qss6m\" (UID: \"7d226f0d-c67e-46ed-bfbd-f56c438226a9\") " pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.334496 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.334452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d226f0d-c67e-46ed-bfbd-f56c438226a9-oidc-ca\") pod \"authorino-58684747d7-qss6m\" (UID: \"7d226f0d-c67e-46ed-bfbd-f56c438226a9\") " pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.334496 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.334494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d226f0d-c67e-46ed-bfbd-f56c438226a9-tls-cert\") pod \"authorino-58684747d7-qss6m\" (UID: \"7d226f0d-c67e-46ed-bfbd-f56c438226a9\") " pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.334735 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.334512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt94p\" (UniqueName: \"kubernetes.io/projected/7d226f0d-c67e-46ed-bfbd-f56c438226a9-kube-api-access-rt94p\") pod \"authorino-58684747d7-qss6m\" (UID: \"7d226f0d-c67e-46ed-bfbd-f56c438226a9\") " pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.335128 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.335099 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d226f0d-c67e-46ed-bfbd-f56c438226a9-oidc-ca\") pod \"authorino-58684747d7-qss6m\" (UID: \"7d226f0d-c67e-46ed-bfbd-f56c438226a9\") " pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.336909 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.336887 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d226f0d-c67e-46ed-bfbd-f56c438226a9-tls-cert\") pod \"authorino-58684747d7-qss6m\" (UID: \"7d226f0d-c67e-46ed-bfbd-f56c438226a9\") " pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.342404 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.342347 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt94p\" (UniqueName: \"kubernetes.io/projected/7d226f0d-c67e-46ed-bfbd-f56c438226a9-kube-api-access-rt94p\") pod \"authorino-58684747d7-qss6m\" (UID: \"7d226f0d-c67e-46ed-bfbd-f56c438226a9\") " pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.403564 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.403533 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58684747d7-qss6m" Jun 12 18:45:06.534378 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:06.534310 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58684747d7-qss6m"] Jun 12 18:45:06.536507 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:45:06.536476 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d226f0d_c67e_46ed_bfbd_f56c438226a9.slice/crio-ccdb137db8d673cea95250b777acf9e5b14fceb16c9d985efc782104fc148bc7 WatchSource:0}: Error finding container ccdb137db8d673cea95250b777acf9e5b14fceb16c9d985efc782104fc148bc7: Status 404 returned error can't find the container with id ccdb137db8d673cea95250b777acf9e5b14fceb16c9d985efc782104fc148bc7 Jun 12 18:45:07.120811 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:07.120781 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58684747d7-qss6m" event={"ID":"7d226f0d-c67e-46ed-bfbd-f56c438226a9","Type":"ContainerStarted","Data":"ccdb137db8d673cea95250b777acf9e5b14fceb16c9d985efc782104fc148bc7"} Jun 12 18:45:08.127367 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:08.127334 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58684747d7-qss6m" event={"ID":"7d226f0d-c67e-46ed-bfbd-f56c438226a9","Type":"ContainerStarted","Data":"76fc6439bcded3350a9d98d3658281a07e39ef87a4ff7724b24542c95c71accb"} Jun 12 18:45:08.147387 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:08.147340 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58684747d7-qss6m" podStartSLOduration=1.622896178 podStartE2EDuration="2.147325124s" totalImagesPullingTime="524.428946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:45:08.145705448 +0000 UTC m=+853.084467446" watchObservedRunningTime="2026-06-12 18:45:08.147325124 +0000 UTC m=+853.086087119" Jun 12 18:45:13.782768 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.782737 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q"] Jun 12 18:45:13.786680 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.786658 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.789346 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.789325 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 18:45:13.790483 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.790462 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qqghg\"" Jun 12 18:45:13.790483 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.790478 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 12 18:45:13.790694 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.790488 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 18:45:13.795475 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.795446 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q"] Jun 12 18:45:13.896707 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.896678 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzlld\" (UniqueName: \"kubernetes.io/projected/27dd90e2-a05b-41ee-8202-09a00f1de088-kube-api-access-bzlld\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.896861 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.896712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27dd90e2-a05b-41ee-8202-09a00f1de088-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.896861 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.896783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.896861 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.896826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.897009 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.896864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.897009 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.896903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.997791 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.997754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.997982 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.997806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.997982 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.997853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.997982 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.997887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.997982 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.997937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzlld\" (UniqueName: \"kubernetes.io/projected/27dd90e2-a05b-41ee-8202-09a00f1de088-kube-api-access-bzlld\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.997982 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.997967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27dd90e2-a05b-41ee-8202-09a00f1de088-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.998329 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.998226 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.998329 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.998274 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.998426 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.998349 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:13.999983 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:13.999957 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27dd90e2-a05b-41ee-8202-09a00f1de088-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:14.000429 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:14.000413 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27dd90e2-a05b-41ee-8202-09a00f1de088-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:14.008534 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:14.008511 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzlld\" (UniqueName: \"kubernetes.io/projected/27dd90e2-a05b-41ee-8202-09a00f1de088-kube-api-access-bzlld\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q\" (UID: \"27dd90e2-a05b-41ee-8202-09a00f1de088\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:14.100297 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:14.100210 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:45:14.232164 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:14.232130 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q"] Jun 12 18:45:14.235738 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:45:14.235707 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27dd90e2_a05b_41ee_8202_09a00f1de088.slice/crio-b6f2aa1788e87ce6451bc9f9978bb513cfe1b9b69933f85c8e6e94aa33a3b611 WatchSource:0}: Error finding container b6f2aa1788e87ce6451bc9f9978bb513cfe1b9b69933f85c8e6e94aa33a3b611: Status 404 returned error can't find the container with id b6f2aa1788e87ce6451bc9f9978bb513cfe1b9b69933f85c8e6e94aa33a3b611 Jun 12 18:45:15.165542 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:15.165504 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" event={"ID":"27dd90e2-a05b-41ee-8202-09a00f1de088","Type":"ContainerStarted","Data":"b6f2aa1788e87ce6451bc9f9978bb513cfe1b9b69933f85c8e6e94aa33a3b611"} Jun 12 18:45:18.184650 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:18.184540 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" event={"ID":"27dd90e2-a05b-41ee-8202-09a00f1de088","Type":"ContainerStarted","Data":"319c7ff84b6acfca2bb1f72deaf0ffd5f34ddde63057ab29d5a65bad754de868"} Jun 12 18:45:37.078411 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.078373 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj"] Jun 12 18:45:37.085714 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.085694 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.088108 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.088086 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 12 18:45:37.092068 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.092040 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj"] Jun 12 18:45:37.185973 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.185945 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.186086 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.186002 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.186086 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.186042 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzw74\" (UniqueName: \"kubernetes.io/projected/471affbd-64c2-44d6-9bc2-cee7f17793d6-kube-api-access-lzw74\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.186157 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.186106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/471affbd-64c2-44d6-9bc2-cee7f17793d6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.186157 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.186127 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.186224 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.186167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.286783 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.286750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.286967 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.286816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.286967 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.286834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzw74\" (UniqueName: \"kubernetes.io/projected/471affbd-64c2-44d6-9bc2-cee7f17793d6-kube-api-access-lzw74\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.286967 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.286854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/471affbd-64c2-44d6-9bc2-cee7f17793d6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.286967 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.286874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.286967 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.286903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.287257 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.287233 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.287306 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.287268 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.287306 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.287293 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.289152 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.289128 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/471affbd-64c2-44d6-9bc2-cee7f17793d6-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.289434 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.289416 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/471affbd-64c2-44d6-9bc2-cee7f17793d6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.295695 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.295675 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzw74\" (UniqueName: \"kubernetes.io/projected/471affbd-64c2-44d6-9bc2-cee7f17793d6-kube-api-access-lzw74\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj\" (UID: \"471affbd-64c2-44d6-9bc2-cee7f17793d6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.423915 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.423876 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:45:37.575913 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:37.575880 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj"] Jun 12 18:45:37.578985 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:45:37.578954 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471affbd_64c2_44d6_9bc2_cee7f17793d6.slice/crio-c0be0891542d978d5c7875f59b1a05d1caf3abedcf3a876837d78390bb546895 WatchSource:0}: Error finding container c0be0891542d978d5c7875f59b1a05d1caf3abedcf3a876837d78390bb546895: Status 404 returned error can't find the container with id c0be0891542d978d5c7875f59b1a05d1caf3abedcf3a876837d78390bb546895 Jun 12 18:45:38.278176 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:38.278138 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" event={"ID":"471affbd-64c2-44d6-9bc2-cee7f17793d6","Type":"ContainerStarted","Data":"52e4a4d9a0824d70a34b94e56d463230e274f6ea59934f33e82a89244f5fa920"} Jun 12 18:45:38.278619 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:38.278197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" event={"ID":"471affbd-64c2-44d6-9bc2-cee7f17793d6","Type":"ContainerStarted","Data":"c0be0891542d978d5c7875f59b1a05d1caf3abedcf3a876837d78390bb546895"} Jun 12 18:45:44.968908 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:44.968808 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9"] Jun 12 18:45:44.973829 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:44.973807 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:44.976360 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:44.976337 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 12 18:45:44.983084 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:44.983056 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9"] Jun 12 18:45:45.052088 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.052059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.052260 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.052104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.052260 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.052190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762c4559-31c6-4f23-9016-3cd0e9f5f062-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.052339 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.052257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.052339 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.052297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcnfv\" (UniqueName: \"kubernetes.io/projected/762c4559-31c6-4f23-9016-3cd0e9f5f062-kube-api-access-lcnfv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.052339 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.052322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.153623 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.153568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.153797 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.153630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnfv\" (UniqueName: \"kubernetes.io/projected/762c4559-31c6-4f23-9016-3cd0e9f5f062-kube-api-access-lcnfv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.153797 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.153660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.153797 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.153691 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.153797 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.153731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.154031 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.153837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762c4559-31c6-4f23-9016-3cd0e9f5f062-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.154031 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.154021 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.154139 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.154068 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.154333 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.154299 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.156156 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.156133 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/762c4559-31c6-4f23-9016-3cd0e9f5f062-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.156250 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.156205 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/762c4559-31c6-4f23-9016-3cd0e9f5f062-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.161743 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.161721 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcnfv\" (UniqueName: \"kubernetes.io/projected/762c4559-31c6-4f23-9016-3cd0e9f5f062-kube-api-access-lcnfv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9\" (UID: \"762c4559-31c6-4f23-9016-3cd0e9f5f062\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.286167 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.286082 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" Jun 12 18:45:45.420196 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:45.420166 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9"] Jun 12 18:45:45.422012 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:45:45.421987 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762c4559_31c6_4f23_9016_3cd0e9f5f062.slice/crio-0c0a2af43ef4d94909caf55b286d0cef72070d2d420a09f44020f8a25ee50342 WatchSource:0}: Error finding container 0c0a2af43ef4d94909caf55b286d0cef72070d2d420a09f44020f8a25ee50342: Status 404 returned error can't find the container with id 0c0a2af43ef4d94909caf55b286d0cef72070d2d420a09f44020f8a25ee50342 Jun 12 18:45:46.319433 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:46.319383 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" event={"ID":"762c4559-31c6-4f23-9016-3cd0e9f5f062","Type":"ContainerStarted","Data":"da50e95dbc451ec23f22bbb8512157ecf1547e31508fc3a90cfd392dc950c771"} Jun 12 18:45:46.319938 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:46.319496 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9" event={"ID":"762c4559-31c6-4f23-9016-3cd0e9f5f062","Type":"ContainerStarted","Data":"0c0a2af43ef4d94909caf55b286d0cef72070d2d420a09f44020f8a25ee50342"} Jun 12 18:45:53.972082 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:53.972046 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2"] Jun 12 18:45:53.976253 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:53.976228 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:53.979083 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:53.979057 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 12 18:45:53.989368 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:53.989348 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2"] Jun 12 18:45:54.029013 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.028986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.029173 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.029021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.029173 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.029058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmdxv\" (UniqueName: \"kubernetes.io/projected/3808419a-1f57-45db-b8b5-8420e79a88b8-kube-api-access-vmdxv\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.029173 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.029108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3808419a-1f57-45db-b8b5-8420e79a88b8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.029173 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.029161 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.029351 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.029187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.130557 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.130523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.130745 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.130615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.130745 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.130639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.130745 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.130728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmdxv\" (UniqueName: \"kubernetes.io/projected/3808419a-1f57-45db-b8b5-8420e79a88b8-kube-api-access-vmdxv\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.130879 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.130761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3808419a-1f57-45db-b8b5-8420e79a88b8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.130879 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.130796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.130984 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.130963 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.131046 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.131010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.131276 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.131096 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.132903 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.132877 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3808419a-1f57-45db-b8b5-8420e79a88b8-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.133179 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.133159 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3808419a-1f57-45db-b8b5-8420e79a88b8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.138067 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.138043 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmdxv\" (UniqueName: \"kubernetes.io/projected/3808419a-1f57-45db-b8b5-8420e79a88b8-kube-api-access-vmdxv\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-67rv2\" (UID: \"3808419a-1f57-45db-b8b5-8420e79a88b8\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.289462 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.289381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:45:54.422852 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:54.422829 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2"] Jun 12 18:45:54.425753 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:45:54.425722 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3808419a_1f57_45db_b8b5_8420e79a88b8.slice/crio-485bc04e3e6e4050853eac031b88db180c4f77ed1f10afca5a0da178c7d6a233 WatchSource:0}: Error finding container 485bc04e3e6e4050853eac031b88db180c4f77ed1f10afca5a0da178c7d6a233: Status 404 returned error can't find the container with id 485bc04e3e6e4050853eac031b88db180c4f77ed1f10afca5a0da178c7d6a233 Jun 12 18:45:55.367899 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:55.367860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" event={"ID":"3808419a-1f57-45db-b8b5-8420e79a88b8","Type":"ContainerStarted","Data":"aa817bb325ad68f53cd4022ca918598e14508ecff8fcf4095334d10efa6e1344"} Jun 12 18:45:55.368297 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:55.367926 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" event={"ID":"3808419a-1f57-45db-b8b5-8420e79a88b8","Type":"ContainerStarted","Data":"485bc04e3e6e4050853eac031b88db180c4f77ed1f10afca5a0da178c7d6a233"} Jun 12 18:45:55.531524 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:55.531487 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:45:55.534662 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:55.534641 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:45:56.373862 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:56.373819 2564 generic.go:356] "Generic (PLEG): container finished" podID="3808419a-1f57-45db-b8b5-8420e79a88b8" containerID="aa817bb325ad68f53cd4022ca918598e14508ecff8fcf4095334d10efa6e1344" exitCode=0 Jun 12 18:45:56.374250 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:56.373907 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" event={"ID":"3808419a-1f57-45db-b8b5-8420e79a88b8","Type":"ContainerDied","Data":"aa817bb325ad68f53cd4022ca918598e14508ecff8fcf4095334d10efa6e1344"} Jun 12 18:45:58.387604 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:58.386890 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" event={"ID":"3808419a-1f57-45db-b8b5-8420e79a88b8","Type":"ContainerStarted","Data":"8ebb77ba6486bde36e8bd4cc171ef539046190f4e9aff8440490e03c1bcc1437"} Jun 12 18:45:58.410098 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:45:58.410045 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" podStartSLOduration=2.996636913 podStartE2EDuration="5.41002878s" totalImagesPullingTime="1.062158026s" totalInitContainerRuntime="1.351233841s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:45:58.408946818 +0000 UTC m=+903.347708804" watchObservedRunningTime="2026-06-12 18:45:58.41002878 +0000 UTC m=+903.348790775" Jun 12 18:46:00.671668 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.671635 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj"] Jun 12 18:46:00.676539 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.676515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.679336 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.679311 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 12 18:46:00.685637 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.685545 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj"] Jun 12 18:46:00.790438 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.790400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.790438 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.790444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f821489e-dbba-402a-a1e8-e65445cb2eff-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.790739 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.790464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr75m\" (UniqueName: \"kubernetes.io/projected/f821489e-dbba-402a-a1e8-e65445cb2eff-kube-api-access-hr75m\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.790739 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.790563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.790739 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.790613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.790739 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.790690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.891773 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.891737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.891971 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.891785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.891971 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.891830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.891971 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.891884 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.891971 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.891912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f821489e-dbba-402a-a1e8-e65445cb2eff-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.891971 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.891936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr75m\" (UniqueName: \"kubernetes.io/projected/f821489e-dbba-402a-a1e8-e65445cb2eff-kube-api-access-hr75m\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.892223 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.892181 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.892273 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.892241 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.892324 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.892250 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.894114 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.894097 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f821489e-dbba-402a-a1e8-e65445cb2eff-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.894467 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.894450 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f821489e-dbba-402a-a1e8-e65445cb2eff-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.899529 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.899507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr75m\" (UniqueName: \"kubernetes.io/projected/f821489e-dbba-402a-a1e8-e65445cb2eff-kube-api-access-hr75m\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-cl9mj\" (UID: \"f821489e-dbba-402a-a1e8-e65445cb2eff\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:00.987485 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:00.987410 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:46:01.121397 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:01.121356 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj"] Jun 12 18:46:01.124116 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:46:01.124081 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf821489e_dbba_402a_a1e8_e65445cb2eff.slice/crio-5a2c20c2c1453420507c8e5d81f3d3d18db83ded44e51f1fe5112d525cb6319b WatchSource:0}: Error finding container 5a2c20c2c1453420507c8e5d81f3d3d18db83ded44e51f1fe5112d525cb6319b: Status 404 returned error can't find the container with id 5a2c20c2c1453420507c8e5d81f3d3d18db83ded44e51f1fe5112d525cb6319b Jun 12 18:46:01.403986 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:01.403953 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" event={"ID":"f821489e-dbba-402a-a1e8-e65445cb2eff","Type":"ContainerStarted","Data":"a02e699ff162d26bcae9b23cedc4eed8a8ca82f701e330691528a6b6e735e2d8"} Jun 12 18:46:01.404175 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:01.404000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" event={"ID":"f821489e-dbba-402a-a1e8-e65445cb2eff","Type":"ContainerStarted","Data":"5a2c20c2c1453420507c8e5d81f3d3d18db83ded44e51f1fe5112d525cb6319b"} Jun 12 18:46:04.290423 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:04.290391 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:46:04.290817 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:04.290456 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:46:04.302757 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:04.302736 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:46:04.430926 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:04.430890 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-67rv2" Jun 12 18:46:10.449157 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:10.449118 2564 generic.go:356] "Generic (PLEG): container finished" podID="27dd90e2-a05b-41ee-8202-09a00f1de088" containerID="319c7ff84b6acfca2bb1f72deaf0ffd5f34ddde63057ab29d5a65bad754de868" exitCode=0 Jun 12 18:46:10.449617 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:10.449176 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" event={"ID":"27dd90e2-a05b-41ee-8202-09a00f1de088","Type":"ContainerDied","Data":"319c7ff84b6acfca2bb1f72deaf0ffd5f34ddde63057ab29d5a65bad754de868"} Jun 12 18:46:11.455909 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:11.455875 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" event={"ID":"27dd90e2-a05b-41ee-8202-09a00f1de088","Type":"ContainerStarted","Data":"1e2d737e16d69b4d50a094ac540ebd42a33019029ac3f40b0dea6698313d7e7b"} Jun 12 18:46:11.473880 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:11.473733 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" podStartSLOduration=2.9356737859999997 podStartE2EDuration="58.473693048s" totalImagesPullingTime="3.840703493s" totalInitContainerRuntime="51.697315769s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:45:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:11.47294081 +0000 UTC m=+916.411702828" watchObservedRunningTime="2026-06-12 18:46:11.473693048 +0000 UTC m=+916.412455045" Jun 12 18:46:14.100470 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:14.100435 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:46:14.100970 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:14.100494 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:46:14.112974 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:14.112948 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:46:14.483387 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:14.483355 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q" Jun 12 18:46:42.603469 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:42.603378 2564 generic.go:356] "Generic (PLEG): container finished" podID="471affbd-64c2-44d6-9bc2-cee7f17793d6" containerID="52e4a4d9a0824d70a34b94e56d463230e274f6ea59934f33e82a89244f5fa920" exitCode=0 Jun 12 18:46:42.603469 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:42.603448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" event={"ID":"471affbd-64c2-44d6-9bc2-cee7f17793d6","Type":"ContainerDied","Data":"52e4a4d9a0824d70a34b94e56d463230e274f6ea59934f33e82a89244f5fa920"} Jun 12 18:46:43.610433 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:43.610393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" event={"ID":"471affbd-64c2-44d6-9bc2-cee7f17793d6","Type":"ContainerStarted","Data":"2cf91a93038ba8484ac84a1793f251a54e24178e8a7dac1f31038019a9e982a2"} Jun 12 18:46:43.640364 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:43.640314 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" podStartSLOduration=1.783539129 podStartE2EDuration="1m6.640294368s" totalImagesPullingTime="212.053295ms" totalInitContainerRuntime="1m4.644701944s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:43.635328812 +0000 UTC m=+948.574090820" watchObservedRunningTime="2026-06-12 18:46:43.640294368 +0000 UTC m=+948.579056363" Jun 12 18:46:47.424219 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:47.424178 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:46:47.424673 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:47.424279 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:46:47.436662 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:47.436638 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:46:47.642984 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:46:47.642954 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj" Jun 12 18:48:37.176555 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:48:37.176519 2564 generic.go:356] "Generic (PLEG): container finished" podID="f821489e-dbba-402a-a1e8-e65445cb2eff" containerID="a02e699ff162d26bcae9b23cedc4eed8a8ca82f701e330691528a6b6e735e2d8" exitCode=0 Jun 12 18:48:37.177132 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:48:37.176611 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" event={"ID":"f821489e-dbba-402a-a1e8-e65445cb2eff","Type":"ContainerDied","Data":"a02e699ff162d26bcae9b23cedc4eed8a8ca82f701e330691528a6b6e735e2d8"} Jun 12 18:48:37.177225 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:48:37.177210 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:48:38.183821 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:48:38.183789 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" event={"ID":"f821489e-dbba-402a-a1e8-e65445cb2eff","Type":"ContainerStarted","Data":"b2ae74e2b3d46bc9a306b9e42b55369577bba9ae30267377e3ba1cd1d5520472"} Jun 12 18:48:38.204083 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:48:38.204032 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" podStartSLOduration=2.384999069 podStartE2EDuration="2m38.204015095s" totalImagesPullingTime="188.459655ms" totalInitContainerRuntime="2m35.630556371s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:48:38.202080141 +0000 UTC m=+1063.140842136" watchObservedRunningTime="2026-06-12 18:48:38.204015095 +0000 UTC m=+1063.142777088" Jun 12 18:48:40.988423 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:48:40.988373 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:48:40.988949 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:48:40.988439 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:48:41.001469 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:48:41.001440 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:48:41.209067 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:48:41.209037 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-cl9mj" Jun 12 18:50:55.564431 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:50:55.564389 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:50:55.568404 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:50:55.568376 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:53:42.819518 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:42.819488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9_762c4559-31c6-4f23-9016-3cd0e9f5f062/storage-initializer/0.log" Jun 12 18:53:43.828979 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:43.828944 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58684747d7-qss6m_7d226f0d-c67e-46ed-bfbd-f56c438226a9/authorino/0.log" Jun 12 18:53:48.369624 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:48.369593 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-84db6bf484-tzwlj_711e6619-8f92-4181-86da-55d0ade6404a/nginx/0.log" Jun 12 18:53:48.477070 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:48.477035 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-m6dhf_14318ef0-d91f-436e-bd20-11e88ea5be6e/manager/0.log" Jun 12 18:53:48.601482 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:48.601450 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-66bsh_c5383c8c-c2bc-4c04-b87f-9da56a035372/manager/0.log" Jun 12 18:53:48.722317 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:48.722263 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-54cf544994-qbzbl_99c5ca4b-b63e-4f31-ac01-53b9874a2e8d/maas-api/0.log" Jun 12 18:53:48.962153 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:48.962115 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56bd9c798f-kjtjf_fc4610a5-79ad-47a9-be3b-58dbff94089b/manager/0.log" Jun 12 18:53:49.064835 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:49.064750 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-cthxv_278c6f74-28d9-4904-ab46-84fe8e8bf066/server/0.log" Jun 12 18:53:49.182216 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:49.182188 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-tgjjp_5472a034-37e1-47f1-af86-467ba7860816/manager/0.log" Jun 12 18:53:49.290684 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:49.290657 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666df475c6-2lhqp_8883cd3d-8dd2-442d-9b63-c7d935b1e996/copy-manifests/0.log" Jun 12 18:53:49.308680 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:49.308654 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666df475c6-2lhqp_8883cd3d-8dd2-442d-9b63-c7d935b1e996/manager/0.log" Jun 12 18:53:50.910923 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:50.910889 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58684747d7-qss6m_7d226f0d-c67e-46ed-bfbd-f56c438226a9/authorino/0.log" Jun 12 18:53:51.699742 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:51.699708 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6w9n4_d6960ab3-48fb-4ed9-8767-9ff53c596db6/manager/0.log" Jun 12 18:53:52.162599 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:52.162530 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-lfqh8_d5c330b5-cc1f-4fcf-ab54-b55067cb3462/discovery/0.log" Jun 12 18:53:52.379211 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:52.379178 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75986b966d-w88b4_81b7d87e-7a95-40f8-b41c-358f7968f0ef/kube-auth-proxy/0.log" Jun 12 18:53:52.610692 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:52.610559 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-pv87d_c3945cd8-4ae8-4392-81f9-9920e0f6702b/payload-pre-processing/0.log" Jun 12 18:53:52.716851 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:52.716813 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-b4s45_536af7b9-5128-4a42-8c15-7079a66fe5b8/payload-processing/0.log" Jun 12 18:53:53.165427 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:53.165394 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q_27dd90e2-a05b-41ee-8202-09a00f1de088/storage-initializer/0.log" Jun 12 18:53:53.173259 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:53.173234 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-cjb5q_27dd90e2-a05b-41ee-8202-09a00f1de088/main/0.log" Jun 12 18:53:53.400342 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:53.400310 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj_471affbd-64c2-44d6-9bc2-cee7f17793d6/storage-initializer/0.log" Jun 12 18:53:53.407491 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:53.407455 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-br2sj_471affbd-64c2-44d6-9bc2-cee7f17793d6/main/0.log" Jun 12 18:53:53.522291 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:53.522203 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cgtfr9_762c4559-31c6-4f23-9016-3cd0e9f5f062/storage-initializer/0.log" Jun 12 18:53:53.639371 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:53.639339 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-67rv2_3808419a-1f57-45db-b8b5-8420e79a88b8/storage-initializer/0.log" Jun 12 18:53:53.649711 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:53.649630 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-67rv2_3808419a-1f57-45db-b8b5-8420e79a88b8/main/0.log" Jun 12 18:53:53.761926 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:53.761894 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-cl9mj_f821489e-dbba-402a-a1e8-e65445cb2eff/storage-initializer/0.log" Jun 12 18:53:53.770007 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:53:53.769971 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-cl9mj_f821489e-dbba-402a-a1e8-e65445cb2eff/main/0.log" Jun 12 18:54:00.616347 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:00.616311 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4dmzd_f025ae2f-0c71-4565-b247-20a5a36792a3/global-pull-secret-syncer/0.log" Jun 12 18:54:00.784442 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:00.784410 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c8mch_be86e7eb-c135-4ef6-aedb-847f63fc4d9f/konnectivity-agent/0.log" Jun 12 18:54:00.882756 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:00.882674 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-164.ec2.internal_45cf0217c278b01860a43fa25a90b85c/haproxy/0.log" Jun 12 18:54:03.704732 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:03.704698 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-fc8zx_f4812fda-d329-4935-83f6-6430a26cfd6f/sail-operator/0.log" Jun 12 18:54:05.987118 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:05.987089 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58684747d7-qss6m_7d226f0d-c67e-46ed-bfbd-f56c438226a9/authorino/0.log" Jun 12 18:54:06.250774 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:06.250682 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6w9n4_d6960ab3-48fb-4ed9-8767-9ff53c596db6/manager/0.log" Jun 12 18:54:08.153719 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.153689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d9w9r_23a2e901-422e-4af4-bd8a-5812d444e617/node-exporter/0.log" Jun 12 18:54:08.177489 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.177456 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d9w9r_23a2e901-422e-4af4-bd8a-5812d444e617/kube-rbac-proxy/0.log" Jun 12 18:54:08.204533 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.204498 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d9w9r_23a2e901-422e-4af4-bd8a-5812d444e617/init-textfile/0.log" Jun 12 18:54:08.654428 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.654398 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-94twc_ae2c5c17-0de2-461a-87ba-2b94877fba7d/prometheus-operator/0.log" Jun 12 18:54:08.671177 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.671153 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-94twc_ae2c5c17-0de2-461a-87ba-2b94877fba7d/kube-rbac-proxy/0.log" Jun 12 18:54:08.821849 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.821809 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b99fd6554-64f44_1ce97233-3964-4805-8c5c-843bb790d1f2/thanos-query/0.log" Jun 12 18:54:08.844906 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.844876 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b99fd6554-64f44_1ce97233-3964-4805-8c5c-843bb790d1f2/kube-rbac-proxy-web/0.log" Jun 12 18:54:08.866080 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.866055 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b99fd6554-64f44_1ce97233-3964-4805-8c5c-843bb790d1f2/kube-rbac-proxy/0.log" Jun 12 18:54:08.888814 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.888794 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b99fd6554-64f44_1ce97233-3964-4805-8c5c-843bb790d1f2/prom-label-proxy/0.log" Jun 12 18:54:08.908609 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.908532 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b99fd6554-64f44_1ce97233-3964-4805-8c5c-843bb790d1f2/kube-rbac-proxy-rules/0.log" Jun 12 18:54:08.934622 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:08.934600 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b99fd6554-64f44_1ce97233-3964-4805-8c5c-843bb790d1f2/kube-rbac-proxy-metrics/0.log" Jun 12 18:54:11.487147 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.487106 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv"] Jun 12 18:54:11.491382 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.491358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.493824 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.493793 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-svkd8\"/\"kube-root-ca.crt\"" Jun 12 18:54:11.493938 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.493888 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-svkd8\"/\"openshift-service-ca.crt\"" Jun 12 18:54:11.494793 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.494777 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-svkd8\"/\"default-dockercfg-98mkc\"" Jun 12 18:54:11.505604 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.505566 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv"] Jun 12 18:54:11.573016 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.572980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-proc\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.573214 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.573036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-sys\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.573214 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.573058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-lib-modules\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.573214 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.573199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-podres\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.573387 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.573252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87tqt\" (UniqueName: \"kubernetes.io/projected/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-kube-api-access-87tqt\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.674344 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.674306 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-proc\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.674540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.674364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-sys\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.674540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.674383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-lib-modules\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.674540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.674424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-podres\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.674540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.674433 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-proc\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.674540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.674450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87tqt\" (UniqueName: \"kubernetes.io/projected/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-kube-api-access-87tqt\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.674540 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.674449 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-sys\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.674809 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.674551 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-podres\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.674809 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.674563 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-lib-modules\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.682459 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.682434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87tqt\" (UniqueName: \"kubernetes.io/projected/d61385c0-44c5-4cc9-ac5f-da200c2cae9f-kube-api-access-87tqt\") pod \"perf-node-gather-daemonset-28hmv\" (UID: \"d61385c0-44c5-4cc9-ac5f-da200c2cae9f\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.803071 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.802992 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:11.938808 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:11.938736 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv"] Jun 12 18:54:11.942939 ip-10-0-143-164 kubenswrapper[2564]: W0612 18:54:11.942912 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd61385c0_44c5_4cc9_ac5f_da200c2cae9f.slice/crio-f0c0e693892457df3e0dbb2185f5e342050060db5defb55426d0cbc44b12d20b WatchSource:0}: Error finding container f0c0e693892457df3e0dbb2185f5e342050060db5defb55426d0cbc44b12d20b: Status 404 returned error can't find the container with id f0c0e693892457df3e0dbb2185f5e342050060db5defb55426d0cbc44b12d20b Jun 12 18:54:12.844256 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:12.844224 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" event={"ID":"d61385c0-44c5-4cc9-ac5f-da200c2cae9f","Type":"ContainerStarted","Data":"489b06a6d8740b48497595a3cade15ee1ebfe801efb8f04c81dfb167fee67dad"} Jun 12 18:54:12.844664 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:12.844277 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" event={"ID":"d61385c0-44c5-4cc9-ac5f-da200c2cae9f","Type":"ContainerStarted","Data":"f0c0e693892457df3e0dbb2185f5e342050060db5defb55426d0cbc44b12d20b"} Jun 12 18:54:12.844664 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:12.844313 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:12.860969 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:12.860919 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" podStartSLOduration=1.86090445 podStartE2EDuration="1.86090445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:54:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:54:12.858400666 +0000 UTC m=+1397.797162662" watchObservedRunningTime="2026-06-12 18:54:12.86090445 +0000 UTC m=+1397.799666445" Jun 12 18:54:13.293359 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:13.293331 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mt57m_f28ec3a4-90e7-45b1-b508-6bb325f89d5a/dns/0.log" Jun 12 18:54:13.313278 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:13.313259 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mt57m_f28ec3a4-90e7-45b1-b508-6bb325f89d5a/kube-rbac-proxy/0.log" Jun 12 18:54:13.450072 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:13.450044 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jdlf6_a2599d11-5c45-411f-af19-4f166bb99e11/dns-node-resolver/0.log" Jun 12 18:54:14.094204 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:14.094170 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sbjhs_81765229-3f4f-40a1-9f61-ce6b693176b3/node-ca/0.log" Jun 12 18:54:15.095983 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:15.095947 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-lfqh8_d5c330b5-cc1f-4fcf-ab54-b55067cb3462/discovery/0.log" Jun 12 18:54:15.139023 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:15.138989 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75986b966d-w88b4_81b7d87e-7a95-40f8-b41c-358f7968f0ef/kube-auth-proxy/0.log" Jun 12 18:54:15.185729 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:15.185700 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-pv87d_c3945cd8-4ae8-4392-81f9-9920e0f6702b/payload-pre-processing/0.log" Jun 12 18:54:15.210362 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:15.210335 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-b4s45_536af7b9-5128-4a42-8c15-7079a66fe5b8/payload-processing/0.log" Jun 12 18:54:15.886431 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:15.886399 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r89pk_e7a5185a-b74c-48c6-94bc-753720b3f316/serve-healthcheck-canary/0.log" Jun 12 18:54:16.498417 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:16.498388 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kw7b5_3fb8581b-3c09-4d63-b32a-a02bce513351/kube-rbac-proxy/0.log" Jun 12 18:54:16.519041 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:16.519014 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kw7b5_3fb8581b-3c09-4d63-b32a-a02bce513351/exporter/0.log" Jun 12 18:54:16.539278 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:16.539252 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kw7b5_3fb8581b-3c09-4d63-b32a-a02bce513351/extractor/0.log" Jun 12 18:54:18.809494 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:18.809464 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-84db6bf484-tzwlj_711e6619-8f92-4181-86da-55d0ade6404a/nginx/0.log" Jun 12 18:54:18.841088 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:18.841063 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-m6dhf_14318ef0-d91f-436e-bd20-11e88ea5be6e/manager/0.log" Jun 12 18:54:18.859657 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:18.859636 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-28hmv" Jun 12 18:54:18.884443 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:18.884415 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-66bsh_c5383c8c-c2bc-4c04-b87f-9da56a035372/manager/0.log" Jun 12 18:54:18.909745 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:18.909716 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-54cf544994-qbzbl_99c5ca4b-b63e-4f31-ac01-53b9874a2e8d/maas-api/0.log" Jun 12 18:54:18.964161 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:18.964134 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56bd9c798f-kjtjf_fc4610a5-79ad-47a9-be3b-58dbff94089b/manager/0.log" Jun 12 18:54:18.982161 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:18.982139 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-cthxv_278c6f74-28d9-4904-ab46-84fe8e8bf066/server/0.log" Jun 12 18:54:19.046895 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:19.046868 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-tgjjp_5472a034-37e1-47f1-af86-467ba7860816/manager/0.log" Jun 12 18:54:19.116024 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:19.115941 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666df475c6-2lhqp_8883cd3d-8dd2-442d-9b63-c7d935b1e996/manager/0.log" Jun 12 18:54:19.131335 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:19.131314 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666df475c6-2lhqp_8883cd3d-8dd2-442d-9b63-c7d935b1e996/copy-manifests/0.log" Jun 12 18:54:20.778692 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:20.778655 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lghgv_5df8465e-64bf-4838-ab01-b413b0705973/openshift-lws-operator/0.log" Jun 12 18:54:25.982897 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:25.982837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-lfqh8_d5c330b5-cc1f-4fcf-ab54-b55067cb3462/discovery/0.log" Jun 12 18:54:26.018515 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:26.018468 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75986b966d-w88b4_81b7d87e-7a95-40f8-b41c-358f7968f0ef/kube-auth-proxy/0.log" Jun 12 18:54:26.053778 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:26.053751 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-pv87d_c3945cd8-4ae8-4392-81f9-9920e0f6702b/payload-pre-processing/0.log" Jun 12 18:54:26.068569 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:26.068540 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-b4s45_536af7b9-5128-4a42-8c15-7079a66fe5b8/payload-processing/0.log" Jun 12 18:54:26.279458 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:26.279378 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-vc92s_3bc3f6e3-f4f3-4531-84f3-7708c96786c9/migrator/0.log" Jun 12 18:54:26.300696 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:26.300671 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-vc92s_3bc3f6e3-f4f3-4531-84f3-7708c96786c9/graceful-termination/0.log" Jun 12 18:54:27.282559 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:27.282525 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-lfqh8_d5c330b5-cc1f-4fcf-ab54-b55067cb3462/discovery/0.log" Jun 12 18:54:27.309914 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:27.309884 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75986b966d-w88b4_81b7d87e-7a95-40f8-b41c-358f7968f0ef/kube-auth-proxy/0.log" Jun 12 18:54:27.346201 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:27.346170 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-pv87d_c3945cd8-4ae8-4392-81f9-9920e0f6702b/payload-pre-processing/0.log" Jun 12 18:54:27.361809 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:27.361775 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-b4s45_536af7b9-5128-4a42-8c15-7079a66fe5b8/payload-processing/0.log" Jun 12 18:54:28.446275 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:28.446251 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qx8rj_86fa01de-334d-439a-ac57-9897fbc27322/kube-multus-additional-cni-plugins/0.log" Jun 12 18:54:28.469162 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:28.469136 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qx8rj_86fa01de-334d-439a-ac57-9897fbc27322/egress-router-binary-copy/0.log" Jun 12 18:54:28.495117 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:28.495096 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qx8rj_86fa01de-334d-439a-ac57-9897fbc27322/cni-plugins/0.log" Jun 12 18:54:28.536159 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:28.536118 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qx8rj_86fa01de-334d-439a-ac57-9897fbc27322/bond-cni-plugin/0.log" Jun 12 18:54:28.557406 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:28.557379 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qx8rj_86fa01de-334d-439a-ac57-9897fbc27322/routeoverride-cni/0.log" Jun 12 18:54:28.579312 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:28.579286 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qx8rj_86fa01de-334d-439a-ac57-9897fbc27322/whereabouts-cni-bincopy/0.log" Jun 12 18:54:28.600075 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:28.600050 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qx8rj_86fa01de-334d-439a-ac57-9897fbc27322/whereabouts-cni/0.log" Jun 12 18:54:28.704982 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:28.704949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pwvdx_8586e9b3-11cd-4bf3-950e-6b512230a52e/kube-multus/0.log" Jun 12 18:54:28.875385 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:28.875356 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zxk4r_d08d72a8-3550-4fe7-9823-7382ef593bc2/network-metrics-daemon/0.log" Jun 12 18:54:28.892885 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:28.892858 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zxk4r_d08d72a8-3550-4fe7-9823-7382ef593bc2/kube-rbac-proxy/0.log" Jun 12 18:54:29.027505 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:29.027417 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-lfqh8_d5c330b5-cc1f-4fcf-ab54-b55067cb3462/discovery/0.log" Jun 12 18:54:29.053564 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:29.053533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75986b966d-w88b4_81b7d87e-7a95-40f8-b41c-358f7968f0ef/kube-auth-proxy/0.log" Jun 12 18:54:29.081172 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:29.081139 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-pv87d_c3945cd8-4ae8-4392-81f9-9920e0f6702b/payload-pre-processing/0.log" Jun 12 18:54:29.093904 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:29.093877 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-b4s45_536af7b9-5128-4a42-8c15-7079a66fe5b8/payload-processing/0.log" Jun 12 18:54:30.102085 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:30.102050 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-controller/0.log" Jun 12 18:54:30.117509 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:30.117479 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/1.log" Jun 12 18:54:30.117673 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:30.117522 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovn-acl-logging/0.log" Jun 12 18:54:30.137849 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:30.137820 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/kube-rbac-proxy-node/0.log" Jun 12 18:54:30.158384 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:30.158360 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/kube-rbac-proxy-ovn-metrics/0.log" Jun 12 18:54:30.181969 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:30.181943 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/northd/0.log" Jun 12 18:54:30.202663 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:30.202644 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/nbdb/0.log" Jun 12 18:54:30.223638 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:30.223619 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/sbdb/0.log" Jun 12 18:54:30.280235 ip-10-0-143-164 kubenswrapper[2564]: I0612 18:54:30.280206 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j48wj_1f7b8255-8a37-4357-9a7c-4fc2aa60f626/ovnkube-controller/0.log"