Jun 11 16:44:25.479998 ip-10-0-143-112 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:44:25.933391 ip-10-0-143-112 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:44:25.933391 ip-10-0-143-112 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:44:25.933391 ip-10-0-143-112 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:44:25.933391 ip-10-0-143-112 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:44:25.933391 ip-10-0-143-112 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:44:25.935545 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.935458 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:44:25.944613 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944583 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:25.944613 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944605 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:25.944613 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944609 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:25.944613 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944613 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:25.944613 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944615 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:25.944613 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944619 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:25.944613 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944622 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:25.944613 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944625 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944628 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944632 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944635 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944639 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944642 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944644 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944647 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944650 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944653 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944655 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944658 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944661 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944663 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944666 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944669 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944673 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944678 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944680 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:25.944921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944683 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944686 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944688 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944691 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944693 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944696 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944701 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944705 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944708 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944711 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944728 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944731 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944734 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944737 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944740 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944744 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944747 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944751 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944754 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:25.945387 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944757 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944760 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944763 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944765 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944768 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944771 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944773 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944775 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944778 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944781 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944783 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944786 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944789 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944793 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944796 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944798 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944801 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944804 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944807 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:25.945871 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944809 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944812 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944815 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944817 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944820 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944822 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944825 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944827 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944830 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944834 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944836 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944839 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944842 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944845 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944848 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944851 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944854 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944857 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944860 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944863 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:25.946335 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944866 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944868 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944871 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944873 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944876 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944879 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944881 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944884 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944887 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944891 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944894 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944897 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944900 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944903 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.944906 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945626 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945633 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945637 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945639 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945642 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:25.946842 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945645 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945648 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945651 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945654 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945656 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945660 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945664 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945667 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945670 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945673 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945675 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945678 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945681 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945684 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945687 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945690 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945692 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945695 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945698 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:25.947321 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945701 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945703 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945706 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945708 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945711 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945728 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945730 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945733 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945736 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945738 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945741 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945744 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945747 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945749 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945753 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945756 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945759 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945761 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945764 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945766 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:25.947821 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945769 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945771 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945774 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945776 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945779 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945781 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945784 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945787 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945790 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945793 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945796 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945799 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945802 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945804 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945807 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945810 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945812 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945815 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945817 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945820 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:25.948385 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945822 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945825 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945827 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945830 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945832 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945835 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945838 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945843 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945846 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945850 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945853 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945857 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945860 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945863 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945866 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945869 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945871 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945874 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945877 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:25.948895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945880 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945885 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945888 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945891 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945895 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945898 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945901 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945904 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945907 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945910 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945912 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945915 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945917 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945920 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945923 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.945925 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946315 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946320 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946324 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:25.949365 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946328 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946331 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946334 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946337 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946339 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946343 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946345 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946348 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946351 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946354 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946357 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946359 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946362 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946365 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946367 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946370 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946374 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946378 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946381 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946384 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:25.949862 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946387 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946389 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946392 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946395 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946398 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946401 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946404 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946407 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946409 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946412 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946415 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946417 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946420 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946423 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946425 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946428 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946430 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946433 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946435 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:25.950357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946438 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946451 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946453 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946456 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946459 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946461 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946481 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946488 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946491 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946494 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946497 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946500 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946503 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946506 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946508 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946511 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946514 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946517 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946519 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:25.950828 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946522 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946525 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946527 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946530 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946533 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946535 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946539 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946543 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946546 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946549 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946552 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946556 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946558 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946561 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946564 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946569 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946572 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946575 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946577 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946580 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:25.951353 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946583 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946586 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946589 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946592 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946594 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946597 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946600 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946602 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946605 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946608 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946611 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946614 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946617 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946620 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946623 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946625 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946628 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.946630 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946693 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946700 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946707 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:44:25.951855 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946711 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946726 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946730 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946735 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946739 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946743 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946746 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946750 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946753 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946756 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946759 2558 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946762 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946765 2558 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946769 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946772 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946776 2558 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946779 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946782 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946785 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946789 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946792 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946796 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946799 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:44:25.952379 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946802 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946809 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946812 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946815 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946818 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946821 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946827 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946830 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946833 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946836 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946839 2558 flags.go:64] FLAG: --enable-server="true" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946842 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946846 2558 flags.go:64] FLAG: --event-burst="100" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946850 2558 flags.go:64] FLAG: --event-qps="50" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946853 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946856 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946859 2558 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946863 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946866 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946869 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946872 2558 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946875 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946877 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946881 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946884 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:44:25.952935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946888 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946890 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946893 2558 flags.go:64] FLAG: --feature-gates="" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946897 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946900 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946903 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946906 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946909 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946913 2558 flags.go:64] FLAG: --help="false" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946916 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-143-112.ec2.internal" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946919 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946922 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946925 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946930 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946934 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946937 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946939 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946942 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946945 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946948 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946951 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946954 2558 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946957 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946960 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:44:25.953569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946963 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946966 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946969 2558 flags.go:64] FLAG: --lock-file="" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946972 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946975 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946978 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946983 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946986 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946989 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946992 2558 flags.go:64] FLAG: --logging-format="text" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946995 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.946998 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947001 2558 flags.go:64] FLAG: --manifest-url="" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947004 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947008 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947011 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947016 2558 flags.go:64] FLAG: --max-pods="110" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947019 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947022 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947025 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947028 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947032 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947035 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947039 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947045 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:44:25.954182 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947048 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947051 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947054 2558 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947057 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947063 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947066 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947069 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947072 2558 flags.go:64] FLAG: --port="10250" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947075 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947078 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a6846e55b26779f2" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947081 2558 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947084 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947087 2558 flags.go:64] FLAG: --register-node="true" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947090 2558 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947099 2558 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947102 2558 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947105 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947108 2558 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947112 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947115 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947117 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947120 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947123 2558 flags.go:64] FLAG: --runonce="false" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947126 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947130 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:44:25.954844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947133 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947136 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947139 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947143 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947146 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947149 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947152 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947155 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947158 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947161 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947164 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947167 2558 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947170 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947175 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947178 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947181 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947185 2558 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947188 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947191 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947193 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947196 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947199 2558 flags.go:64] FLAG: --v="2" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947203 2558 flags.go:64] FLAG: --version="false" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947210 2558 flags.go:64] FLAG: --vmodule="" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947214 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:44:25.955488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.947217 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947331 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947335 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947338 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947341 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947344 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947348 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947350 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947353 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947356 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947359 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947362 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947365 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947367 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947370 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947372 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947375 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947378 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947380 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947383 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:25.956106 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947385 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947388 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947390 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947393 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947395 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947398 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947400 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947403 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947406 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947408 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947411 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947414 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947417 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947419 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947422 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947425 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947427 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947430 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947434 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947437 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:25.956651 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947439 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947442 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947446 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947449 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947451 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947454 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947458 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947462 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947465 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947467 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947470 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947473 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947475 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947478 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947480 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947483 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947485 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947489 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947491 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:25.957201 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947494 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947496 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947499 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947503 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947506 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947510 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947512 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947515 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947518 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947521 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947523 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947527 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947530 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947533 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947535 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947539 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947542 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947544 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947547 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:25.957686 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947550 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947552 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947555 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947557 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947560 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947563 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947565 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947568 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947570 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947574 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947577 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947580 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947583 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947585 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947588 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947591 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947593 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947596 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947599 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:25.958176 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947602 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947604 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.947607 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.948550 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.955777 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.955795 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.956750 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.956760 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956826 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956832 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956835 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956838 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956841 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956844 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:25.958628 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956847 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956849 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956852 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956855 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956858 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956860 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956863 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956865 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956868 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956871 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956873 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956876 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956878 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956881 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956884 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956886 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956889 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956891 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956896 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956899 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:25.958993 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956901 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956904 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956907 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956911 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956914 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956916 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956919 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956922 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956925 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956929 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956933 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956937 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956941 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956944 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956947 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956950 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956953 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956956 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956959 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:25.959470 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956961 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956964 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956968 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956971 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956974 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956977 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956980 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956983 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956986 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956988 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956991 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956993 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956996 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.956999 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957002 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957005 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957008 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957011 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957014 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:25.959947 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957017 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957019 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957022 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957024 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957027 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957030 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957033 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957035 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957038 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957040 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957043 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957046 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957048 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957051 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957054 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957056 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957059 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957061 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957064 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957066 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:25.960476 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957069 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957071 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957074 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957077 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957079 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957082 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957085 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957087 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957090 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957093 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957096 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957098 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957101 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957103 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957106 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:25.960990 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.957111 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957224 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957228 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957232 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957235 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957238 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957241 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957244 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957246 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957249 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957252 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957256 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957259 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957261 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957264 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957267 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957269 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957272 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957274 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:44:25.961375 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957277 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957280 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957282 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957285 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957287 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957291 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957293 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957297 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957299 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957302 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957305 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957307 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957310 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957313 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957317 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957320 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957323 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957326 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957338 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957341 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:44:25.961866 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957343 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957346 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957348 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957352 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957354 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957357 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957359 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957362 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957365 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957367 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957369 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957372 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957375 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957378 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957381 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957383 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957385 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957388 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957391 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957394 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:44:25.962479 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957397 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957400 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957403 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957405 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957408 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957411 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957413 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957416 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957419 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957422 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957424 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957427 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957429 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957432 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957434 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957437 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957439 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957442 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957444 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957447 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:44:25.962996 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957450 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957452 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957454 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957457 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957460 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957462 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957465 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957467 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957470 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957473 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957476 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957479 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957481 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957484 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957487 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957489 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957492 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957494 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957497 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:44:25.963763 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957499 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:44:25.964398 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:25.957503 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:44:25.964398 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.957508 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:44:25.964398 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.957620 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:44:25.964398 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.960162 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:44:25.964398 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.961882 2558 server.go:1019] "Starting client certificate rotation" Jun 11 16:44:25.964398 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.962001 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:44:25.964398 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.962054 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:44:25.964675 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.964661 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:44:25.968913 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.968895 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:44:25.980563 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.980540 2558 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:44:25.983519 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.983503 2558 log.go:25] "Validated CRI v1 image API" Jun 11 16:44:25.985635 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.985619 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:44:25.988143 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.988123 2558 fs.go:135] Filesystem UUIDs: map[129446ae-e3b4-4adc-bf2a-a8e8d5620664:/dev/nvme0n1p3 56cff9aa-65de-4253-9160-334c39ff1c43:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 11 16:44:25.988216 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.988140 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:44:25.992026 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.992008 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:44:25.994141 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.994030 2558 manager.go:216] Machine: {Timestamp:2026-06-11 16:44:25.991772775 +0000 UTC m=+0.373331301 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099018 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e963bfcbdf973f250b87b82592c5 SystemUUID:ec25e963-bfcb-df97-3f25-0b87b82592c5 BootID:66db17c0-dea1-4eba-8911-078f03ec62ef Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:f9:0b:91:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:f9:0b:91:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:d9:31:55:e9:c1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:44:25.994141 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.994137 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:44:25.994254 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.994221 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:44:25.997788 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.997764 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:44:25.997960 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.997791 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-112.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:44:25.998654 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.998642 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:44:25.998705 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.998659 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:44:25.998705 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.998669 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:44:25.998705 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.998690 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:44:25.999997 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:25.999985 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:44:26.004538 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.004524 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:44:26.004859 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.004846 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:44:26.004935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.004899 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:44:26.004935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.004919 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:44:26.005025 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.004940 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:44:26.005025 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.004954 2558 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:44:26.005025 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.004967 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:44:26.005608 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.005594 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:44:26.005680 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.005618 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:44:26.008904 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.008887 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:44:26.010620 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.010606 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:44:26.010674 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.010636 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:44:26.012038 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012027 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:44:26.012076 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012043 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:44:26.012076 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012049 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:44:26.012076 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012055 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:44:26.012076 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012064 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:44:26.012076 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012069 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:44:26.012076 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012078 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:44:26.012229 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012084 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:44:26.012229 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012091 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:44:26.012229 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012097 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:44:26.012229 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012111 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:44:26.012229 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.012117 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:44:26.013051 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.013038 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:44:26.013051 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.013051 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:44:26.015732 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.015694 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-112.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:44:26.015834 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.015748 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-112.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:44:26.015834 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.015748 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:44:26.016903 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.016888 2558 server.go:1268] "Started kubelet" Jun 11 16:44:26.017000 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.016974 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:44:26.017148 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.017097 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:44:26.017255 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.017166 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:44:26.017990 ip-10-0-143-112 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:44:26.018631 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.018607 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qzblx" Jun 11 16:44:26.019138 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.019125 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:44:26.019232 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.019220 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:44:26.025100 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.025078 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:44:26.026689 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.026672 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qzblx" Jun 11 16:44:26.028235 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.028215 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:44:26.028333 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.028239 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:44:26.028391 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.028359 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 11 16:44:26.028797 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.027145 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-112.ec2.internal.18b81491172fea7d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-112.ec2.internal,UID:ip-10-0-143-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-112.ec2.internal,},FirstTimestamp:2026-06-11 16:44:26.016860797 +0000 UTC m=+0.398419334,LastTimestamp:2026-06-11 16:44:26.016860797 +0000 UTC m=+0.398419334,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-112.ec2.internal,}" Jun 11 16:44:26.029060 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029041 2558 factory.go:55] Registering systemd factory Jun 11 16:44:26.029130 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029064 2558 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:44:26.029300 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029218 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:44:26.029300 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029246 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:44:26.029300 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029263 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:44:26.029540 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029349 2558 factory.go:153] Registering CRI-O factory Jun 11 16:44:26.029540 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029366 2558 factory.go:223] Registration of the crio container factory successfully Jun 11 16:44:26.029540 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029413 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:44:26.029540 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029423 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:44:26.029540 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029414 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:44:26.029540 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029456 2558 factory.go:103] Registering Raw factory Jun 11 16:44:26.029540 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029472 2558 manager.go:1196] Started watching for new ooms in manager Jun 11 16:44:26.029923 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.029910 2558 manager.go:349] Starting recovery of all containers Jun 11 16:44:26.035799 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.035644 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:44:26.038270 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.038246 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:26.039924 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.039904 2558 manager.go:354] Recovery completed Jun 11 16:44:26.041394 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.041374 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-112.ec2.internal\" not found" node="ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.041523 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.041501 2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 11 16:44:26.044423 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.044411 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:26.046364 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.046346 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:26.046427 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.046376 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:26.046427 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.046390 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:26.046885 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.046868 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:26.046960 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.046870 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:44:26.046960 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.046937 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:44:26.046960 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.046959 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:44:26.047595 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.047581 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:26.047650 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.047606 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:26.047650 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.047620 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:26.049149 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.049137 2558 policy_none.go:49] "None policy: Start" Jun 11 16:44:26.049186 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.049153 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:44:26.049186 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.049163 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:44:26.050881 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.050870 2558 policy_none.go:47] "Start" Jun 11 16:44:26.092409 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.092391 2558 manager.go:337] "Starting Device Plugin manager" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.092437 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.092451 2558 server.go:87] "Starting device plugin registration server" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.092680 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.092694 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.092828 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.092912 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.092922 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.093480 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.093528 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-112.ec2.internal\" not found" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.108384 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.108418 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.108436 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.108464 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:44:26.117779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.110561 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:26.193771 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.193676 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:26.194867 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.194850 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:26.194954 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.194888 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:26.194954 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.194903 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:26.194954 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.194926 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.205664 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.205644 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.205737 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.205668 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-112.ec2.internal\": node \"ip-10-0-143-112.ec2.internal\" not found" Jun 11 16:44:26.208569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.208551 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal"] Jun 11 16:44:26.208628 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.208613 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:26.209359 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.209341 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:26.209427 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.209373 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:26.209427 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.209389 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:26.211970 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.211958 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:26.212132 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.212119 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.212169 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.212146 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:26.212631 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.212613 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:26.212740 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.212639 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:26.212740 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.212649 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:26.212740 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.212614 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:26.212740 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.212732 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:26.212937 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.212756 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:26.215022 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.215009 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.215092 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.215035 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:44:26.215640 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.215624 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:44:26.215748 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.215654 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:44:26.215748 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.215668 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:44:26.221542 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.221523 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 11 16:44:26.228264 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.228246 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-112.ec2.internal\" not found" node="ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.232743 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.232711 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-112.ec2.internal\" not found" node="ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.322632 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.322606 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 11 16:44:26.330600 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.330582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e289c5a5bd5b8f639323fb6b704d3f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"5e289c5a5bd5b8f639323fb6b704d3f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.330689 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.330608 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e289c5a5bd5b8f639323fb6b704d3f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"5e289c5a5bd5b8f639323fb6b704d3f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.330689 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.330625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9cf0603ecf25c26ddaba857696c5a239-config\") pod \"kube-apiserver-proxy-ip-10-0-143-112.ec2.internal\" (UID: \"9cf0603ecf25c26ddaba857696c5a239\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.422996 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.422959 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 11 16:44:26.431314 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.431291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e289c5a5bd5b8f639323fb6b704d3f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"5e289c5a5bd5b8f639323fb6b704d3f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.431361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.431323 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e289c5a5bd5b8f639323fb6b704d3f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"5e289c5a5bd5b8f639323fb6b704d3f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.431361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.431341 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9cf0603ecf25c26ddaba857696c5a239-config\") pod \"kube-apiserver-proxy-ip-10-0-143-112.ec2.internal\" (UID: \"9cf0603ecf25c26ddaba857696c5a239\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.431434 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.431391 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e289c5a5bd5b8f639323fb6b704d3f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"5e289c5a5bd5b8f639323fb6b704d3f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.431434 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.431391 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9cf0603ecf25c26ddaba857696c5a239-config\") pod \"kube-apiserver-proxy-ip-10-0-143-112.ec2.internal\" (UID: \"9cf0603ecf25c26ddaba857696c5a239\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.431434 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.431411 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e289c5a5bd5b8f639323fb6b704d3f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"5e289c5a5bd5b8f639323fb6b704d3f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.523832 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.523770 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 11 16:44:26.535249 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.535222 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.539922 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.539707 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.624331 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.624299 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 11 16:44:26.724802 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.724775 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 11 16:44:26.825399 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:26.825316 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 11 16:44:26.864975 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.864946 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:26.928780 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.928753 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.938690 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.938672 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:44:26.940368 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.940355 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 11 16:44:26.951410 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.951393 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:44:26.960489 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.960471 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:44:26.960613 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.960593 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:44:26.960673 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.960606 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:44:26.960673 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:26.960595 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:44:27.005826 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.005796 2558 apiserver.go:52] "Watching apiserver" Jun 11 16:44:27.026790 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.026765 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:44:27.028277 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.028247 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal","openshift-multus/multus-additional-cni-plugins-7r5rc","openshift-multus/network-metrics-daemon-2hn9p","openshift-network-operator/iptables-alerter-b7q6n","kube-system/global-pull-secret-syncer-7b27n","kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872","openshift-dns/node-resolver-9p8bj","openshift-multus/multus-5d6sw","openshift-network-diagnostics/network-check-target-2hkm9","openshift-ovn-kubernetes/ovnkube-node-4799k","kube-system/konnectivity-agent-l4z5b","openshift-cluster-node-tuning-operator/tuned-ftn7m","openshift-image-registry/node-ca-fgzxb"] Jun 11 16:44:27.028700 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.028674 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:44:27.030729 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.030696 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:39:26 +0000 UTC" deadline="2028-01-02 15:03:01.586253817 +0000 UTC" Jun 11 16:44:27.030804 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.030733 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13678h18m34.555523566s" Jun 11 16:44:27.030858 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.030844 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.033009 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.032989 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:27.033109 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.033062 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:27.033554 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.033526 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:44:27.033645 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.033576 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:44:27.033739 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.033708 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:44:27.033804 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.033790 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:44:27.033858 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.033837 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:44:27.034077 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.034060 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-system-cni-dir\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.034128 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.034089 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-os-release\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.034128 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.034110 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.034198 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.034126 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.034198 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.034143 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.034198 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.034192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-cnibin\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.034296 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.034231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.034296 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.034263 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjknr\" (UniqueName: \"kubernetes.io/projected/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-kube-api-access-mjknr\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.034524 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.034510 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9f2wc\"" Jun 11 16:44:27.036087 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.036058 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.038794 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.038626 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:44:27.039154 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.039130 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:44:27.039154 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.039141 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:44:27.039313 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.039176 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xvcpc\"" Jun 11 16:44:27.040042 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.040025 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:27.040124 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.040097 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:27.041846 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.041829 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:44:27.042115 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.042098 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.044095 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.044079 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.045547 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.045527 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:44:27.045639 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.045527 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-28fk9\"" Jun 11 16:44:27.045639 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.045528 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:44:27.045857 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.045843 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:44:27.046371 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.046143 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.046677 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.046664 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zgcff\"" Jun 11 16:44:27.046845 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.046767 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:44:27.046911 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.046894 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:44:27.048245 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.048229 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:44:27.048382 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.048340 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:27.048445 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.048405 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:27.048638 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.048622 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lqxbq\"" Jun 11 16:44:27.050465 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.050447 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.053099 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.053082 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:27.053191 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.053146 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:44:27.053251 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.053211 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:44:27.053303 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.053288 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:44:27.053487 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.053474 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:44:27.053535 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.053489 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6v5gc\"" Jun 11 16:44:27.054381 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.054366 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:44:27.054429 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.054383 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:44:27.055799 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.055781 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.057009 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.056996 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:44:27.057058 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.057009 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:44:27.057871 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.057856 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.058082 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.058027 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:44:27.058167 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.058136 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fv426\"" Jun 11 16:44:27.058346 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.058331 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:44:27.059190 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.059176 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xm2g9\"" Jun 11 16:44:27.060200 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.060185 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:44:27.060678 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.060659 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:44:27.060787 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.060659 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p9dhk\"" Jun 11 16:44:27.061689 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.061672 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:44:27.074533 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.074513 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-68s64" Jun 11 16:44:27.083338 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.083317 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-68s64" Jun 11 16:44:27.125092 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.125066 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e289c5a5bd5b8f639323fb6b704d3f3.slice/crio-0b98127f8134f433f291a1ccd0c0d0f2095fa93c816c8b0d58c051938da085da WatchSource:0}: Error finding container 0b98127f8134f433f291a1ccd0c0d0f2095fa93c816c8b0d58c051938da085da: Status 404 returned error can't find the container with id 0b98127f8134f433f291a1ccd0c0d0f2095fa93c816c8b0d58c051938da085da Jun 11 16:44:27.125359 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.125336 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf0603ecf25c26ddaba857696c5a239.slice/crio-f50c007e584272ad853fb1e7155824c895e3ab1bf8d0808ed5239d02ff1277d5 WatchSource:0}: Error finding container f50c007e584272ad853fb1e7155824c895e3ab1bf8d0808ed5239d02ff1277d5: Status 404 returned error can't find the container with id f50c007e584272ad853fb1e7155824c895e3ab1bf8d0808ed5239d02ff1277d5 Jun 11 16:44:27.129572 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.129554 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:44:27.131753 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.131703 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:44:27.134458 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-sysctl-conf\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.134557 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134473 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t96jd\" (UniqueName: \"kubernetes.io/projected/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-kube-api-access-t96jd\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.134557 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134504 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:27.134557 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134532 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.134681 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-device-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.134681 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-cnibin\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.134681 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134606 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-os-release\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.134681 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-systemd-units\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.134995 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134706 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.134995 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:27.134995 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5c8209e-966a-4d35-9f72-5075e2cca944-hosts-file\") pod \"node-resolver-9p8bj\" (UID: \"c5c8209e-966a-4d35-9f72-5075e2cca944\") " pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.134995 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac9e69f7-30e1-467f-9349-b9d4b15c4658-cni-binary-copy\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.134995 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134856 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-var-lib-kubelet\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.134995 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134902 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-daemon-config\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.134995 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.134995 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.134987 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsmmq\" (UniqueName: \"kubernetes.io/projected/995c73f4-4932-4535-84fe-5bbb5d22f805-kube-api-access-xsmmq\") pod \"iptables-alerter-b7q6n\" (UID: \"995c73f4-4932-4535-84fe-5bbb5d22f805\") " pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135024 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-log-socket\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135053 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-host\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90aeba2e-9e10-4a7a-907c-9f8fa617198a-agent-certs\") pod \"konnectivity-agent-l4z5b\" (UID: \"90aeba2e-9e10-4a7a-907c-9f8fa617198a\") " pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/995c73f4-4932-4535-84fe-5bbb5d22f805-host-slash\") pod \"iptables-alerter-b7q6n\" (UID: \"995c73f4-4932-4535-84fe-5bbb5d22f805\") " pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135128 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135142 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8sxm\" (UniqueName: \"kubernetes.io/projected/2af92175-3ed1-4425-9f77-47907e96c5b6-kube-api-access-n8sxm\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-run\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135184 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-cni-dir\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-socket-dir-parent\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135215 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-run-k8s-cni-cncf-io\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135232 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-etc-kubernetes\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-run-openvswitch\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-system-cni-dir\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-var-lib-cni-multus\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135321 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5dafdd3-b1a0-40bd-8144-6839cf079de0-serviceca\") pod \"node-ca-fgzxb\" (UID: \"d5dafdd3-b1a0-40bd-8144-6839cf079de0\") " pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.135357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-run-netns\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135368 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-var-lib-openvswitch\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135394 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-sys\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-registration-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135438 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-var-lib-cni-bin\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-hostroot\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135506 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmcx8\" (UniqueName: \"kubernetes.io/projected/ac9e69f7-30e1-467f-9349-b9d4b15c4658-kube-api-access-tmcx8\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkqz8\" (UniqueName: \"kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8\") pod \"network-check-target-2hkm9\" (UID: \"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413\") " pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-kubelet\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135621 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2af92175-3ed1-4425-9f77-47907e96c5b6-ovnkube-script-lib\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rfrt\" (UniqueName: \"kubernetes.io/projected/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-kube-api-access-2rfrt\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-kubelet-config\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-slash\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-var-lib-kubelet\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.136140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-run-multus-certs\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135802 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-dbus\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135840 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-lib-modules\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-run-netns\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135906 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-os-release\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-tuned\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-socket-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.135997 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-tmp\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136002 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-os-release\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136028 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-cnibin\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136052 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-etc-openvswitch\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136069 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-cnibin\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-cni-netd\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-kubernetes\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-429wg\" (UniqueName: \"kubernetes.io/projected/25230cfa-9fff-47b3-bba0-3f4023c53bdc-kube-api-access-429wg\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136151 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90aeba2e-9e10-4a7a-907c-9f8fa617198a-konnectivity-ca\") pod \"konnectivity-agent-l4z5b\" (UID: \"90aeba2e-9e10-4a7a-907c-9f8fa617198a\") " pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136174 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgl84\" (UniqueName: \"kubernetes.io/projected/d5dafdd3-b1a0-40bd-8144-6839cf079de0-kube-api-access-mgl84\") pod \"node-ca-fgzxb\" (UID: \"d5dafdd3-b1a0-40bd-8144-6839cf079de0\") " pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.136841 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136201 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-system-cni-dir\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136244 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-run-systemd\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136253 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-system-cni-dir\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136281 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-cni-bin\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136307 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136321 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136331 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-sysctl-d\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136356 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-conf-dir\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136383 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjknr\" (UniqueName: \"kubernetes.io/projected/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-kube-api-access-mjknr\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136420 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lljxd\" (UniqueName: \"kubernetes.io/projected/c5c8209e-966a-4d35-9f72-5075e2cca944-kube-api-access-lljxd\") pod \"node-resolver-9p8bj\" (UID: \"c5c8209e-966a-4d35-9f72-5075e2cca944\") " pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-run-ovn\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2af92175-3ed1-4425-9f77-47907e96c5b6-ovn-node-metrics-cert\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136484 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-systemd\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5dafdd3-b1a0-40bd-8144-6839cf079de0-host\") pod \"node-ca-fgzxb\" (UID: \"d5dafdd3-b1a0-40bd-8144-6839cf079de0\") " pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136564 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-modprobe-d\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.137361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-sysconfig\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.137848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.137848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2af92175-3ed1-4425-9f77-47907e96c5b6-ovnkube-config\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.137848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/995c73f4-4932-4535-84fe-5bbb5d22f805-iptables-alerter-script\") pod \"iptables-alerter-b7q6n\" (UID: \"995c73f4-4932-4535-84fe-5bbb5d22f805\") " pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.137848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5c8209e-966a-4d35-9f72-5075e2cca944-tmp-dir\") pod \"node-resolver-9p8bj\" (UID: \"c5c8209e-966a-4d35-9f72-5075e2cca944\") " pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.137848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2af92175-3ed1-4425-9f77-47907e96c5b6-env-overrides\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.137848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136707 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.137848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136793 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.137848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-sys-fs\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.137848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.136847 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-node-log\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.142436 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.142418 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:44:27.145788 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.145772 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjknr\" (UniqueName: \"kubernetes.io/projected/02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8-kube-api-access-mjknr\") pod \"multus-additional-cni-plugins-7r5rc\" (UID: \"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8\") " pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.237707 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237665 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-sysctl-conf\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.237707 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237706 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t96jd\" (UniqueName: \"kubernetes.io/projected/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-kube-api-access-t96jd\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237762 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237778 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-device-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-cnibin\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-os-release\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237840 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-systemd-units\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237839 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237849 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-sysctl-conf\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.237852 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.237917 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs podName:25230cfa-9fff-47b3-bba0-3f4023c53bdc nodeName:}" failed. No retries permitted until 2026-06-11 16:44:27.737900395 +0000 UTC m=+2.119458921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs") pod "network-metrics-daemon-2hn9p" (UID: "25230cfa-9fff-47b3-bba0-3f4023c53bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237925 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-cnibin\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.237950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5c8209e-966a-4d35-9f72-5075e2cca944-hosts-file\") pod \"node-resolver-9p8bj\" (UID: \"c5c8209e-966a-4d35-9f72-5075e2cca944\") " pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237965 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-systemd-units\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237966 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac9e69f7-30e1-467f-9349-b9d4b15c4658-cni-binary-copy\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.237943 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237915 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-device-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.237993 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-os-release\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238002 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-var-lib-kubelet\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.238015 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret podName:70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e nodeName:}" failed. No retries permitted until 2026-06-11 16:44:27.738003979 +0000 UTC m=+2.119562494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret") pod "global-pull-secret-syncer-7b27n" (UID: "70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238034 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-var-lib-kubelet\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-daemon-config\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238051 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5c8209e-966a-4d35-9f72-5075e2cca944-hosts-file\") pod \"node-resolver-9p8bj\" (UID: \"c5c8209e-966a-4d35-9f72-5075e2cca944\") " pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238073 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsmmq\" (UniqueName: \"kubernetes.io/projected/995c73f4-4932-4535-84fe-5bbb5d22f805-kube-api-access-xsmmq\") pod \"iptables-alerter-b7q6n\" (UID: \"995c73f4-4932-4535-84fe-5bbb5d22f805\") " pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238096 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-log-socket\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-host\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90aeba2e-9e10-4a7a-907c-9f8fa617198a-agent-certs\") pod \"konnectivity-agent-l4z5b\" (UID: \"90aeba2e-9e10-4a7a-907c-9f8fa617198a\") " pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238171 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-log-socket\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238179 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-host\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.238463 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238238 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/995c73f4-4932-4535-84fe-5bbb5d22f805-host-slash\") pod \"iptables-alerter-b7q6n\" (UID: \"995c73f4-4932-4535-84fe-5bbb5d22f805\") " pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238264 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8sxm\" (UniqueName: \"kubernetes.io/projected/2af92175-3ed1-4425-9f77-47907e96c5b6-kube-api-access-n8sxm\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238287 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/995c73f4-4932-4535-84fe-5bbb5d22f805-host-slash\") pod \"iptables-alerter-b7q6n\" (UID: \"995c73f4-4932-4535-84fe-5bbb5d22f805\") " pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238290 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-run\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238324 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-cni-dir\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238331 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-run\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238348 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-socket-dir-parent\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238372 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-run-k8s-cni-cncf-io\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238388 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-cni-dir\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238398 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-etc-kubernetes\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-run-openvswitch\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238435 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-socket-dir-parent\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238446 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-system-cni-dir\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-var-lib-cni-multus\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238495 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5dafdd3-b1a0-40bd-8144-6839cf079de0-serviceca\") pod \"node-ca-fgzxb\" (UID: \"d5dafdd3-b1a0-40bd-8144-6839cf079de0\") " pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238499 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-run-k8s-cni-cncf-io\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238522 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-run-netns\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238554 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac9e69f7-30e1-467f-9349-b9d4b15c4658-cni-binary-copy\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.239287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238555 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-run-openvswitch\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238578 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-var-lib-openvswitch\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238588 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-var-lib-cni-multus\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-etc-kubernetes\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238611 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-sys\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238608 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-var-lib-openvswitch\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238640 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-registration-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-var-lib-cni-bin\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-sys\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238642 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-run-netns\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238677 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-daemon-config\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238684 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-registration-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238706 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-var-lib-cni-bin\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238755 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-system-cni-dir\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-hostroot\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238791 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmcx8\" (UniqueName: \"kubernetes.io/projected/ac9e69f7-30e1-467f-9349-b9d4b15c4658-kube-api-access-tmcx8\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238818 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqz8\" (UniqueName: \"kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8\") pod \"network-check-target-2hkm9\" (UID: \"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413\") " pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-kubelet\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.240163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238872 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2af92175-3ed1-4425-9f77-47907e96c5b6-ovnkube-script-lib\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238809 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-hostroot\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rfrt\" (UniqueName: \"kubernetes.io/projected/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-kube-api-access-2rfrt\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-kubelet\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-kubelet-config\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238925 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5dafdd3-b1a0-40bd-8144-6839cf079de0-serviceca\") pod \"node-ca-fgzxb\" (UID: \"d5dafdd3-b1a0-40bd-8144-6839cf079de0\") " pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238957 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-slash\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-var-lib-kubelet\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239024 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-slash\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239035 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-run-multus-certs\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.238984 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-kubelet-config\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-dbus\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239097 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-var-lib-kubelet\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239096 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-lib-modules\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239120 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-run-multus-certs\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-run-netns\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239167 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-tuned\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-socket-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.241068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239210 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-dbus\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239222 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-lib-modules\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239230 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-host-run-netns\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-tmp\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239265 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-etc-openvswitch\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239288 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-cni-netd\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239309 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-socket-dir\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-kubernetes\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239347 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-etc-openvswitch\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239351 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-cni-netd\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-429wg\" (UniqueName: \"kubernetes.io/projected/25230cfa-9fff-47b3-bba0-3f4023c53bdc-kube-api-access-429wg\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239394 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-kubernetes\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239399 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90aeba2e-9e10-4a7a-907c-9f8fa617198a-konnectivity-ca\") pod \"konnectivity-agent-l4z5b\" (UID: \"90aeba2e-9e10-4a7a-907c-9f8fa617198a\") " pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgl84\" (UniqueName: \"kubernetes.io/projected/d5dafdd3-b1a0-40bd-8144-6839cf079de0-kube-api-access-mgl84\") pod \"node-ca-fgzxb\" (UID: \"d5dafdd3-b1a0-40bd-8144-6839cf079de0\") " pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-run-systemd\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239468 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2af92175-3ed1-4425-9f77-47907e96c5b6-ovnkube-script-lib\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-cni-bin\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.241936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239547 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-sysctl-d\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239551 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-run-systemd\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239577 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-conf-dir\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239581 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-cni-bin\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239607 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lljxd\" (UniqueName: \"kubernetes.io/projected/c5c8209e-966a-4d35-9f72-5075e2cca944-kube-api-access-lljxd\") pod \"node-resolver-9p8bj\" (UID: \"c5c8209e-966a-4d35-9f72-5075e2cca944\") " pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239631 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-run-ovn\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2af92175-3ed1-4425-9f77-47907e96c5b6-ovn-node-metrics-cert\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-systemd\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239689 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-sysctl-d\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239697 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5dafdd3-b1a0-40bd-8144-6839cf079de0-host\") pod \"node-ca-fgzxb\" (UID: \"d5dafdd3-b1a0-40bd-8144-6839cf079de0\") " pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-modprobe-d\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239756 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239769 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-sysconfig\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239792 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239818 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-systemd\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239825 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2af92175-3ed1-4425-9f77-47907e96c5b6-ovnkube-config\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239892 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90aeba2e-9e10-4a7a-907c-9f8fa617198a-konnectivity-ca\") pod \"konnectivity-agent-l4z5b\" (UID: \"90aeba2e-9e10-4a7a-907c-9f8fa617198a\") " pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:27.242443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239945 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac9e69f7-30e1-467f-9349-b9d4b15c4658-multus-conf-dir\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239953 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-run-ovn\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.239989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/995c73f4-4932-4535-84fe-5bbb5d22f805-iptables-alerter-script\") pod \"iptables-alerter-b7q6n\" (UID: \"995c73f4-4932-4535-84fe-5bbb5d22f805\") " pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240015 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5c8209e-966a-4d35-9f72-5075e2cca944-tmp-dir\") pod \"node-resolver-9p8bj\" (UID: \"c5c8209e-966a-4d35-9f72-5075e2cca944\") " pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240028 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5dafdd3-b1a0-40bd-8144-6839cf079de0-host\") pod \"node-ca-fgzxb\" (UID: \"d5dafdd3-b1a0-40bd-8144-6839cf079de0\") " pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240044 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-modprobe-d\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240054 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2af92175-3ed1-4425-9f77-47907e96c5b6-env-overrides\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240082 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240088 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-sysconfig\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240128 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-sys-fs\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-node-log\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240170 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240210 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-node-log\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240253 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2af92175-3ed1-4425-9f77-47907e96c5b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-sys-fs\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240304 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2af92175-3ed1-4425-9f77-47907e96c5b6-ovnkube-config\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240445 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5c8209e-966a-4d35-9f72-5075e2cca944-tmp-dir\") pod \"node-resolver-9p8bj\" (UID: \"c5c8209e-966a-4d35-9f72-5075e2cca944\") " pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240599 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2af92175-3ed1-4425-9f77-47907e96c5b6-env-overrides\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.242972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.240971 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90aeba2e-9e10-4a7a-907c-9f8fa617198a-agent-certs\") pod \"konnectivity-agent-l4z5b\" (UID: \"90aeba2e-9e10-4a7a-907c-9f8fa617198a\") " pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:27.243479 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.241313 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/995c73f4-4932-4535-84fe-5bbb5d22f805-iptables-alerter-script\") pod \"iptables-alerter-b7q6n\" (UID: \"995c73f4-4932-4535-84fe-5bbb5d22f805\") " pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.243479 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.241615 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-tmp\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.243479 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.241913 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-etc-tuned\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.243479 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.242154 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2af92175-3ed1-4425-9f77-47907e96c5b6-ovn-node-metrics-cert\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.247163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.247140 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsmmq\" (UniqueName: \"kubernetes.io/projected/995c73f4-4932-4535-84fe-5bbb5d22f805-kube-api-access-xsmmq\") pod \"iptables-alerter-b7q6n\" (UID: \"995c73f4-4932-4535-84fe-5bbb5d22f805\") " pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.247569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.247546 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t96jd\" (UniqueName: \"kubernetes.io/projected/ac65c9d3-fffd-4b53-b56c-6780c3069aa8-kube-api-access-t96jd\") pod \"tuned-ftn7m\" (UID: \"ac65c9d3-fffd-4b53-b56c-6780c3069aa8\") " pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.247876 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.247857 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:27.247963 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.247881 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:27.247963 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.247894 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkqz8 for pod openshift-network-diagnostics/network-check-target-2hkm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:27.248079 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.247970 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8 podName:f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:27.747949871 +0000 UTC m=+2.129508401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fkqz8" (UniqueName: "kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8") pod "network-check-target-2hkm9" (UID: "f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:27.248079 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.247983 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8sxm\" (UniqueName: \"kubernetes.io/projected/2af92175-3ed1-4425-9f77-47907e96c5b6-kube-api-access-n8sxm\") pod \"ovnkube-node-4799k\" (UID: \"2af92175-3ed1-4425-9f77-47907e96c5b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.248869 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.248842 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgl84\" (UniqueName: \"kubernetes.io/projected/d5dafdd3-b1a0-40bd-8144-6839cf079de0-kube-api-access-mgl84\") pod \"node-ca-fgzxb\" (UID: \"d5dafdd3-b1a0-40bd-8144-6839cf079de0\") " pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.249156 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.249131 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmcx8\" (UniqueName: \"kubernetes.io/projected/ac9e69f7-30e1-467f-9349-b9d4b15c4658-kube-api-access-tmcx8\") pod \"multus-5d6sw\" (UID: \"ac9e69f7-30e1-467f-9349-b9d4b15c4658\") " pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.249460 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.249437 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lljxd\" (UniqueName: \"kubernetes.io/projected/c5c8209e-966a-4d35-9f72-5075e2cca944-kube-api-access-lljxd\") pod \"node-resolver-9p8bj\" (UID: \"c5c8209e-966a-4d35-9f72-5075e2cca944\") " pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.249593 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.249577 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rfrt\" (UniqueName: \"kubernetes.io/projected/fadbfb9b-2ddd-41eb-851c-72e12c20bbb4-kube-api-access-2rfrt\") pod \"aws-ebs-csi-driver-node-ms872\" (UID: \"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.249754 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.249739 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-429wg\" (UniqueName: \"kubernetes.io/projected/25230cfa-9fff-47b3-bba0-3f4023c53bdc-kube-api-access-429wg\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:27.361381 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.361287 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" Jun 11 16:44:27.370928 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.370902 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ec660b_c2f7_4e1e_9112_9ae70ed6d0f8.slice/crio-9f368073cd8de3617e3055d430a0949c46e1773113f4b2dfd7e1e97076292bc8 WatchSource:0}: Error finding container 9f368073cd8de3617e3055d430a0949c46e1773113f4b2dfd7e1e97076292bc8: Status 404 returned error can't find the container with id 9f368073cd8de3617e3055d430a0949c46e1773113f4b2dfd7e1e97076292bc8 Jun 11 16:44:27.376857 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.376840 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b7q6n" Jun 11 16:44:27.384736 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.384700 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995c73f4_4932_4535_84fe_5bbb5d22f805.slice/crio-d2934d4af80a07ead9801f26aff0c8902d5d0c273e0d370cb84dc2c254ac7f2d WatchSource:0}: Error finding container d2934d4af80a07ead9801f26aff0c8902d5d0c273e0d370cb84dc2c254ac7f2d: Status 404 returned error can't find the container with id d2934d4af80a07ead9801f26aff0c8902d5d0c273e0d370cb84dc2c254ac7f2d Jun 11 16:44:27.390705 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.390686 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" Jun 11 16:44:27.399257 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.399236 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfadbfb9b_2ddd_41eb_851c_72e12c20bbb4.slice/crio-472f5da2e2c0a94af289ddb15f1bda1a2ccca8fc58e61c3d1281cb5e769effc8 WatchSource:0}: Error finding container 472f5da2e2c0a94af289ddb15f1bda1a2ccca8fc58e61c3d1281cb5e769effc8: Status 404 returned error can't find the container with id 472f5da2e2c0a94af289ddb15f1bda1a2ccca8fc58e61c3d1281cb5e769effc8 Jun 11 16:44:27.403202 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.403044 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9p8bj" Jun 11 16:44:27.407925 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.407905 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5d6sw" Jun 11 16:44:27.410533 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.410511 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c8209e_966a_4d35_9f72_5075e2cca944.slice/crio-5fa49b4e177ece4067e1223db14b443224c73ff1101e4f2542c68c5d757dba0f WatchSource:0}: Error finding container 5fa49b4e177ece4067e1223db14b443224c73ff1101e4f2542c68c5d757dba0f: Status 404 returned error can't find the container with id 5fa49b4e177ece4067e1223db14b443224c73ff1101e4f2542c68c5d757dba0f Jun 11 16:44:27.415357 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.415338 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9e69f7_30e1_467f_9349_b9d4b15c4658.slice/crio-5384e8e8a3314373ce120949b45e3899828e9b6ba35a62f762d16ad8f40131e4 WatchSource:0}: Error finding container 5384e8e8a3314373ce120949b45e3899828e9b6ba35a62f762d16ad8f40131e4: Status 404 returned error can't find the container with id 5384e8e8a3314373ce120949b45e3899828e9b6ba35a62f762d16ad8f40131e4 Jun 11 16:44:27.437429 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.437397 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:27.443203 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.443182 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:27.445743 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.445700 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af92175_3ed1_4425_9f77_47907e96c5b6.slice/crio-a499c9d396ab9b22f9ee3c8278a0934a66475b37ce064c418ebb7a74be29d217 WatchSource:0}: Error finding container a499c9d396ab9b22f9ee3c8278a0934a66475b37ce064c418ebb7a74be29d217: Status 404 returned error can't find the container with id a499c9d396ab9b22f9ee3c8278a0934a66475b37ce064c418ebb7a74be29d217 Jun 11 16:44:27.450836 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.450813 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" Jun 11 16:44:27.452395 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.452372 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90aeba2e_9e10_4a7a_907c_9f8fa617198a.slice/crio-4fc2546951d65ce81448c99a72a558bf2c1442bb11caaba3e7e3025c1c4e76af WatchSource:0}: Error finding container 4fc2546951d65ce81448c99a72a558bf2c1442bb11caaba3e7e3025c1c4e76af: Status 404 returned error can't find the container with id 4fc2546951d65ce81448c99a72a558bf2c1442bb11caaba3e7e3025c1c4e76af Jun 11 16:44:27.454846 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.454828 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fgzxb" Jun 11 16:44:27.461738 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.461690 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac65c9d3_fffd_4b53_b56c_6780c3069aa8.slice/crio-91f2be5faa87057282cab56507ba8040c2883132cfb81ad42aec56b9884d9a7a WatchSource:0}: Error finding container 91f2be5faa87057282cab56507ba8040c2883132cfb81ad42aec56b9884d9a7a: Status 404 returned error can't find the container with id 91f2be5faa87057282cab56507ba8040c2883132cfb81ad42aec56b9884d9a7a Jun 11 16:44:27.465475 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:44:27.465446 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5dafdd3_b1a0_40bd_8144_6839cf079de0.slice/crio-35b3e97b2e351af0720ef05f2ce1f4f3242039afc020e5fa3ce5318c1fd65fe1 WatchSource:0}: Error finding container 35b3e97b2e351af0720ef05f2ce1f4f3242039afc020e5fa3ce5318c1fd65fe1: Status 404 returned error can't find the container with id 35b3e97b2e351af0720ef05f2ce1f4f3242039afc020e5fa3ce5318c1fd65fe1 Jun 11 16:44:27.549569 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.549542 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:27.744991 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.744956 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:27.745165 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.745010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:27.745227 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.745170 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:27.745280 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.745227 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret podName:70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e nodeName:}" failed. No retries permitted until 2026-06-11 16:44:28.745210175 +0000 UTC m=+3.126768777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret") pod "global-pull-secret-syncer-7b27n" (UID: "70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:27.745624 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.745603 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:27.745753 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.745663 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs podName:25230cfa-9fff-47b3-bba0-3f4023c53bdc nodeName:}" failed. No retries permitted until 2026-06-11 16:44:28.745646903 +0000 UTC m=+3.127205423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs") pod "network-metrics-daemon-2hn9p" (UID: "25230cfa-9fff-47b3-bba0-3f4023c53bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:27.845974 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:27.845937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqz8\" (UniqueName: \"kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8\") pod \"network-check-target-2hkm9\" (UID: \"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413\") " pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:27.846191 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.846145 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:27.846191 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.846169 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:27.846191 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.846181 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkqz8 for pod openshift-network-diagnostics/network-check-target-2hkm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:27.846370 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:27.846238 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8 podName:f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:28.84622061 +0000 UTC m=+3.227779124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkqz8" (UniqueName: "kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8") pod "network-check-target-2hkm9" (UID: "f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:28.085915 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.085745 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:39:27 +0000 UTC" deadline="2028-02-01 08:48:50.992332287 +0000 UTC" Jun 11 16:44:28.085915 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.085805 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14392h4m22.906531083s" Jun 11 16:44:28.128952 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.128893 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b7q6n" event={"ID":"995c73f4-4932-4535-84fe-5bbb5d22f805","Type":"ContainerStarted","Data":"d2934d4af80a07ead9801f26aff0c8902d5d0c273e0d370cb84dc2c254ac7f2d"} Jun 11 16:44:28.131157 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.131130 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" event={"ID":"9cf0603ecf25c26ddaba857696c5a239","Type":"ContainerStarted","Data":"f50c007e584272ad853fb1e7155824c895e3ab1bf8d0808ed5239d02ff1277d5"} Jun 11 16:44:28.134517 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.134493 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fgzxb" event={"ID":"d5dafdd3-b1a0-40bd-8144-6839cf079de0","Type":"ContainerStarted","Data":"35b3e97b2e351af0720ef05f2ce1f4f3242039afc020e5fa3ce5318c1fd65fe1"} Jun 11 16:44:28.136642 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.136620 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" event={"ID":"ac65c9d3-fffd-4b53-b56c-6780c3069aa8","Type":"ContainerStarted","Data":"91f2be5faa87057282cab56507ba8040c2883132cfb81ad42aec56b9884d9a7a"} Jun 11 16:44:28.144183 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.144114 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9p8bj" event={"ID":"c5c8209e-966a-4d35-9f72-5075e2cca944","Type":"ContainerStarted","Data":"5fa49b4e177ece4067e1223db14b443224c73ff1101e4f2542c68c5d757dba0f"} Jun 11 16:44:28.147204 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.147177 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" event={"ID":"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4","Type":"ContainerStarted","Data":"472f5da2e2c0a94af289ddb15f1bda1a2ccca8fc58e61c3d1281cb5e769effc8"} Jun 11 16:44:28.159783 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.159757 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" event={"ID":"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8","Type":"ContainerStarted","Data":"9f368073cd8de3617e3055d430a0949c46e1773113f4b2dfd7e1e97076292bc8"} Jun 11 16:44:28.177048 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.176975 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" event={"ID":"5e289c5a5bd5b8f639323fb6b704d3f3","Type":"ContainerStarted","Data":"0b98127f8134f433f291a1ccd0c0d0f2095fa93c816c8b0d58c051938da085da"} Jun 11 16:44:28.204147 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.204113 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l4z5b" event={"ID":"90aeba2e-9e10-4a7a-907c-9f8fa617198a","Type":"ContainerStarted","Data":"4fc2546951d65ce81448c99a72a558bf2c1442bb11caaba3e7e3025c1c4e76af"} Jun 11 16:44:28.208009 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.207749 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" event={"ID":"2af92175-3ed1-4425-9f77-47907e96c5b6","Type":"ContainerStarted","Data":"a499c9d396ab9b22f9ee3c8278a0934a66475b37ce064c418ebb7a74be29d217"} Jun 11 16:44:28.222396 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.222366 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5d6sw" event={"ID":"ac9e69f7-30e1-467f-9349-b9d4b15c4658","Type":"ContainerStarted","Data":"5384e8e8a3314373ce120949b45e3899828e9b6ba35a62f762d16ad8f40131e4"} Jun 11 16:44:28.530934 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.530888 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:28.548287 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.548241 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:28.725891 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.725862 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:44:28.753306 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.752468 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:28.753306 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.752515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:28.753306 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:28.752673 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:28.753306 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:28.752749 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret podName:70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e nodeName:}" failed. No retries permitted until 2026-06-11 16:44:30.752730865 +0000 UTC m=+5.134289394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret") pod "global-pull-secret-syncer-7b27n" (UID: "70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:28.753306 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:28.752812 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:28.753306 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:28.752845 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs podName:25230cfa-9fff-47b3-bba0-3f4023c53bdc nodeName:}" failed. No retries permitted until 2026-06-11 16:44:30.752834146 +0000 UTC m=+5.134392667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs") pod "network-metrics-daemon-2hn9p" (UID: "25230cfa-9fff-47b3-bba0-3f4023c53bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:28.853139 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:28.853052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqz8\" (UniqueName: \"kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8\") pod \"network-check-target-2hkm9\" (UID: \"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413\") " pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:28.853313 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:28.853210 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:28.853313 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:28.853230 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:28.853313 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:28.853242 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkqz8 for pod openshift-network-diagnostics/network-check-target-2hkm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:28.853313 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:28.853300 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8 podName:f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:30.853282213 +0000 UTC m=+5.234840742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkqz8" (UniqueName: "kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8") pod "network-check-target-2hkm9" (UID: "f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:29.086820 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:29.086777 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:39:27 +0000 UTC" deadline="2027-11-22 15:31:03.859823948 +0000 UTC" Jun 11 16:44:29.086820 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:29.086820 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12694h46m34.773008739s" Jun 11 16:44:29.109680 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:29.109604 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:29.109841 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:29.109747 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:29.110160 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:29.110139 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:29.110276 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:29.110245 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:29.110335 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:29.110309 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:29.110402 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:29.110387 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:30.771114 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:30.771078 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:30.771565 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:30.771131 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:30.771565 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:30.771263 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:30.771565 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:30.771322 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret podName:70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e nodeName:}" failed. No retries permitted until 2026-06-11 16:44:34.771305199 +0000 UTC m=+9.152863713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret") pod "global-pull-secret-syncer-7b27n" (UID: "70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:30.771565 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:30.771386 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:30.771565 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:30.771420 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs podName:25230cfa-9fff-47b3-bba0-3f4023c53bdc nodeName:}" failed. No retries permitted until 2026-06-11 16:44:34.771407642 +0000 UTC m=+9.152966158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs") pod "network-metrics-daemon-2hn9p" (UID: "25230cfa-9fff-47b3-bba0-3f4023c53bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:30.872531 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:30.872478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqz8\" (UniqueName: \"kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8\") pod \"network-check-target-2hkm9\" (UID: \"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413\") " pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:30.872694 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:30.872669 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:30.872694 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:30.872686 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:30.872694 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:30.872696 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkqz8 for pod openshift-network-diagnostics/network-check-target-2hkm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:30.872881 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:30.872774 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8 podName:f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:34.872757121 +0000 UTC m=+9.254315636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkqz8" (UniqueName: "kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8") pod "network-check-target-2hkm9" (UID: "f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:31.109110 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:31.109026 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:31.109275 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:31.109150 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:31.109425 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:31.109402 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:31.109594 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:31.109533 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:31.109670 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:31.109597 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:31.109869 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:31.109682 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:33.109449 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:33.109419 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:33.109935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:33.109419 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:33.109935 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:33.109560 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:33.109935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:33.109419 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:33.109935 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:33.109632 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:33.109935 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:33.109690 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:34.808331 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:34.808128 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:34.808331 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:34.808174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:34.808331 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:34.808292 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:34.808974 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:34.808355 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret podName:70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e nodeName:}" failed. No retries permitted until 2026-06-11 16:44:42.808335949 +0000 UTC m=+17.189894475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret") pod "global-pull-secret-syncer-7b27n" (UID: "70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:34.808974 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:34.808293 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:34.808974 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:34.808746 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs podName:25230cfa-9fff-47b3-bba0-3f4023c53bdc nodeName:}" failed. No retries permitted until 2026-06-11 16:44:42.808709976 +0000 UTC m=+17.190268503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs") pod "network-metrics-daemon-2hn9p" (UID: "25230cfa-9fff-47b3-bba0-3f4023c53bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:34.909262 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:34.909223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqz8\" (UniqueName: \"kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8\") pod \"network-check-target-2hkm9\" (UID: \"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413\") " pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:34.909463 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:34.909447 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:34.909506 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:34.909473 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:34.909506 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:34.909487 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkqz8 for pod openshift-network-diagnostics/network-check-target-2hkm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:34.909584 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:34.909553 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8 podName:f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:42.909534184 +0000 UTC m=+17.291092705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkqz8" (UniqueName: "kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8") pod "network-check-target-2hkm9" (UID: "f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:35.109147 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:35.109068 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:35.109322 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:35.109191 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:35.109322 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:35.109260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:35.109430 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:35.109345 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:35.109489 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:35.109421 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:35.109555 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:35.109534 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:37.109507 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:37.109270 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:37.110066 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:37.109274 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:37.110066 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:37.109599 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:37.110066 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:37.109705 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:37.110066 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:37.109338 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:37.110066 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:37.109845 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:39.109656 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:39.109582 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:39.109656 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:39.109622 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:39.110128 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:39.109694 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:39.110128 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:39.109734 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:39.110128 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:39.109844 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:39.110128 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:39.109915 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:41.108932 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:41.108890 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:41.108932 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:41.108916 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:41.109411 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:41.108892 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:41.109411 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:41.109023 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:41.109411 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:41.109138 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:41.109411 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:41.109230 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:42.872043 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:42.871996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:42.872043 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:42.872046 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:42.872551 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:42.872147 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:42.872551 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:42.872216 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret podName:70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e nodeName:}" failed. No retries permitted until 2026-06-11 16:44:58.872196363 +0000 UTC m=+33.253754877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret") pod "global-pull-secret-syncer-7b27n" (UID: "70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:42.872551 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:42.872147 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:42.872551 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:42.872276 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs podName:25230cfa-9fff-47b3-bba0-3f4023c53bdc nodeName:}" failed. No retries permitted until 2026-06-11 16:44:58.872261502 +0000 UTC m=+33.253820015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs") pod "network-metrics-daemon-2hn9p" (UID: "25230cfa-9fff-47b3-bba0-3f4023c53bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:42.973063 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:42.973029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqz8\" (UniqueName: \"kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8\") pod \"network-check-target-2hkm9\" (UID: \"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413\") " pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:42.973239 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:42.973187 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:42.973239 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:42.973211 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:42.973239 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:42.973225 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkqz8 for pod openshift-network-diagnostics/network-check-target-2hkm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:42.973369 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:42.973282 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8 podName:f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413 nodeName:}" failed. No retries permitted until 2026-06-11 16:44:58.973264418 +0000 UTC m=+33.354822932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkqz8" (UniqueName: "kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8") pod "network-check-target-2hkm9" (UID: "f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:43.109498 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:43.109405 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:43.109650 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:43.109522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:43.109650 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:43.109529 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:43.109650 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:43.109530 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:43.109650 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:43.109627 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:43.109882 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:43.109727 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:45.109556 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:45.109520 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:45.109556 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:45.109554 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:45.110067 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:45.109552 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:45.110067 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:45.109667 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:45.110067 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:45.109743 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:45.110067 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:45.109803 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:47.109235 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:47.109169 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:47.109566 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:47.109283 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:47.109566 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:47.109298 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:47.109566 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:47.109326 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:47.109566 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:47.109428 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:47.109566 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:47.109507 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:48.273555 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.273262 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" event={"ID":"ac65c9d3-fffd-4b53-b56c-6780c3069aa8","Type":"ContainerStarted","Data":"f071547af34b3eefbe65b9f8299b09a2d8d40cf391c604345d83b60efc7add58"} Jun 11 16:44:48.276669 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.276648 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 16:44:48.277105 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.277082 2558 generic.go:356] "Generic (PLEG): container finished" podID="2af92175-3ed1-4425-9f77-47907e96c5b6" containerID="f89c957af92005e9edc746a49f1473dd9926b6ae0cce297f78452a9548c8bcd6" exitCode=1 Jun 11 16:44:48.277175 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.277158 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" event={"ID":"2af92175-3ed1-4425-9f77-47907e96c5b6","Type":"ContainerStarted","Data":"cdbdbcfeb13c8d4ad5966c44ab5087fe4f249424591ca38f5175e47c1253f060"} Jun 11 16:44:48.277250 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.277228 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" event={"ID":"2af92175-3ed1-4425-9f77-47907e96c5b6","Type":"ContainerDied","Data":"f89c957af92005e9edc746a49f1473dd9926b6ae0cce297f78452a9548c8bcd6"} Jun 11 16:44:48.277365 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.277316 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" event={"ID":"2af92175-3ed1-4425-9f77-47907e96c5b6","Type":"ContainerStarted","Data":"6808b118f6037ea648a0f8a6d46982ef97fe6fa58a1e578cb0e19bb78073c77f"} Jun 11 16:44:48.278837 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.278812 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5d6sw" event={"ID":"ac9e69f7-30e1-467f-9349-b9d4b15c4658","Type":"ContainerStarted","Data":"158e847c615dade6ae7957f31f7786d1178c555bf50acb12a7280776a3c32fd8"} Jun 11 16:44:48.281645 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.281625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" event={"ID":"9cf0603ecf25c26ddaba857696c5a239","Type":"ContainerStarted","Data":"cb0529d7d8fed5b3e63e02ea5e3acbac8976c037265b42d0aa2df2a8055cf8ca"} Jun 11 16:44:48.290777 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.290694 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ftn7m" podStartSLOduration=2.659265676 podStartE2EDuration="22.290681615s" totalImagesPullingTime="19.631415939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:48.29059766 +0000 UTC m=+22.672156218" watchObservedRunningTime="2026-06-11 16:44:48.290681615 +0000 UTC m=+22.672240149" Jun 11 16:44:48.311293 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.311255 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5d6sw" podStartSLOduration=2.395203023 podStartE2EDuration="22.311240545s" totalImagesPullingTime="19.916037522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:48.310559565 +0000 UTC m=+22.692118100" watchObservedRunningTime="2026-06-11 16:44:48.311240545 +0000 UTC m=+22.692799079" Jun 11 16:44:48.324354 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:48.324313 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" podStartSLOduration=22.324294687 podStartE2EDuration="22.324294687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:48.323685187 +0000 UTC m=+22.705243718" watchObservedRunningTime="2026-06-11 16:44:48.324294687 +0000 UTC m=+22.705853222" Jun 11 16:44:49.109345 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.109111 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:49.109345 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.109156 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:49.109548 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.109174 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:49.109548 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:49.109483 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:49.109548 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:49.109512 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:49.109698 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:49.109606 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:49.285495 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.285456 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l4z5b" event={"ID":"90aeba2e-9e10-4a7a-907c-9f8fa617198a","Type":"ContainerStarted","Data":"fd7192801d734efee6c6b9dbbd717caf40f95a8f12fc151e2c3fd5dd77bad3d3"} Jun 11 16:44:49.288632 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.288613 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 16:44:49.289086 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.289055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" event={"ID":"2af92175-3ed1-4425-9f77-47907e96c5b6","Type":"ContainerStarted","Data":"b2d73dd2ea141babca53ed29a065001930fe9f34aa238debff91a969a37675ff"} Jun 11 16:44:49.289197 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.289139 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" event={"ID":"2af92175-3ed1-4425-9f77-47907e96c5b6","Type":"ContainerStarted","Data":"8993c0fc50a2e5752aa9859a96fd29691183044dfaa23c84e35f066e0ef8f0d7"} Jun 11 16:44:49.289197 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.289189 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" event={"ID":"2af92175-3ed1-4425-9f77-47907e96c5b6","Type":"ContainerStarted","Data":"657ed8efabd28233b38ea7595693ae30267a70f52456016171936b1e98d4bc75"} Jun 11 16:44:49.290811 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.290786 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b7q6n" event={"ID":"995c73f4-4932-4535-84fe-5bbb5d22f805","Type":"ContainerStarted","Data":"4153f0df42895967d10edeaa21477dd31e9b5c2332ab2316bf4d23833bbed75b"} Jun 11 16:44:49.292335 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.292313 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fgzxb" event={"ID":"d5dafdd3-b1a0-40bd-8144-6839cf079de0","Type":"ContainerStarted","Data":"1ccd87cb9026ecec7e0ac26a1dc423f8782b2835dc5eaa17321d8d24921ccac4"} Jun 11 16:44:49.293777 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.293753 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9p8bj" event={"ID":"c5c8209e-966a-4d35-9f72-5075e2cca944","Type":"ContainerStarted","Data":"682a2e08a846b1b9de9dc3b2cfc811bcc8da38ed33274dd81cdbf3ce1601a736"} Jun 11 16:44:49.295258 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.295238 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" event={"ID":"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4","Type":"ContainerStarted","Data":"c55130657e463274dc0fc8443a1d6d73bc6cd578e166496c9c836d54373015a8"} Jun 11 16:44:49.296854 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.296832 2558 generic.go:356] "Generic (PLEG): container finished" podID="02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8" containerID="cbd4767a4c42e831b8fc0d7f27f3227bee2168fdb6077ec9939fa837adc0a528" exitCode=0 Jun 11 16:44:49.296937 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.296908 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" event={"ID":"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8","Type":"ContainerDied","Data":"cbd4767a4c42e831b8fc0d7f27f3227bee2168fdb6077ec9939fa837adc0a528"} Jun 11 16:44:49.298486 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.298462 2558 generic.go:356] "Generic (PLEG): container finished" podID="5e289c5a5bd5b8f639323fb6b704d3f3" containerID="4e91b4f50cd8446524a2804d8ad5b1189c8108b7bc6fe46486cd8d042726501c" exitCode=0 Jun 11 16:44:49.298584 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.298537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" event={"ID":"5e289c5a5bd5b8f639323fb6b704d3f3","Type":"ContainerDied","Data":"4e91b4f50cd8446524a2804d8ad5b1189c8108b7bc6fe46486cd8d042726501c"} Jun 11 16:44:49.301073 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.301037 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l4z5b" podStartSLOduration=8.288588486 podStartE2EDuration="23.301023516s" totalImagesPullingTime="15.01243503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:49.300811672 +0000 UTC m=+23.682370208" watchObservedRunningTime="2026-06-11 16:44:49.301023516 +0000 UTC m=+23.682582051" Jun 11 16:44:49.316577 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.316531 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fgzxb" podStartSLOduration=3.711851182 podStartE2EDuration="23.316515016s" totalImagesPullingTime="19.604663834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:49.315608781 +0000 UTC m=+23.697167315" watchObservedRunningTime="2026-06-11 16:44:49.316515016 +0000 UTC m=+23.698073552" Jun 11 16:44:49.364342 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.364251 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b7q6n" podStartSLOduration=3.678161611 podStartE2EDuration="23.364234171s" totalImagesPullingTime="19.68607256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:49.364033149 +0000 UTC m=+23.745591685" watchObservedRunningTime="2026-06-11 16:44:49.364234171 +0000 UTC m=+23.745792706" Jun 11 16:44:49.379785 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.379730 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9p8bj" podStartSLOduration=3.702968555 podStartE2EDuration="23.379697297s" totalImagesPullingTime="19.676728742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:49.379562421 +0000 UTC m=+23.761120966" watchObservedRunningTime="2026-06-11 16:44:49.379697297 +0000 UTC m=+23.761255832" Jun 11 16:44:49.410251 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.410221 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:49.472976 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.472934 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:49.538848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.538820 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:49.593265 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.593233 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:49.773254 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:49.773232 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:44:50.107936 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:50.107844 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:44:49.773250336Z","UUID":"9f1e0c24-e380-4fb6-b786-19e94195aa60","Handler":null,"Name":"","Endpoint":""} Jun 11 16:44:50.109768 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:50.109609 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:44:50.109768 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:50.109668 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:44:50.303537 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:50.303498 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" event={"ID":"5e289c5a5bd5b8f639323fb6b704d3f3","Type":"ContainerStarted","Data":"0b81127fe3c4558ddd0ecc9386c34e7d209535ccff01e20357eec6ce5d0148af"} Jun 11 16:44:50.305840 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:50.305774 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" event={"ID":"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4","Type":"ContainerStarted","Data":"ba4bc05c118d2c9f1174e00e5f42c14139cf88a6aaf84b1fc4c6fc14e179443b"} Jun 11 16:44:50.319361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:50.319314 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" podStartSLOduration=24.319297802 podStartE2EDuration="24.319297802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:50.318596022 +0000 UTC m=+24.700154582" watchObservedRunningTime="2026-06-11 16:44:50.319297802 +0000 UTC m=+24.700856337" Jun 11 16:44:51.109119 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:51.108894 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:51.109280 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:51.108954 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:51.109280 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:51.109157 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:51.109280 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:51.109232 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:51.109280 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:51.108954 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:51.109495 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:51.109367 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:51.313730 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:51.313678 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" event={"ID":"fadbfb9b-2ddd-41eb-851c-72e12c20bbb4","Type":"ContainerStarted","Data":"9c0c1559ded4b23c9a2e0e62f1fe881f1845f91c54dc41f106ed81e01979153d"} Jun 11 16:44:51.319773 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:51.319752 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 16:44:51.320217 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:51.320192 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" event={"ID":"2af92175-3ed1-4425-9f77-47907e96c5b6","Type":"ContainerStarted","Data":"297750adf7c03063d1ebce4d7f86154abfb3a7c991a03c30c15b6aa705368617"} Jun 11 16:44:51.332356 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:51.332306 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ms872" podStartSLOduration=3.6383651500000003 podStartE2EDuration="25.332289295s" totalImagesPullingTime="21.693924145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:51.331831619 +0000 UTC m=+25.713390212" watchObservedRunningTime="2026-06-11 16:44:51.332289295 +0000 UTC m=+25.713847830" Jun 11 16:44:53.109396 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:53.109362 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:53.109886 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:53.109466 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:53.109886 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:53.109485 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:53.109886 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:53.109480 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:53.109886 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:53.109580 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:53.109886 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:53.109673 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:53.500258 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:53.499938 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:53.500926 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:53.500541 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:54.324987 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.324784 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:54.325749 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.325344 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l4z5b" Jun 11 16:44:54.329235 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.329214 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 16:44:54.329680 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.329648 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" event={"ID":"2af92175-3ed1-4425-9f77-47907e96c5b6","Type":"ContainerStarted","Data":"ac4e713cb670d17b93c0de44f2c50ebbea5bf4581ef349f748da01e5e4e678de"} Jun 11 16:44:54.330376 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.330358 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:54.330480 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.330408 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:54.330582 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.330564 2558 scope.go:117] "RemoveContainer" containerID="f89c957af92005e9edc746a49f1473dd9926b6ae0cce297f78452a9548c8bcd6" Jun 11 16:44:54.332113 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.332094 2558 generic.go:356] "Generic (PLEG): container finished" podID="02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8" containerID="6a339f4a28c339d76bceaac5b8f95ca54f4beefda1ab25074d3cd08621abfdd6" exitCode=0 Jun 11 16:44:54.333747 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.332176 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" event={"ID":"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8","Type":"ContainerDied","Data":"6a339f4a28c339d76bceaac5b8f95ca54f4beefda1ab25074d3cd08621abfdd6"} Jun 11 16:44:54.349935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.349898 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:54.398475 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:54.398444 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:44:55.108925 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.108892 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:55.109174 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.108895 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:55.109174 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:55.109019 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:55.109174 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.109025 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:55.109174 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:55.109108 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:55.109455 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:55.109192 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:55.338666 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.338647 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 16:44:55.339038 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.339018 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" event={"ID":"2af92175-3ed1-4425-9f77-47907e96c5b6","Type":"ContainerStarted","Data":"fe222ec89e19373208bf314205857957718785d31ecaaa8382e2e7a4156286e1"} Jun 11 16:44:55.339478 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.339459 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:55.353679 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.353654 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:44:55.377530 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.377300 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" podStartSLOduration=8.910203167 podStartE2EDuration="29.377280254s" totalImagesPullingTime="20.467077087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:44:55.376522791 +0000 UTC m=+29.758081350" watchObservedRunningTime="2026-06-11 16:44:55.377280254 +0000 UTC m=+29.758838790" Jun 11 16:44:55.412757 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.412705 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7b27n"] Jun 11 16:44:55.412937 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.412892 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:55.413031 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:55.413008 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:55.413520 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.413498 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2hkm9"] Jun 11 16:44:55.413624 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.413597 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:55.413702 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:55.413683 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:55.414229 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.414208 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2hn9p"] Jun 11 16:44:55.414298 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:55.414288 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:55.414404 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:55.414384 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:56.343754 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:56.343557 2558 generic.go:356] "Generic (PLEG): container finished" podID="02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8" containerID="47df6f9b6d8ead3af2c98ef13410203e3ad0fd4c3f1cbf9741e4db7ccbf84fd9" exitCode=0 Jun 11 16:44:56.344166 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:56.343633 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" event={"ID":"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8","Type":"ContainerDied","Data":"47df6f9b6d8ead3af2c98ef13410203e3ad0fd4c3f1cbf9741e4db7ccbf84fd9"} Jun 11 16:44:57.109405 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:57.109372 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:57.109549 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:57.109417 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:57.109549 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:57.109473 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:57.109549 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:57.109519 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:57.109667 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:57.109631 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:57.109801 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:57.109762 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:44:58.350634 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:58.350602 2558 generic.go:356] "Generic (PLEG): container finished" podID="02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8" containerID="c97fc94d8e86c1256761e1412c74145bdb3821a82b00d0fb2645ea21a86b9b16" exitCode=0 Jun 11 16:44:58.351239 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:58.350664 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" event={"ID":"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8","Type":"ContainerDied","Data":"c97fc94d8e86c1256761e1412c74145bdb3821a82b00d0fb2645ea21a86b9b16"} Jun 11 16:44:58.896973 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:58.896943 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:58.896973 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:58.896978 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:58.897206 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:58.897101 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:58.897206 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:58.897115 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:58.897206 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:58.897160 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret podName:70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e nodeName:}" failed. No retries permitted until 2026-06-11 16:45:30.897143908 +0000 UTC m=+65.278702444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret") pod "global-pull-secret-syncer-7b27n" (UID: "70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:44:58.897206 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:58.897175 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs podName:25230cfa-9fff-47b3-bba0-3f4023c53bdc nodeName:}" failed. No retries permitted until 2026-06-11 16:45:30.897169354 +0000 UTC m=+65.278727867 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs") pod "network-metrics-daemon-2hn9p" (UID: "25230cfa-9fff-47b3-bba0-3f4023c53bdc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:44:58.997328 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:58.997284 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqz8\" (UniqueName: \"kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8\") pod \"network-check-target-2hkm9\" (UID: \"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413\") " pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:58.997499 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:58.997472 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:44:58.997539 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:58.997502 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:44:58.997539 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:58.997517 2558 projected.go:196] Error preparing data for projected volume kube-api-access-fkqz8 for pod openshift-network-diagnostics/network-check-target-2hkm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:58.997612 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:58.997581 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8 podName:f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413 nodeName:}" failed. No retries permitted until 2026-06-11 16:45:30.99756185 +0000 UTC m=+65.379120380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fkqz8" (UniqueName: "kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8") pod "network-check-target-2hkm9" (UID: "f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:44:59.109614 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:59.109550 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:44:59.109614 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:59.109594 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:44:59.109943 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:44:59.109669 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:44:59.109943 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:59.109681 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:44:59.109943 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:59.109804 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:44:59.109943 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:44:59.109903 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:45:01.109251 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.109218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:45:01.109831 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.109224 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:45:01.109831 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:01.109358 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:45:01.109831 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.109367 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:45:01.109831 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:01.109435 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2hkm9" podUID="f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413" Jun 11 16:45:01.109831 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:01.109514 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b27n" podUID="70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e" Jun 11 16:45:01.366090 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.366018 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeReady" Jun 11 16:45:01.366244 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.366147 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:45:01.462629 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.462595 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h8whw"] Jun 11 16:45:01.468030 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.468005 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jtsv8"] Jun 11 16:45:01.468184 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.468152 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.471486 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.471465 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d9x4d\"" Jun 11 16:45:01.471615 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.471547 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jtsv8" Jun 11 16:45:01.471969 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.471945 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:45:01.472081 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.471948 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:45:01.473652 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.473636 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:45:01.474290 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.474217 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:45:01.474290 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.474235 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:45:01.474556 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.474511 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-428pv\"" Jun 11 16:45:01.475753 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.475731 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jtsv8"] Jun 11 16:45:01.478972 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.478687 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h8whw"] Jun 11 16:45:01.584459 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.584424 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:01.617425 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.617352 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmpdh\" (UniqueName: \"kubernetes.io/projected/19a845c8-e5c5-4523-96f0-b4cef88ff648-kube-api-access-rmpdh\") pod \"ingress-canary-jtsv8\" (UID: \"19a845c8-e5c5-4523-96f0-b4cef88ff648\") " pod="openshift-ingress-canary/ingress-canary-jtsv8" Jun 11 16:45:01.617425 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.617388 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e915cfae-2400-40f3-a789-72932ee96199-tmp-dir\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.617585 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.617483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.617585 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.617515 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19a845c8-e5c5-4523-96f0-b4cef88ff648-cert\") pod \"ingress-canary-jtsv8\" (UID: \"19a845c8-e5c5-4523-96f0-b4cef88ff648\") " pod="openshift-ingress-canary/ingress-canary-jtsv8" Jun 11 16:45:01.617665 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.617615 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e915cfae-2400-40f3-a789-72932ee96199-config-volume\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.617665 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.617645 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw8wz\" (UniqueName: \"kubernetes.io/projected/e915cfae-2400-40f3-a789-72932ee96199-kube-api-access-qw8wz\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.683518 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.683482 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:01.718603 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.718553 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmpdh\" (UniqueName: \"kubernetes.io/projected/19a845c8-e5c5-4523-96f0-b4cef88ff648-kube-api-access-rmpdh\") pod \"ingress-canary-jtsv8\" (UID: \"19a845c8-e5c5-4523-96f0-b4cef88ff648\") " pod="openshift-ingress-canary/ingress-canary-jtsv8" Jun 11 16:45:01.718603 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.718607 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e915cfae-2400-40f3-a789-72932ee96199-tmp-dir\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.718882 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.718712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.718882 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.718752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19a845c8-e5c5-4523-96f0-b4cef88ff648-cert\") pod \"ingress-canary-jtsv8\" (UID: \"19a845c8-e5c5-4523-96f0-b4cef88ff648\") " pod="openshift-ingress-canary/ingress-canary-jtsv8" Jun 11 16:45:01.718882 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.718795 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e915cfae-2400-40f3-a789-72932ee96199-config-volume\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.718882 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.718825 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw8wz\" (UniqueName: \"kubernetes.io/projected/e915cfae-2400-40f3-a789-72932ee96199-kube-api-access-qw8wz\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.718882 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:01.718862 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:45:01.719118 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:01.718936 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls podName:e915cfae-2400-40f3-a789-72932ee96199 nodeName:}" failed. No retries permitted until 2026-06-11 16:45:02.218915023 +0000 UTC m=+36.600473536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls") pod "dns-default-h8whw" (UID: "e915cfae-2400-40f3-a789-72932ee96199") : secret "dns-default-metrics-tls" not found Jun 11 16:45:01.719118 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.719035 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e915cfae-2400-40f3-a789-72932ee96199-tmp-dir\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.719560 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.719534 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e915cfae-2400-40f3-a789-72932ee96199-config-volume\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.723415 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.723393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19a845c8-e5c5-4523-96f0-b4cef88ff648-cert\") pod \"ingress-canary-jtsv8\" (UID: \"19a845c8-e5c5-4523-96f0-b4cef88ff648\") " pod="openshift-ingress-canary/ingress-canary-jtsv8" Jun 11 16:45:01.727917 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.727872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmpdh\" (UniqueName: \"kubernetes.io/projected/19a845c8-e5c5-4523-96f0-b4cef88ff648-kube-api-access-rmpdh\") pod \"ingress-canary-jtsv8\" (UID: \"19a845c8-e5c5-4523-96f0-b4cef88ff648\") " pod="openshift-ingress-canary/ingress-canary-jtsv8" Jun 11 16:45:01.728135 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.728115 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw8wz\" (UniqueName: \"kubernetes.io/projected/e915cfae-2400-40f3-a789-72932ee96199-kube-api-access-qw8wz\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:01.787222 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:01.787185 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jtsv8" Jun 11 16:45:02.222025 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:02.221750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:02.222378 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:02.221890 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:45:02.222378 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:02.222104 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls podName:e915cfae-2400-40f3-a789-72932ee96199 nodeName:}" failed. No retries permitted until 2026-06-11 16:45:03.222081167 +0000 UTC m=+37.603639695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls") pod "dns-default-h8whw" (UID: "e915cfae-2400-40f3-a789-72932ee96199") : secret "dns-default-metrics-tls" not found Jun 11 16:45:02.261769 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:02.261737 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jtsv8"] Jun 11 16:45:02.267573 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:45:02.267545 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a845c8_e5c5_4523_96f0_b4cef88ff648.slice/crio-5c181a48d117abbe698d686426fa2536911471631aa8036cee289f570da493be WatchSource:0}: Error finding container 5c181a48d117abbe698d686426fa2536911471631aa8036cee289f570da493be: Status 404 returned error can't find the container with id 5c181a48d117abbe698d686426fa2536911471631aa8036cee289f570da493be Jun 11 16:45:02.360708 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:02.360681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jtsv8" event={"ID":"19a845c8-e5c5-4523-96f0-b4cef88ff648","Type":"ContainerStarted","Data":"5c181a48d117abbe698d686426fa2536911471631aa8036cee289f570da493be"} Jun 11 16:45:02.363689 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:02.363666 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" event={"ID":"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8","Type":"ContainerStarted","Data":"845779a725073d1e3cc7086707b41a71be9de774ce6424ce32b2f42badb965d6"} Jun 11 16:45:03.108928 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.108894 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:45:03.109133 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.108949 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:45:03.109203 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.109158 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:45:03.111801 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.111775 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:45:03.112943 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.112764 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:45:03.112943 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.112812 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mwddw\"" Jun 11 16:45:03.112943 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.112830 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bmxfr\"" Jun 11 16:45:03.112943 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.112843 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:45:03.112943 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.112770 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:45:03.231118 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.231080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:03.231535 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:03.231205 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:45:03.231535 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:03.231267 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls podName:e915cfae-2400-40f3-a789-72932ee96199 nodeName:}" failed. No retries permitted until 2026-06-11 16:45:05.23124891 +0000 UTC m=+39.612807429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls") pod "dns-default-h8whw" (UID: "e915cfae-2400-40f3-a789-72932ee96199") : secret "dns-default-metrics-tls" not found Jun 11 16:45:03.368782 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.368682 2558 generic.go:356] "Generic (PLEG): container finished" podID="02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8" containerID="845779a725073d1e3cc7086707b41a71be9de774ce6424ce32b2f42badb965d6" exitCode=0 Jun 11 16:45:03.368922 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:03.368768 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" event={"ID":"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8","Type":"ContainerDied","Data":"845779a725073d1e3cc7086707b41a71be9de774ce6424ce32b2f42badb965d6"} Jun 11 16:45:04.374555 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.374359 2558 generic.go:356] "Generic (PLEG): container finished" podID="02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8" containerID="62760e2b77702a81b04073e58e48b1468bdf3c762f59c766343f258db35b3076" exitCode=0 Jun 11 16:45:04.374961 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.374438 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" event={"ID":"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8","Type":"ContainerDied","Data":"62760e2b77702a81b04073e58e48b1468bdf3c762f59c766343f258db35b3076"} Jun 11 16:45:04.455366 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.455330 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9"] Jun 11 16:45:04.473742 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.473679 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" Jun 11 16:45:04.478705 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.478523 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 16:45:04.478705 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.478664 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9"] Jun 11 16:45:04.478886 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.478781 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 16:45:04.479084 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.479020 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4g8fg\"" Jun 11 16:45:04.479235 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.479221 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 16:45:04.479318 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.479260 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 16:45:04.486848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.486826 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz"] Jun 11 16:45:04.509131 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.509109 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz"] Jun 11 16:45:04.509235 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.509196 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.511809 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.511792 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 16:45:04.641561 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.641538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02e45afc-150c-44bc-b030-b856498bc700-klusterlet-config\") pod \"klusterlet-addon-workmgr-86d58fc85c-brblz\" (UID: \"02e45afc-150c-44bc-b030-b856498bc700\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.641652 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.641569 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7gdn\" (UniqueName: \"kubernetes.io/projected/02e45afc-150c-44bc-b030-b856498bc700-kube-api-access-r7gdn\") pod \"klusterlet-addon-workmgr-86d58fc85c-brblz\" (UID: \"02e45afc-150c-44bc-b030-b856498bc700\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.641652 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.641597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-957r2\" (UniqueName: \"kubernetes.io/projected/bc89250c-cc76-42a0-9e25-78515b3b9c48-kube-api-access-957r2\") pod \"managed-serviceaccount-addon-agent-66595d9478-gjsz9\" (UID: \"bc89250c-cc76-42a0-9e25-78515b3b9c48\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" Jun 11 16:45:04.641769 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.641749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc89250c-cc76-42a0-9e25-78515b3b9c48-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66595d9478-gjsz9\" (UID: \"bc89250c-cc76-42a0-9e25-78515b3b9c48\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" Jun 11 16:45:04.641813 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.641776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02e45afc-150c-44bc-b030-b856498bc700-tmp\") pod \"klusterlet-addon-workmgr-86d58fc85c-brblz\" (UID: \"02e45afc-150c-44bc-b030-b856498bc700\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.742944 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.742913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc89250c-cc76-42a0-9e25-78515b3b9c48-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66595d9478-gjsz9\" (UID: \"bc89250c-cc76-42a0-9e25-78515b3b9c48\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" Jun 11 16:45:04.742944 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.742947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02e45afc-150c-44bc-b030-b856498bc700-tmp\") pod \"klusterlet-addon-workmgr-86d58fc85c-brblz\" (UID: \"02e45afc-150c-44bc-b030-b856498bc700\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.743169 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.742984 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02e45afc-150c-44bc-b030-b856498bc700-klusterlet-config\") pod \"klusterlet-addon-workmgr-86d58fc85c-brblz\" (UID: \"02e45afc-150c-44bc-b030-b856498bc700\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.743169 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.743010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gdn\" (UniqueName: \"kubernetes.io/projected/02e45afc-150c-44bc-b030-b856498bc700-kube-api-access-r7gdn\") pod \"klusterlet-addon-workmgr-86d58fc85c-brblz\" (UID: \"02e45afc-150c-44bc-b030-b856498bc700\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.743169 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.743113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-957r2\" (UniqueName: \"kubernetes.io/projected/bc89250c-cc76-42a0-9e25-78515b3b9c48-kube-api-access-957r2\") pod \"managed-serviceaccount-addon-agent-66595d9478-gjsz9\" (UID: \"bc89250c-cc76-42a0-9e25-78515b3b9c48\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" Jun 11 16:45:04.743445 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.743418 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02e45afc-150c-44bc-b030-b856498bc700-tmp\") pod \"klusterlet-addon-workmgr-86d58fc85c-brblz\" (UID: \"02e45afc-150c-44bc-b030-b856498bc700\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.747136 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.747103 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02e45afc-150c-44bc-b030-b856498bc700-klusterlet-config\") pod \"klusterlet-addon-workmgr-86d58fc85c-brblz\" (UID: \"02e45afc-150c-44bc-b030-b856498bc700\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.747245 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.747174 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc89250c-cc76-42a0-9e25-78515b3b9c48-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66595d9478-gjsz9\" (UID: \"bc89250c-cc76-42a0-9e25-78515b3b9c48\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" Jun 11 16:45:04.752495 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.752467 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-957r2\" (UniqueName: \"kubernetes.io/projected/bc89250c-cc76-42a0-9e25-78515b3b9c48-kube-api-access-957r2\") pod \"managed-serviceaccount-addon-agent-66595d9478-gjsz9\" (UID: \"bc89250c-cc76-42a0-9e25-78515b3b9c48\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" Jun 11 16:45:04.752629 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.752520 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7gdn\" (UniqueName: \"kubernetes.io/projected/02e45afc-150c-44bc-b030-b856498bc700-kube-api-access-r7gdn\") pod \"klusterlet-addon-workmgr-86d58fc85c-brblz\" (UID: \"02e45afc-150c-44bc-b030-b856498bc700\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.760633 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.760610 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:04.793856 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.793824 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" Jun 11 16:45:04.817215 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.817188 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:04.865608 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.864643 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:04.954912 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.954839 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9"] Jun 11 16:45:04.958864 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:45:04.958839 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc89250c_cc76_42a0_9e25_78515b3b9c48.slice/crio-5042887b5851c13faa5776e87d2dd9511136a9546740bebf0022fe5f9f779b00 WatchSource:0}: Error finding container 5042887b5851c13faa5776e87d2dd9511136a9546740bebf0022fe5f9f779b00: Status 404 returned error can't find the container with id 5042887b5851c13faa5776e87d2dd9511136a9546740bebf0022fe5f9f779b00 Jun 11 16:45:04.980946 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:04.980919 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz"] Jun 11 16:45:04.984193 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:45:04.984170 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e45afc_150c_44bc_b030_b856498bc700.slice/crio-7bcbd19f8f9e705ee3f4dd5fa51c9d210651afc9126231b0cb25c53001417ea9 WatchSource:0}: Error finding container 7bcbd19f8f9e705ee3f4dd5fa51c9d210651afc9126231b0cb25c53001417ea9: Status 404 returned error can't find the container with id 7bcbd19f8f9e705ee3f4dd5fa51c9d210651afc9126231b0cb25c53001417ea9 Jun 11 16:45:05.013487 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.013430 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:05.119437 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.119405 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:05.246842 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.246811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:05.247000 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:05.246962 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:45:05.247040 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:05.247025 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls podName:e915cfae-2400-40f3-a789-72932ee96199 nodeName:}" failed. No retries permitted until 2026-06-11 16:45:09.247008635 +0000 UTC m=+43.628567149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls") pod "dns-default-h8whw" (UID: "e915cfae-2400-40f3-a789-72932ee96199") : secret "dns-default-metrics-tls" not found Jun 11 16:45:05.379647 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.379610 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" event={"ID":"02ec660b-c2f7-4e1e-9112-9ae70ed6d0f8","Type":"ContainerStarted","Data":"ac8f633545e1530b5e617a40cd85cccb53cabfc38e8510bef0385fcafdd6fada"} Jun 11 16:45:05.381027 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.381002 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jtsv8" event={"ID":"19a845c8-e5c5-4523-96f0-b4cef88ff648","Type":"ContainerStarted","Data":"3aabc96e6508afe10f67cd0ffc7159e8b993afc5ccafe9ff894d8e6e3f538a9f"} Jun 11 16:45:05.382084 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.382060 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" event={"ID":"02e45afc-150c-44bc-b030-b856498bc700","Type":"ContainerStarted","Data":"7bcbd19f8f9e705ee3f4dd5fa51c9d210651afc9126231b0cb25c53001417ea9"} Jun 11 16:45:05.383022 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.383003 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" event={"ID":"bc89250c-cc76-42a0-9e25-78515b3b9c48","Type":"ContainerStarted","Data":"5042887b5851c13faa5776e87d2dd9511136a9546740bebf0022fe5f9f779b00"} Jun 11 16:45:05.406579 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.406539 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7r5rc" podStartSLOduration=9.354744285 podStartE2EDuration="39.406526337s" totalImagesPullingTime="30.051782052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:05.402887985 +0000 UTC m=+39.784446524" watchObservedRunningTime="2026-06-11 16:45:05.406526337 +0000 UTC m=+39.788084872" Jun 11 16:45:05.421184 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.421141 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jtsv8" podStartSLOduration=2.075838661 podStartE2EDuration="4.421128637s" totalImagesPullingTime="2.345289976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:05.420667825 +0000 UTC m=+39.802226361" watchObservedRunningTime="2026-06-11 16:45:05.421128637 +0000 UTC m=+39.802687172" Jun 11 16:45:05.511093 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.510999 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:05.571272 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:05.571212 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:08.862734 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:08.862686 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:08.967058 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:08.967010 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:09.281894 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:09.281859 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:09.282086 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:09.281971 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:45:09.282086 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:09.282024 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls podName:e915cfae-2400-40f3-a789-72932ee96199 nodeName:}" failed. No retries permitted until 2026-06-11 16:45:17.282009762 +0000 UTC m=+51.663568276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls") pod "dns-default-h8whw" (UID: "e915cfae-2400-40f3-a789-72932ee96199") : secret "dns-default-metrics-tls" not found Jun 11 16:45:11.404107 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:11.404070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" event={"ID":"bc89250c-cc76-42a0-9e25-78515b3b9c48","Type":"ContainerStarted","Data":"cd350c4a4769a99711c72d72c34f64ef1cfda23e9d5119e8ac1f7ac9c4b85649"} Jun 11 16:45:11.405671 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:11.405642 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" event={"ID":"02e45afc-150c-44bc-b030-b856498bc700","Type":"ContainerStarted","Data":"2c4e28aea4567769112938b5b0333b57d0e0b1f98520f10990c8e7f4112da256"} Jun 11 16:45:11.405836 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:11.405703 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:11.407369 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:11.407350 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:45:11.433325 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:11.433269 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" podStartSLOduration=1.530400242 podStartE2EDuration="7.433252401s" totalImagesPullingTime="5.902852159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:11.431792823 +0000 UTC m=+45.813351358" watchObservedRunningTime="2026-06-11 16:45:11.433252401 +0000 UTC m=+45.814810936" Jun 11 16:45:17.337290 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:17.337252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:17.337744 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:17.337384 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:45:17.337744 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:17.337440 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls podName:e915cfae-2400-40f3-a789-72932ee96199 nodeName:}" failed. No retries permitted until 2026-06-11 16:45:33.337423451 +0000 UTC m=+67.718981967 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls") pod "dns-default-h8whw" (UID: "e915cfae-2400-40f3-a789-72932ee96199") : secret "dns-default-metrics-tls" not found Jun 11 16:45:27.364214 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:27.364184 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4799k" Jun 11 16:45:27.403206 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:27.403151 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" podStartSLOduration=17.117882658 podStartE2EDuration="23.403135496s" totalImagesPullingTime="6.285252838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:11.454030051 +0000 UTC m=+45.835588586" watchObservedRunningTime="2026-06-11 16:45:27.403135496 +0000 UTC m=+61.784694031" Jun 11 16:45:27.518776 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:27.518744 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:27.617568 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:27.617470 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:27.719157 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:27.719114 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:45:30.935486 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:30.935447 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:45:30.935957 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:30.935558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:45:30.938659 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:30.938640 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:45:30.938659 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:30.938656 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:45:30.945901 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:30.945885 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:45:30.945969 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:30.945957 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs podName:25230cfa-9fff-47b3-bba0-3f4023c53bdc nodeName:}" failed. No retries permitted until 2026-06-11 16:46:34.94593698 +0000 UTC m=+129.327495512 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs") pod "network-metrics-daemon-2hn9p" (UID: "25230cfa-9fff-47b3-bba0-3f4023c53bdc") : secret "metrics-daemon-secret" not found Jun 11 16:45:30.948140 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:30.948119 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e-original-pull-secret\") pod \"global-pull-secret-syncer-7b27n\" (UID: \"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e\") " pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:45:31.028816 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:31.028784 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b27n" Jun 11 16:45:31.036088 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:31.036059 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqz8\" (UniqueName: \"kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8\") pod \"network-check-target-2hkm9\" (UID: \"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413\") " pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:45:31.039078 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:31.039054 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:45:31.048793 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:31.048771 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:45:31.059363 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:31.059335 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkqz8\" (UniqueName: \"kubernetes.io/projected/f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413-kube-api-access-fkqz8\") pod \"network-check-target-2hkm9\" (UID: \"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413\") " pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:45:31.157399 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:31.157361 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7b27n"] Jun 11 16:45:31.160425 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:45:31.160398 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e6dac7_acbb_4dd2_bf07_4fd2bc1df83e.slice/crio-915230ad1af78e2ec05b509bf140117173042c266d8e81a3abb4702447cf34df WatchSource:0}: Error finding container 915230ad1af78e2ec05b509bf140117173042c266d8e81a3abb4702447cf34df: Status 404 returned error can't find the container with id 915230ad1af78e2ec05b509bf140117173042c266d8e81a3abb4702447cf34df Jun 11 16:45:31.338301 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:31.338273 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mwddw\"" Jun 11 16:45:31.346601 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:31.346585 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:45:31.454414 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:31.454382 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7b27n" event={"ID":"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e","Type":"ContainerStarted","Data":"915230ad1af78e2ec05b509bf140117173042c266d8e81a3abb4702447cf34df"} Jun 11 16:45:31.473946 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:31.473921 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2hkm9"] Jun 11 16:45:31.476932 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:45:31.476905 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a77bf2_e9b4_42b1_a12a_18eaa3dcb413.slice/crio-1391210b5ebfe69c211f34a4c478c7060ed0d1de08b06be0bd53d46d79a628c1 WatchSource:0}: Error finding container 1391210b5ebfe69c211f34a4c478c7060ed0d1de08b06be0bd53d46d79a628c1: Status 404 returned error can't find the container with id 1391210b5ebfe69c211f34a4c478c7060ed0d1de08b06be0bd53d46d79a628c1 Jun 11 16:45:32.459181 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:32.459134 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2hkm9" event={"ID":"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413","Type":"ContainerStarted","Data":"1391210b5ebfe69c211f34a4c478c7060ed0d1de08b06be0bd53d46d79a628c1"} Jun 11 16:45:33.352326 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:33.352268 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:45:33.352646 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:33.352454 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:45:33.352646 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:45:33.352524 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls podName:e915cfae-2400-40f3-a789-72932ee96199 nodeName:}" failed. No retries permitted until 2026-06-11 16:46:05.352506057 +0000 UTC m=+99.734064576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls") pod "dns-default-h8whw" (UID: "e915cfae-2400-40f3-a789-72932ee96199") : secret "dns-default-metrics-tls" not found Jun 11 16:45:37.475474 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:37.475434 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7b27n" event={"ID":"70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e","Type":"ContainerStarted","Data":"f5674cb4384a04a0e9c031412addbc6455946427f053417f35cda612451cdc67"} Jun 11 16:45:37.476830 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:37.476808 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2hkm9" event={"ID":"f6a77bf2-e9b4-42b1-a12a-18eaa3dcb413","Type":"ContainerStarted","Data":"30394bfaedb0bbf8b95e8b5c807183278cb8592a02979f2fb1ae52e62ccf8013"} Jun 11 16:45:37.476965 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:37.476945 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:45:37.492421 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:37.492377 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7b27n" podStartSLOduration=65.788277593 podStartE2EDuration="1m11.492364127s" totalImagesPullingTime="5.704086534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:37.491493199 +0000 UTC m=+71.873051733" watchObservedRunningTime="2026-06-11 16:45:37.492364127 +0000 UTC m=+71.873922661" Jun 11 16:45:37.507029 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:45:37.506985 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2hkm9" podStartSLOduration=66.123581425 podStartE2EDuration="1m11.506972056s" totalImagesPullingTime="5.383390631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:45:37.506810857 +0000 UTC m=+71.888369396" watchObservedRunningTime="2026-06-11 16:45:37.506972056 +0000 UTC m=+71.888530575" Jun 11 16:46:05.361564 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:46:05.361533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:46:05.361962 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:46:05.361683 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:46:05.361962 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:46:05.361797 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls podName:e915cfae-2400-40f3-a789-72932ee96199 nodeName:}" failed. No retries permitted until 2026-06-11 16:47:09.361775108 +0000 UTC m=+163.743333625 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls") pod "dns-default-h8whw" (UID: "e915cfae-2400-40f3-a789-72932ee96199") : secret "dns-default-metrics-tls" not found Jun 11 16:46:08.482233 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:46:08.482197 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2hkm9" Jun 11 16:46:34.965217 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:46:34.965158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:46:34.965835 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:46:34.965327 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:46:34.965835 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:46:34.965437 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs podName:25230cfa-9fff-47b3-bba0-3f4023c53bdc nodeName:}" failed. No retries permitted until 2026-06-11 16:48:36.965416508 +0000 UTC m=+251.346975025 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs") pod "network-metrics-daemon-2hn9p" (UID: "25230cfa-9fff-47b3-bba0-3f4023c53bdc") : secret "metrics-daemon-secret" not found Jun 11 16:47:04.483062 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:47:04.483010 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h8whw" podUID="e915cfae-2400-40f3-a789-72932ee96199" Jun 11 16:47:04.725370 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:04.725340 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8whw" Jun 11 16:47:06.121436 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:47:06.121353 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:47:09.406180 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:09.406142 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:47:09.406568 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:47:09.406264 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:47:09.406568 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:47:09.406317 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls podName:e915cfae-2400-40f3-a789-72932ee96199 nodeName:}" failed. No retries permitted until 2026-06-11 16:49:11.406303881 +0000 UTC m=+285.787862394 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls") pod "dns-default-h8whw" (UID: "e915cfae-2400-40f3-a789-72932ee96199") : secret "dns-default-metrics-tls" not found Jun 11 16:47:11.406224 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:11.406187 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" podUID="02e45afc-150c-44bc-b030-b856498bc700" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.9:8000/readyz\": dial tcp 10.134.0.9:8000: connect: connection refused" Jun 11 16:47:11.745702 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:11.745668 2558 generic.go:356] "Generic (PLEG): container finished" podID="bc89250c-cc76-42a0-9e25-78515b3b9c48" containerID="cd350c4a4769a99711c72d72c34f64ef1cfda23e9d5119e8ac1f7ac9c4b85649" exitCode=255 Jun 11 16:47:11.745873 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:11.745743 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" event={"ID":"bc89250c-cc76-42a0-9e25-78515b3b9c48","Type":"ContainerDied","Data":"cd350c4a4769a99711c72d72c34f64ef1cfda23e9d5119e8ac1f7ac9c4b85649"} Jun 11 16:47:11.747178 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:11.747156 2558 generic.go:356] "Generic (PLEG): container finished" podID="02e45afc-150c-44bc-b030-b856498bc700" containerID="2c4e28aea4567769112938b5b0333b57d0e0b1f98520f10990c8e7f4112da256" exitCode=1 Jun 11 16:47:11.747300 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:11.747209 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" event={"ID":"02e45afc-150c-44bc-b030-b856498bc700","Type":"ContainerDied","Data":"2c4e28aea4567769112938b5b0333b57d0e0b1f98520f10990c8e7f4112da256"} Jun 11 16:47:11.747538 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:11.747523 2558 scope.go:117] "RemoveContainer" containerID="2c4e28aea4567769112938b5b0333b57d0e0b1f98520f10990c8e7f4112da256" Jun 11 16:47:11.751824 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:11.751811 2558 scope.go:117] "RemoveContainer" containerID="cd350c4a4769a99711c72d72c34f64ef1cfda23e9d5119e8ac1f7ac9c4b85649" Jun 11 16:47:12.752139 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:12.752106 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" event={"ID":"bc89250c-cc76-42a0-9e25-78515b3b9c48","Type":"ContainerStarted","Data":"ca175102b33eda55d955f8e230515f113d4f6285d23207c41a9f57f7c0002164"} Jun 11 16:47:12.753698 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:12.753675 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" event={"ID":"02e45afc-150c-44bc-b030-b856498bc700","Type":"ContainerStarted","Data":"5d39b55a03a4f96270843c9d57af820ddb318ff6a681e8680a7706e9393385f1"} Jun 11 16:47:12.753941 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:12.753926 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:47:12.754497 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:12.754482 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:47:19.109320 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:19.109288 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:47:48.824130 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:48.824079 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:47:50.304771 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:47:50.304707 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:09.147996 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:09.147963 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:30.784169 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.784109 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld"] Jun 11 16:48:30.787266 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.787244 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c"] Jun 11 16:48:30.787459 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.787360 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:30.790077 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.790059 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:30.791184 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.791167 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:48:30.793935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.793914 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-87nxf"] Jun 11 16:48:30.796538 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.796517 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-99f9g"] Jun 11 16:48:30.796673 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.796633 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:30.796673 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.796645 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 16:48:30.796673 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.796522 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 16:48:30.796857 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.796691 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qbbpf\"" Jun 11 16:48:30.799350 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.799333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:30.802382 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.802362 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 16:48:30.803930 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.803911 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 16:48:30.804046 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.803980 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 16:48:30.804117 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.804060 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:48:30.804201 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.804182 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 16:48:30.804310 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.804257 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:48:30.804756 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.804737 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 16:48:30.804847 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.804806 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 16:48:30.805063 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.805046 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:48:30.805158 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.805139 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fjgh5\"" Jun 11 16:48:30.805219 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.805055 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 16:48:30.805370 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.805353 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:48:30.805433 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.805398 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pz4vf\"" Jun 11 16:48:30.805484 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.805442 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 16:48:30.805544 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.805526 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:48:30.805671 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.805649 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q7j8b\"" Jun 11 16:48:30.806000 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.805983 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld"] Jun 11 16:48:30.811290 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.811271 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 16:48:30.812086 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.812072 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 16:48:30.816701 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.816681 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c"] Jun 11 16:48:30.823926 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.823906 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-99f9g"] Jun 11 16:48:30.853199 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.853170 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-87nxf"] Jun 11 16:48:30.961543 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msclc\" (UniqueName: \"kubernetes.io/projected/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-kube-api-access-msclc\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:30.961543 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961543 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68ab36b6-32a0-4669-b9c1-115829e40bd1-serving-cert\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:30.961840 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961563 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-serving-cert\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:30.961840 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961620 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc74bc96-466b-4a41-a6a5-43990fa60108-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-mxm4c\" (UID: \"fc74bc96-466b-4a41-a6a5-43990fa60108\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:30.961840 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc74bc96-466b-4a41-a6a5-43990fa60108-config\") pod \"service-ca-operator-6bc5ff68f5-mxm4c\" (UID: \"fc74bc96-466b-4a41-a6a5-43990fa60108\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:30.961840 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961740 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdf67\" (UniqueName: \"kubernetes.io/projected/fc74bc96-466b-4a41-a6a5-43990fa60108-kube-api-access-cdf67\") pod \"service-ca-operator-6bc5ff68f5-mxm4c\" (UID: \"fc74bc96-466b-4a41-a6a5-43990fa60108\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:30.961840 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961774 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ab36b6-32a0-4669-b9c1-115829e40bd1-service-ca-bundle\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:30.961840 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-config\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:30.962190 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzvqw\" (UniqueName: \"kubernetes.io/projected/68ab36b6-32a0-4669-b9c1-115829e40bd1-kube-api-access-xzvqw\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:30.962190 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cwpv\" (UniqueName: \"kubernetes.io/projected/4bfc1750-3b96-42e9-8c54-3b55c422781a-kube-api-access-4cwpv\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:30.962190 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961941 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:30.962190 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ab36b6-32a0-4669-b9c1-115829e40bd1-trusted-ca-bundle\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:30.962190 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.961994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ab36b6-32a0-4669-b9c1-115829e40bd1-tmp\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:30.962190 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.962016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68ab36b6-32a0-4669-b9c1-115829e40bd1-snapshots\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:30.962190 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.962056 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4bfc1750-3b96-42e9-8c54-3b55c422781a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:30.962190 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:30.962081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-trusted-ca\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:31.063005 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.062892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzvqw\" (UniqueName: \"kubernetes.io/projected/68ab36b6-32a0-4669-b9c1-115829e40bd1-kube-api-access-xzvqw\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.063005 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.062952 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cwpv\" (UniqueName: \"kubernetes.io/projected/4bfc1750-3b96-42e9-8c54-3b55c422781a-kube-api-access-4cwpv\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:31.063005 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.062971 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:31.063005 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.062989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ab36b6-32a0-4669-b9c1-115829e40bd1-trusted-ca-bundle\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.063005 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ab36b6-32a0-4669-b9c1-115829e40bd1-tmp\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.063354 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063022 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68ab36b6-32a0-4669-b9c1-115829e40bd1-snapshots\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.063354 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:31.063112 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:48:31.063354 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063207 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4bfc1750-3b96-42e9-8c54-3b55c422781a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:31.063354 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:31.063228 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls podName:4bfc1750-3b96-42e9-8c54-3b55c422781a nodeName:}" failed. No retries permitted until 2026-06-11 16:48:31.563205695 +0000 UTC m=+245.944764213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qk6ld" (UID: "4bfc1750-3b96-42e9-8c54-3b55c422781a") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:48:31.063354 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063270 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-trusted-ca\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:31.063354 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msclc\" (UniqueName: \"kubernetes.io/projected/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-kube-api-access-msclc\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:31.063354 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063332 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68ab36b6-32a0-4669-b9c1-115829e40bd1-serving-cert\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.063697 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063358 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-serving-cert\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:31.063697 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc74bc96-466b-4a41-a6a5-43990fa60108-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-mxm4c\" (UID: \"fc74bc96-466b-4a41-a6a5-43990fa60108\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:31.063697 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063422 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc74bc96-466b-4a41-a6a5-43990fa60108-config\") pod \"service-ca-operator-6bc5ff68f5-mxm4c\" (UID: \"fc74bc96-466b-4a41-a6a5-43990fa60108\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:31.063697 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdf67\" (UniqueName: \"kubernetes.io/projected/fc74bc96-466b-4a41-a6a5-43990fa60108-kube-api-access-cdf67\") pod \"service-ca-operator-6bc5ff68f5-mxm4c\" (UID: \"fc74bc96-466b-4a41-a6a5-43990fa60108\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:31.063697 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063499 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ab36b6-32a0-4669-b9c1-115829e40bd1-service-ca-bundle\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.063697 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-config\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:31.063697 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.063639 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68ab36b6-32a0-4669-b9c1-115829e40bd1-tmp\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.064076 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.064021 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ab36b6-32a0-4669-b9c1-115829e40bd1-trusted-ca-bundle\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.064076 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.064033 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4bfc1750-3b96-42e9-8c54-3b55c422781a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:31.064234 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.064212 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-config\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:31.064290 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.064251 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-trusted-ca\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:31.064523 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.064488 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc74bc96-466b-4a41-a6a5-43990fa60108-config\") pod \"service-ca-operator-6bc5ff68f5-mxm4c\" (UID: \"fc74bc96-466b-4a41-a6a5-43990fa60108\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:31.064646 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.064502 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ab36b6-32a0-4669-b9c1-115829e40bd1-service-ca-bundle\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.064646 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.064541 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68ab36b6-32a0-4669-b9c1-115829e40bd1-snapshots\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.065871 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.065853 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68ab36b6-32a0-4669-b9c1-115829e40bd1-serving-cert\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.066151 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.066132 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc74bc96-466b-4a41-a6a5-43990fa60108-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-mxm4c\" (UID: \"fc74bc96-466b-4a41-a6a5-43990fa60108\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:31.066373 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.066357 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-serving-cert\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:31.073258 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.073236 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzvqw\" (UniqueName: \"kubernetes.io/projected/68ab36b6-32a0-4669-b9c1-115829e40bd1-kube-api-access-xzvqw\") pod \"insights-operator-896549976-99f9g\" (UID: \"68ab36b6-32a0-4669-b9c1-115829e40bd1\") " pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.078594 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.078575 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msclc\" (UniqueName: \"kubernetes.io/projected/c8239c37-9dc5-4cf2-bee3-047a6eb79bae-kube-api-access-msclc\") pod \"console-operator-668fdbf85c-87nxf\" (UID: \"c8239c37-9dc5-4cf2-bee3-047a6eb79bae\") " pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:31.078756 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.078735 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cwpv\" (UniqueName: \"kubernetes.io/projected/4bfc1750-3b96-42e9-8c54-3b55c422781a-kube-api-access-4cwpv\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:31.078756 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.078747 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdf67\" (UniqueName: \"kubernetes.io/projected/fc74bc96-466b-4a41-a6a5-43990fa60108-kube-api-access-cdf67\") pod \"service-ca-operator-6bc5ff68f5-mxm4c\" (UID: \"fc74bc96-466b-4a41-a6a5-43990fa60108\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:31.104670 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.104648 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" Jun 11 16:48:31.111817 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.111796 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:31.113899 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.113855 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:31.116566 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.116549 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-99f9g" Jun 11 16:48:31.233535 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.233493 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:31.259503 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.259473 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c"] Jun 11 16:48:31.262441 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:48:31.262416 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc74bc96_466b_4a41_a6a5_43990fa60108.slice/crio-e8cfae9af6077197251afee7aab1634e84e3c685d1c67d836dce561dc039b44b WatchSource:0}: Error finding container e8cfae9af6077197251afee7aab1634e84e3c685d1c67d836dce561dc039b44b: Status 404 returned error can't find the container with id e8cfae9af6077197251afee7aab1634e84e3c685d1c67d836dce561dc039b44b Jun 11 16:48:31.270705 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.270683 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-87nxf"] Jun 11 16:48:31.273207 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:48:31.273187 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8239c37_9dc5_4cf2_bee3_047a6eb79bae.slice/crio-fee875d8c2fa5b0dbf06e12031d7f42453efd531ebe6409c9eb8af5cfd4545b1 WatchSource:0}: Error finding container fee875d8c2fa5b0dbf06e12031d7f42453efd531ebe6409c9eb8af5cfd4545b1: Status 404 returned error can't find the container with id fee875d8c2fa5b0dbf06e12031d7f42453efd531ebe6409c9eb8af5cfd4545b1 Jun 11 16:48:31.295765 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.295741 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-99f9g"] Jun 11 16:48:31.297895 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:48:31.297866 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ab36b6_32a0_4669_b9c1_115829e40bd1.slice/crio-5beeeea9aba1dedb96b6fe75b09ac844a117ce3ca0b7178b7b038be25d64aed1 WatchSource:0}: Error finding container 5beeeea9aba1dedb96b6fe75b09ac844a117ce3ca0b7178b7b038be25d64aed1: Status 404 returned error can't find the container with id 5beeeea9aba1dedb96b6fe75b09ac844a117ce3ca0b7178b7b038be25d64aed1 Jun 11 16:48:31.569404 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.569366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:31.569583 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:31.569517 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:48:31.569583 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:31.569581 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls podName:4bfc1750-3b96-42e9-8c54-3b55c422781a nodeName:}" failed. No retries permitted until 2026-06-11 16:48:32.569563845 +0000 UTC m=+246.951122358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qk6ld" (UID: "4bfc1750-3b96-42e9-8c54-3b55c422781a") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:48:31.977823 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.975571 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-99f9g" event={"ID":"68ab36b6-32a0-4669-b9c1-115829e40bd1","Type":"ContainerStarted","Data":"5beeeea9aba1dedb96b6fe75b09ac844a117ce3ca0b7178b7b038be25d64aed1"} Jun 11 16:48:31.981478 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.978711 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" event={"ID":"c8239c37-9dc5-4cf2-bee3-047a6eb79bae","Type":"ContainerStarted","Data":"fee875d8c2fa5b0dbf06e12031d7f42453efd531ebe6409c9eb8af5cfd4545b1"} Jun 11 16:48:31.983602 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:31.983574 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" event={"ID":"fc74bc96-466b-4a41-a6a5-43990fa60108","Type":"ContainerStarted","Data":"e8cfae9af6077197251afee7aab1634e84e3c685d1c67d836dce561dc039b44b"} Jun 11 16:48:32.496806 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:32.496771 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:32.577800 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:32.577763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:32.577983 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:32.577935 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:48:32.578042 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:32.578020 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls podName:4bfc1750-3b96-42e9-8c54-3b55c422781a nodeName:}" failed. No retries permitted until 2026-06-11 16:48:34.577998155 +0000 UTC m=+248.959556686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qk6ld" (UID: "4bfc1750-3b96-42e9-8c54-3b55c422781a") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:48:32.597230 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:32.597202 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:34.480247 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:34.480214 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:34.570130 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:34.570048 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:34.596161 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:34.596136 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:34.596326 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:34.596308 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:48:34.596392 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:34.596382 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls podName:4bfc1750-3b96-42e9-8c54-3b55c422781a nodeName:}" failed. No retries permitted until 2026-06-11 16:48:38.5963628 +0000 UTC m=+252.977921320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qk6ld" (UID: "4bfc1750-3b96-42e9-8c54-3b55c422781a") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:48:34.669019 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:34.668986 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:34.994217 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:34.994180 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-99f9g" event={"ID":"68ab36b6-32a0-4669-b9c1-115829e40bd1","Type":"ContainerStarted","Data":"6f00064342319a34444d30e7032562e916e4fcc2d822cf1c0db87d4c16bf3db3"} Jun 11 16:48:34.995874 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:34.995853 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/0.log" Jun 11 16:48:34.995981 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:34.995891 2558 generic.go:356] "Generic (PLEG): container finished" podID="c8239c37-9dc5-4cf2-bee3-047a6eb79bae" containerID="923649625e2e3703f94b44b043729868bf3f8f4255526c0341e262872de2fd2a" exitCode=255 Jun 11 16:48:34.995981 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:34.995965 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" event={"ID":"c8239c37-9dc5-4cf2-bee3-047a6eb79bae","Type":"ContainerDied","Data":"923649625e2e3703f94b44b043729868bf3f8f4255526c0341e262872de2fd2a"} Jun 11 16:48:34.996173 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:34.996158 2558 scope.go:117] "RemoveContainer" containerID="923649625e2e3703f94b44b043729868bf3f8f4255526c0341e262872de2fd2a" Jun 11 16:48:34.997378 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:34.997349 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" event={"ID":"fc74bc96-466b-4a41-a6a5-43990fa60108","Type":"ContainerStarted","Data":"f7b8a99f783f2d54df757f7d5ce17deb09cf47e313357127953515e45a9260c9"} Jun 11 16:48:35.016984 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:35.016935 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-99f9g" podStartSLOduration=2.031378246 podStartE2EDuration="5.016916458s" totalImagesPullingTime="2.985538212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:35.015192717 +0000 UTC m=+249.396751253" watchObservedRunningTime="2026-06-11 16:48:35.016916458 +0000 UTC m=+249.398474993" Jun 11 16:48:35.035818 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:35.035764 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" podStartSLOduration=2.01019117 podStartE2EDuration="5.03574108s" totalImagesPullingTime="3.02554991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:35.034568857 +0000 UTC m=+249.416127399" watchObservedRunningTime="2026-06-11 16:48:35.03574108 +0000 UTC m=+249.417299613" Jun 11 16:48:35.416125 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:35.416040 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:35.482057 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:35.482027 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:35.740205 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:35.740168 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:35.840148 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:35.840118 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:35.906635 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:35.906604 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:36.002246 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:36.002176 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 16:48:36.002547 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:36.002534 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/0.log" Jun 11 16:48:36.002590 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:36.002566 2558 generic.go:356] "Generic (PLEG): container finished" podID="c8239c37-9dc5-4cf2-bee3-047a6eb79bae" containerID="fa6c431739001c9d18c44b11184fe9a178478f36bee58a7a499d2e5172ce3cd5" exitCode=255 Jun 11 16:48:36.002648 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:36.002634 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" event={"ID":"c8239c37-9dc5-4cf2-bee3-047a6eb79bae","Type":"ContainerDied","Data":"fa6c431739001c9d18c44b11184fe9a178478f36bee58a7a499d2e5172ce3cd5"} Jun 11 16:48:36.002705 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:36.002675 2558 scope.go:117] "RemoveContainer" containerID="923649625e2e3703f94b44b043729868bf3f8f4255526c0341e262872de2fd2a" Jun 11 16:48:36.002913 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:36.002893 2558 scope.go:117] "RemoveContainer" containerID="fa6c431739001c9d18c44b11184fe9a178478f36bee58a7a499d2e5172ce3cd5" Jun 11 16:48:36.003105 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:36.003082 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-87nxf_openshift-console-operator(c8239c37-9dc5-4cf2-bee3-047a6eb79bae)\"" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" podUID="c8239c37-9dc5-4cf2-bee3-047a6eb79bae" Jun 11 16:48:36.135167 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:36.135133 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:36.235997 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:36.235962 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:36.480030 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:36.480000 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:36.580965 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:36.580931 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:37.006907 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.006882 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 16:48:37.007237 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.007222 2558 scope.go:117] "RemoveContainer" containerID="fa6c431739001c9d18c44b11184fe9a178478f36bee58a7a499d2e5172ce3cd5" Jun 11 16:48:37.007441 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:37.007422 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-87nxf_openshift-console-operator(c8239c37-9dc5-4cf2-bee3-047a6eb79bae)\"" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" podUID="c8239c37-9dc5-4cf2-bee3-047a6eb79bae" Jun 11 16:48:37.012751 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.012729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:48:37.012848 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:37.012832 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:48:37.012922 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:37.012910 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs podName:25230cfa-9fff-47b3-bba0-3f4023c53bdc nodeName:}" failed. No retries permitted until 2026-06-11 16:50:39.012889564 +0000 UTC m=+373.394448082 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs") pod "network-metrics-daemon-2hn9p" (UID: "25230cfa-9fff-47b3-bba0-3f4023c53bdc") : secret "metrics-daemon-secret" not found Jun 11 16:48:37.720021 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.719984 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-fq96g"] Jun 11 16:48:37.724067 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.724051 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:37.727046 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.727019 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 16:48:37.727336 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.727311 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 16:48:37.727440 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.727311 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 16:48:37.728267 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.728252 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 16:48:37.728488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.728471 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kbv2k\"" Jun 11 16:48:37.740923 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.740902 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-fq96g"] Jun 11 16:48:37.790460 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.790427 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:37.818432 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.818402 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/92c17750-98ed-4aa5-a1a3-ab884cf257ef-signing-key\") pod \"service-ca-7d74d578b8-fq96g\" (UID: \"92c17750-98ed-4aa5-a1a3-ab884cf257ef\") " pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:37.818576 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.818441 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5z26\" (UniqueName: \"kubernetes.io/projected/92c17750-98ed-4aa5-a1a3-ab884cf257ef-kube-api-access-p5z26\") pod \"service-ca-7d74d578b8-fq96g\" (UID: \"92c17750-98ed-4aa5-a1a3-ab884cf257ef\") " pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:37.818576 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.818521 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/92c17750-98ed-4aa5-a1a3-ab884cf257ef-signing-cabundle\") pod \"service-ca-7d74d578b8-fq96g\" (UID: \"92c17750-98ed-4aa5-a1a3-ab884cf257ef\") " pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:37.850690 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.850659 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:37.919677 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.919644 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/92c17750-98ed-4aa5-a1a3-ab884cf257ef-signing-key\") pod \"service-ca-7d74d578b8-fq96g\" (UID: \"92c17750-98ed-4aa5-a1a3-ab884cf257ef\") " pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:37.919677 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.919679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5z26\" (UniqueName: \"kubernetes.io/projected/92c17750-98ed-4aa5-a1a3-ab884cf257ef-kube-api-access-p5z26\") pod \"service-ca-7d74d578b8-fq96g\" (UID: \"92c17750-98ed-4aa5-a1a3-ab884cf257ef\") " pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:37.919933 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.919788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/92c17750-98ed-4aa5-a1a3-ab884cf257ef-signing-cabundle\") pod \"service-ca-7d74d578b8-fq96g\" (UID: \"92c17750-98ed-4aa5-a1a3-ab884cf257ef\") " pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:37.920422 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.920405 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/92c17750-98ed-4aa5-a1a3-ab884cf257ef-signing-cabundle\") pod \"service-ca-7d74d578b8-fq96g\" (UID: \"92c17750-98ed-4aa5-a1a3-ab884cf257ef\") " pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:37.922048 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.922027 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/92c17750-98ed-4aa5-a1a3-ab884cf257ef-signing-key\") pod \"service-ca-7d74d578b8-fq96g\" (UID: \"92c17750-98ed-4aa5-a1a3-ab884cf257ef\") " pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:37.928372 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:37.928343 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5z26\" (UniqueName: \"kubernetes.io/projected/92c17750-98ed-4aa5-a1a3-ab884cf257ef-kube-api-access-p5z26\") pod \"service-ca-7d74d578b8-fq96g\" (UID: \"92c17750-98ed-4aa5-a1a3-ab884cf257ef\") " pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:38.032658 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:38.032625 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" Jun 11 16:48:38.156343 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:38.156316 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-fq96g"] Jun 11 16:48:38.158921 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:48:38.158891 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c17750_98ed_4aa5_a1a3_ab884cf257ef.slice/crio-4c1db71211c4591f4204b99508d42f14bded266919471e4e8116a5b09b258b4d WatchSource:0}: Error finding container 4c1db71211c4591f4204b99508d42f14bded266919471e4e8116a5b09b258b4d: Status 404 returned error can't find the container with id 4c1db71211c4591f4204b99508d42f14bded266919471e4e8116a5b09b258b4d Jun 11 16:48:38.252815 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:38.252783 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9p8bj_c5c8209e-966a-4d35-9f72-5075e2cca944/dns-node-resolver/0.log" Jun 11 16:48:38.624989 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:38.624930 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:38.625217 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:38.625104 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 16:48:38.625217 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:38.625191 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls podName:4bfc1750-3b96-42e9-8c54-3b55c422781a nodeName:}" failed. No retries permitted until 2026-06-11 16:48:46.625170753 +0000 UTC m=+261.006729278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qk6ld" (UID: "4bfc1750-3b96-42e9-8c54-3b55c422781a") : secret "cluster-monitoring-operator-tls" not found Jun 11 16:48:38.899598 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:38.899516 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:39.015283 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:39.015242 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" event={"ID":"92c17750-98ed-4aa5-a1a3-ab884cf257ef","Type":"ContainerStarted","Data":"68cd6624b4c6da7e8f2138692ab1c8eb0e7ad9439f783314b8866adb6a5c7060"} Jun 11 16:48:39.015472 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:39.015305 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" event={"ID":"92c17750-98ed-4aa5-a1a3-ab884cf257ef","Type":"ContainerStarted","Data":"4c1db71211c4591f4204b99508d42f14bded266919471e4e8116a5b09b258b4d"} Jun 11 16:48:39.034470 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:39.034423 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-fq96g" podStartSLOduration=2.034407572 podStartE2EDuration="2.034407572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:39.033746168 +0000 UTC m=+253.415304702" watchObservedRunningTime="2026-06-11 16:48:39.034407572 +0000 UTC m=+253.415966106" Jun 11 16:48:39.108403 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:39.108370 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:39.225615 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:39.225586 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:39.326524 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:39.326489 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:39.459549 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:39.459515 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fgzxb_d5dafdd3-b1a0-40bd-8144-6839cf079de0/node-ca/0.log" Jun 11 16:48:39.460176 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:39.460152 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:39.990198 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:39.990167 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:40.463231 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:40.463151 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jtsv8_19a845c8-e5c5-4523-96f0-b4cef88ff648/serve-healthcheck-canary/0.log" Jun 11 16:48:40.600769 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:40.600736 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:40.988791 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:40.988754 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:41.112257 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:41.112225 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:41.112648 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:41.112285 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:41.112648 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:41.112612 2558 scope.go:117] "RemoveContainer" containerID="fa6c431739001c9d18c44b11184fe9a178478f36bee58a7a499d2e5172ce3cd5" Jun 11 16:48:41.112799 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:48:41.112781 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-87nxf_openshift-console-operator(c8239c37-9dc5-4cf2-bee3-047a6eb79bae)\"" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" podUID="c8239c37-9dc5-4cf2-bee3-047a6eb79bae" Jun 11 16:48:41.185135 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:41.185101 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:41.398744 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:41.398639 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:41.882000 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:41.881966 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:41.983360 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:41.983327 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:42.584040 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:42.584012 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:42.685163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:42.685132 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:42.798328 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:42.798299 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:42.991168 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:42.991137 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:43.067427 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:43.067394 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:43.191927 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:43.191894 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:43.359554 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:43.359465 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:43.419350 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:43.419320 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:44.584966 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:44.584933 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:44.786736 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:44.786692 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:44.985334 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:44.985300 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:45.192939 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:45.192905 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:45.384174 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:45.384096 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:45.602729 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:45.602671 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:46.588372 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:46.588338 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:46.688020 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:46.687985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:46.690538 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:46.690504 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bfc1750-3b96-42e9-8c54-3b55c422781a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qk6ld\" (UID: \"4bfc1750-3b96-42e9-8c54-3b55c422781a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:46.697267 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:46.697245 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" Jun 11 16:48:46.797253 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:46.797225 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:46.829210 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:46.829180 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld"] Jun 11 16:48:46.832329 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:48:46.832298 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfc1750_3b96_42e9_8c54_3b55c422781a.slice/crio-d6a850eba0bc917c0095164a122e430a5c2302b56e29592a469d8ee2cc745790 WatchSource:0}: Error finding container d6a850eba0bc917c0095164a122e430a5c2302b56e29592a469d8ee2cc745790: Status 404 returned error can't find the container with id d6a850eba0bc917c0095164a122e430a5c2302b56e29592a469d8ee2cc745790 Jun 11 16:48:46.989389 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:46.989363 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:47.041818 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:47.041787 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" event={"ID":"4bfc1750-3b96-42e9-8c54-3b55c422781a","Type":"ContainerStarted","Data":"d6a850eba0bc917c0095164a122e430a5c2302b56e29592a469d8ee2cc745790"} Jun 11 16:48:47.203641 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:47.203603 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:47.393555 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:47.393457 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:47.474210 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:47.474167 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:48.386933 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:48.386906 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:48.751486 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:48.751456 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:48.852973 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:48.852942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:48.953014 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:48.952978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:49.021332 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:49.021260 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:49.049970 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:49.049938 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" event={"ID":"4bfc1750-3b96-42e9-8c54-3b55c422781a","Type":"ContainerStarted","Data":"f60c68599c784a782a89457e652b24cfbe6e75d96914a3eac9ca9fbc687cc444"} Jun 11 16:48:49.068896 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:49.068851 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qk6ld" podStartSLOduration=17.545037355 podStartE2EDuration="19.068836145s" totalImagesPullingTime="1.52379879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:49.068011315 +0000 UTC m=+263.449569852" watchObservedRunningTime="2026-06-11 16:48:49.068836145 +0000 UTC m=+263.450394679" Jun 11 16:48:49.194254 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:49.194213 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:49.382517 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:49.382440 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:49.984326 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:49.984299 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:50.195790 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:50.195759 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:51.395115 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:51.395085 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:53.109441 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:53.109416 2558 scope.go:117] "RemoveContainer" containerID="fa6c431739001c9d18c44b11184fe9a178478f36bee58a7a499d2e5172ce3cd5" Jun 11 16:48:53.976165 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:53.976128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:54.065959 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:54.065933 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 16:48:54.066123 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:54.065979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" event={"ID":"c8239c37-9dc5-4cf2-bee3-047a6eb79bae","Type":"ContainerStarted","Data":"813a7a48367d2c80d473850395ec29728655576096c86387ea2244598269c28a"} Jun 11 16:48:54.066262 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:54.066244 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:54.070693 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:54.070671 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" Jun 11 16:48:54.092683 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:54.092656 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:54.103057 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:54.103004 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-87nxf" podStartSLOduration=21.087097332 podStartE2EDuration="24.102990626s" totalImagesPullingTime="3.015893294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:48:54.10223918 +0000 UTC m=+268.483797715" watchObservedRunningTime="2026-06-11 16:48:54.102990626 +0000 UTC m=+268.484549194" Jun 11 16:48:54.171665 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:54.171636 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:54.272547 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:54.272457 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:54.456279 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:54.456248 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:54.526611 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:54.526520 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:55.072955 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:55.072919 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:55.379120 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:55.379039 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:55.479330 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:55.479297 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:55.684176 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:55.684101 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:55.754431 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:55.754398 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:55.894981 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:55.894950 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:55.991548 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:55.991501 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:48:56.078859 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:48:56.078832 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:01.860814 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.860772 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-98xmm"] Jun 11 16:49:01.865015 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.864992 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:01.870751 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.868421 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:49:01.870751 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.868497 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4vcj6\"" Jun 11 16:49:01.872531 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.872505 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:49:01.884532 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.884504 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-98xmm"] Jun 11 16:49:01.900554 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.900513 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47246775-d162-4106-901d-0e510ebe3c36-data-volume\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:01.900743 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.900572 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47246775-d162-4106-901d-0e510ebe3c36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:01.900743 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.900644 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kkf6\" (UniqueName: \"kubernetes.io/projected/47246775-d162-4106-901d-0e510ebe3c36-kube-api-access-7kkf6\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:01.900743 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.900684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47246775-d162-4106-901d-0e510ebe3c36-crio-socket\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:01.900854 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.900755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47246775-d162-4106-901d-0e510ebe3c36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:01.938457 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.938417 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-sll6m"] Jun 11 16:49:01.941492 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.941471 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-sll6m" Jun 11 16:49:01.950517 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.950495 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:49:01.950655 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.950567 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:49:01.953038 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.953018 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dqxfr\"" Jun 11 16:49:01.968933 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:01.968902 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-sll6m"] Jun 11 16:49:02.001827 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.001794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47246775-d162-4106-901d-0e510ebe3c36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.001987 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.001835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngzvx\" (UniqueName: \"kubernetes.io/projected/f40369d7-b678-4803-b347-cbdbc6b6c2d1-kube-api-access-ngzvx\") pod \"downloads-6657875f97-sll6m\" (UID: \"f40369d7-b678-4803-b347-cbdbc6b6c2d1\") " pod="openshift-console/downloads-6657875f97-sll6m" Jun 11 16:49:02.001987 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.001861 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47246775-d162-4106-901d-0e510ebe3c36-data-volume\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.001987 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.001902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47246775-d162-4106-901d-0e510ebe3c36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.001987 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.001924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kkf6\" (UniqueName: \"kubernetes.io/projected/47246775-d162-4106-901d-0e510ebe3c36-kube-api-access-7kkf6\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.001987 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.001954 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47246775-d162-4106-901d-0e510ebe3c36-crio-socket\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.002179 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.002060 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47246775-d162-4106-901d-0e510ebe3c36-crio-socket\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.002285 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.002261 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47246775-d162-4106-901d-0e510ebe3c36-data-volume\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.002535 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.002515 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47246775-d162-4106-901d-0e510ebe3c36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.004317 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.004296 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47246775-d162-4106-901d-0e510ebe3c36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.019596 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.019561 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kkf6\" (UniqueName: \"kubernetes.io/projected/47246775-d162-4106-901d-0e510ebe3c36-kube-api-access-7kkf6\") pod \"insights-runtime-extractor-98xmm\" (UID: \"47246775-d162-4106-901d-0e510ebe3c36\") " pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.033479 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.033452 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bcd958576-2rhbg"] Jun 11 16:49:02.036710 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.036694 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.043297 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.043282 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 16:49:02.043819 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.043797 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fsrsr\"" Jun 11 16:49:02.043905 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.043860 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 16:49:02.043905 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.043873 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 16:49:02.050194 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.050173 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:02.050891 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.050874 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 16:49:02.056830 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.056803 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bcd958576-2rhbg"] Jun 11 16:49:02.102816 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.102790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75448089-e93b-4b6f-a4d4-da4e732e6304-image-registry-private-configuration\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.103005 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.102823 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75448089-e93b-4b6f-a4d4-da4e732e6304-trusted-ca\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.103005 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.102847 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5g7\" (UniqueName: \"kubernetes.io/projected/75448089-e93b-4b6f-a4d4-da4e732e6304-kube-api-access-gp5g7\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.103005 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.102914 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75448089-e93b-4b6f-a4d4-da4e732e6304-registry-tls\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.103005 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.102951 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75448089-e93b-4b6f-a4d4-da4e732e6304-installation-pull-secrets\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.103005 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.102985 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75448089-e93b-4b6f-a4d4-da4e732e6304-bound-sa-token\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.103201 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.103015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75448089-e93b-4b6f-a4d4-da4e732e6304-registry-certificates\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.103201 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.103045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75448089-e93b-4b6f-a4d4-da4e732e6304-ca-trust-extracted\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.103201 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.103067 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngzvx\" (UniqueName: \"kubernetes.io/projected/f40369d7-b678-4803-b347-cbdbc6b6c2d1-kube-api-access-ngzvx\") pod \"downloads-6657875f97-sll6m\" (UID: \"f40369d7-b678-4803-b347-cbdbc6b6c2d1\") " pod="openshift-console/downloads-6657875f97-sll6m" Jun 11 16:49:02.123712 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.123643 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngzvx\" (UniqueName: \"kubernetes.io/projected/f40369d7-b678-4803-b347-cbdbc6b6c2d1-kube-api-access-ngzvx\") pod \"downloads-6657875f97-sll6m\" (UID: \"f40369d7-b678-4803-b347-cbdbc6b6c2d1\") " pod="openshift-console/downloads-6657875f97-sll6m" Jun 11 16:49:02.178484 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.178457 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-98xmm" Jun 11 16:49:02.185581 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.185546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:02.204261 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.204229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75448089-e93b-4b6f-a4d4-da4e732e6304-image-registry-private-configuration\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.204400 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.204279 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75448089-e93b-4b6f-a4d4-da4e732e6304-trusted-ca\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.204400 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.204315 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5g7\" (UniqueName: \"kubernetes.io/projected/75448089-e93b-4b6f-a4d4-da4e732e6304-kube-api-access-gp5g7\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.204531 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.204454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75448089-e93b-4b6f-a4d4-da4e732e6304-registry-tls\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.204531 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.204492 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75448089-e93b-4b6f-a4d4-da4e732e6304-installation-pull-secrets\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.204531 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.204524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75448089-e93b-4b6f-a4d4-da4e732e6304-bound-sa-token\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.205352 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.204553 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75448089-e93b-4b6f-a4d4-da4e732e6304-registry-certificates\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.205352 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.204580 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75448089-e93b-4b6f-a4d4-da4e732e6304-ca-trust-extracted\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.205352 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.205285 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75448089-e93b-4b6f-a4d4-da4e732e6304-ca-trust-extracted\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.205784 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.205382 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75448089-e93b-4b6f-a4d4-da4e732e6304-trusted-ca\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.205784 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.205450 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75448089-e93b-4b6f-a4d4-da4e732e6304-registry-certificates\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.206951 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.206916 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75448089-e93b-4b6f-a4d4-da4e732e6304-image-registry-private-configuration\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.207051 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.207021 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75448089-e93b-4b6f-a4d4-da4e732e6304-registry-tls\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.207673 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.207652 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75448089-e93b-4b6f-a4d4-da4e732e6304-installation-pull-secrets\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.215174 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.215155 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5g7\" (UniqueName: \"kubernetes.io/projected/75448089-e93b-4b6f-a4d4-da4e732e6304-kube-api-access-gp5g7\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.216645 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.216621 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75448089-e93b-4b6f-a4d4-da4e732e6304-bound-sa-token\") pod \"image-registry-6bcd958576-2rhbg\" (UID: \"75448089-e93b-4b6f-a4d4-da4e732e6304\") " pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.252688 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.252661 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-sll6m" Jun 11 16:49:02.318187 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.318163 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-98xmm"] Jun 11 16:49:02.321451 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:49:02.321406 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47246775_d162_4106_901d_0e510ebe3c36.slice/crio-866620ccb70554c07998f9bfa44d79fe3e690e251f4421376d63dfd62eb8663e WatchSource:0}: Error finding container 866620ccb70554c07998f9bfa44d79fe3e690e251f4421376d63dfd62eb8663e: Status 404 returned error can't find the container with id 866620ccb70554c07998f9bfa44d79fe3e690e251f4421376d63dfd62eb8663e Jun 11 16:49:02.345819 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.345796 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:02.394940 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.394914 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-sll6m"] Jun 11 16:49:02.398386 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:49:02.398359 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40369d7_b678_4803_b347_cbdbc6b6c2d1.slice/crio-410b751d3819deed4d897002f7350582fb2e657e5a1c08cb9cae58e88daa13eb WatchSource:0}: Error finding container 410b751d3819deed4d897002f7350582fb2e657e5a1c08cb9cae58e88daa13eb: Status 404 returned error can't find the container with id 410b751d3819deed4d897002f7350582fb2e657e5a1c08cb9cae58e88daa13eb Jun 11 16:49:02.491946 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:02.491915 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bcd958576-2rhbg"] Jun 11 16:49:02.494596 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:49:02.494570 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75448089_e93b_4b6f_a4d4_da4e732e6304.slice/crio-66eef0a46e121f84807bf0d6fce4aacce85017405219b416909395dcfae55e48 WatchSource:0}: Error finding container 66eef0a46e121f84807bf0d6fce4aacce85017405219b416909395dcfae55e48: Status 404 returned error can't find the container with id 66eef0a46e121f84807bf0d6fce4aacce85017405219b416909395dcfae55e48 Jun 11 16:49:03.093479 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:03.093410 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-sll6m" event={"ID":"f40369d7-b678-4803-b347-cbdbc6b6c2d1","Type":"ContainerStarted","Data":"410b751d3819deed4d897002f7350582fb2e657e5a1c08cb9cae58e88daa13eb"} Jun 11 16:49:03.095424 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:03.095323 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" event={"ID":"75448089-e93b-4b6f-a4d4-da4e732e6304","Type":"ContainerStarted","Data":"0e9b8936438b51b75172eed457a8a52d14bb280c44dcc9a41ce0ef47067c9f6d"} Jun 11 16:49:03.095424 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:03.095371 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" event={"ID":"75448089-e93b-4b6f-a4d4-da4e732e6304","Type":"ContainerStarted","Data":"66eef0a46e121f84807bf0d6fce4aacce85017405219b416909395dcfae55e48"} Jun 11 16:49:03.095703 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:03.095662 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:03.097648 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:03.097622 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98xmm" event={"ID":"47246775-d162-4106-901d-0e510ebe3c36","Type":"ContainerStarted","Data":"ebc731b885a073926c36b44256932b53131eb6ea208096d1cf9842a9d977ef88"} Jun 11 16:49:03.097762 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:03.097679 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98xmm" event={"ID":"47246775-d162-4106-901d-0e510ebe3c36","Type":"ContainerStarted","Data":"866620ccb70554c07998f9bfa44d79fe3e690e251f4421376d63dfd62eb8663e"} Jun 11 16:49:03.141672 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:03.141617 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" podStartSLOduration=1.1415963279999999 podStartE2EDuration="1.141596328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:03.140147313 +0000 UTC m=+277.521705848" watchObservedRunningTime="2026-06-11 16:49:03.141596328 +0000 UTC m=+277.523154843" Jun 11 16:49:04.114842 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:04.114797 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98xmm" event={"ID":"47246775-d162-4106-901d-0e510ebe3c36","Type":"ContainerStarted","Data":"45b56f0af71dd5afb1124aec4f76ade7dfcc893811a2c9e7573a4f1710a4c5a0"} Jun 11 16:49:04.885848 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:04.885803 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:04.963376 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:04.963341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:05.340537 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:05.340500 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:06.118367 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:06.118333 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98xmm" event={"ID":"47246775-d162-4106-901d-0e510ebe3c36","Type":"ContainerStarted","Data":"09cb1c03f1ae746728d437c2181d672e7c097fcfa3e1aff1fe36a39f9679954a"} Jun 11 16:49:07.508665 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:07.508632 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:07.611400 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:07.611368 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:07.726662 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:49:07.726624 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h8whw" podUID="e915cfae-2400-40f3-a789-72932ee96199" Jun 11 16:49:08.126008 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:08.125974 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8whw" Jun 11 16:49:08.680621 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:08.680587 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:10.040959 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.040907 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:10.258538 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.258470 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:10.335614 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.335518 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-98xmm" podStartSLOduration=6.763117871 podStartE2EDuration="9.335499004s" totalImagesPullingTime="2.572381133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:49:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:06.145180229 +0000 UTC m=+280.526738789" watchObservedRunningTime="2026-06-11 16:49:10.335499004 +0000 UTC m=+284.717057539" Jun 11 16:49:10.335995 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.335974 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dlpkm"] Jun 11 16:49:10.340982 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.340957 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.345030 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.345007 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:49:10.345326 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.345308 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nvhnv\"" Jun 11 16:49:10.345385 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.345340 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:49:10.345439 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.345361 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:49:10.345794 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.345750 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:49:10.368609 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.368579 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:10.456008 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.455974 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:10.479761 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.479626 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee42bb51-de23-4c4b-8409-22e26272b1a2-root\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.479761 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.479673 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-textfile\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.479998 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.479800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9x42\" (UniqueName: \"kubernetes.io/projected/ee42bb51-de23-4c4b-8409-22e26272b1a2-kube-api-access-g9x42\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.479998 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.479844 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-wtmp\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.479998 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.479914 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee42bb51-de23-4c4b-8409-22e26272b1a2-sys\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.479998 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.479945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee42bb51-de23-4c4b-8409-22e26272b1a2-metrics-client-ca\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.479998 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.479979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-tls\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.480228 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.480017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.480228 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.480083 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.556352 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.556320 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:10.580537 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.580503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.580742 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.580567 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee42bb51-de23-4c4b-8409-22e26272b1a2-root\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.580742 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.580595 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-textfile\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.580742 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.580647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9x42\" (UniqueName: \"kubernetes.io/projected/ee42bb51-de23-4c4b-8409-22e26272b1a2-kube-api-access-g9x42\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.580742 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.580680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-wtmp\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.580742 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.580707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee42bb51-de23-4c4b-8409-22e26272b1a2-sys\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.581014 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.580737 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee42bb51-de23-4c4b-8409-22e26272b1a2-root\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.581072 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.581048 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-textfile\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.581167 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.581149 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-wtmp\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.581228 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.581182 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee42bb51-de23-4c4b-8409-22e26272b1a2-sys\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.581228 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.581205 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.581340 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.581213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee42bb51-de23-4c4b-8409-22e26272b1a2-metrics-client-ca\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.581340 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.581274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-tls\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.581340 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.581309 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.581765 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.581743 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee42bb51-de23-4c4b-8409-22e26272b1a2-metrics-client-ca\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.584875 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.584835 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-tls\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.585477 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.585440 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee42bb51-de23-4c4b-8409-22e26272b1a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.590993 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.590933 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9x42\" (UniqueName: \"kubernetes.io/projected/ee42bb51-de23-4c4b-8409-22e26272b1a2-kube-api-access-g9x42\") pod \"node-exporter-dlpkm\" (UID: \"ee42bb51-de23-4c4b-8409-22e26272b1a2\") " pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.653878 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.653845 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dlpkm" Jun 11 16:49:10.657169 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.657109 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:10.671416 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:49:10.671384 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee42bb51_de23_4c4b_8409_22e26272b1a2.slice/crio-3908d64100a087e108a223be6abc6f9aac62686c936df81c1ea6640f7a16b838 WatchSource:0}: Error finding container 3908d64100a087e108a223be6abc6f9aac62686c936df81c1ea6640f7a16b838: Status 404 returned error can't find the container with id 3908d64100a087e108a223be6abc6f9aac62686c936df81c1ea6640f7a16b838 Jun 11 16:49:10.758408 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.758370 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:10.860905 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.860809 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:10.966645 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:10.966608 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:11.117880 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.117789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:11.139577 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.139542 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlpkm" event={"ID":"ee42bb51-de23-4c4b-8409-22e26272b1a2","Type":"ContainerStarted","Data":"3908d64100a087e108a223be6abc6f9aac62686c936df81c1ea6640f7a16b838"} Jun 11 16:49:11.220618 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.220580 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:11.321217 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.321188 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:11.415867 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.415786 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:11.490291 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.490256 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:49:11.494400 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.494366 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e915cfae-2400-40f3-a789-72932ee96199-metrics-tls\") pod \"dns-default-h8whw\" (UID: \"e915cfae-2400-40f3-a789-72932ee96199\") " pod="openshift-dns/dns-default-h8whw" Jun 11 16:49:11.639991 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.639963 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:11.729601 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.729531 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d9x4d\"" Jun 11 16:49:11.736852 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.736823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8whw" Jun 11 16:49:11.737225 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.737159 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:11.903761 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.903731 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h8whw"] Jun 11 16:49:11.908270 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.908242 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:11.943069 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:49:11.943035 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode915cfae_2400_40f3_a789_72932ee96199.slice/crio-0a682193365c897ac9c9a776d4251ad6dfb08fecee4d6d9c8a6db7507deb8840 WatchSource:0}: Error finding container 0a682193365c897ac9c9a776d4251ad6dfb08fecee4d6d9c8a6db7507deb8840: Status 404 returned error can't find the container with id 0a682193365c897ac9c9a776d4251ad6dfb08fecee4d6d9c8a6db7507deb8840 Jun 11 16:49:11.981324 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:11.981286 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:12.146393 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.146310 2558 generic.go:356] "Generic (PLEG): container finished" podID="ee42bb51-de23-4c4b-8409-22e26272b1a2" containerID="677a0a3ab7ea498419ed03e712dd57ec57ca76567fb06e02c837c54d65d27e11" exitCode=0 Jun 11 16:49:12.146789 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.146398 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlpkm" event={"ID":"ee42bb51-de23-4c4b-8409-22e26272b1a2","Type":"ContainerDied","Data":"677a0a3ab7ea498419ed03e712dd57ec57ca76567fb06e02c837c54d65d27e11"} Jun 11 16:49:12.148318 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.148272 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8whw" event={"ID":"e915cfae-2400-40f3-a789-72932ee96199","Type":"ContainerStarted","Data":"0a682193365c897ac9c9a776d4251ad6dfb08fecee4d6d9c8a6db7507deb8840"} Jun 11 16:49:12.150317 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.150298 2558 generic.go:356] "Generic (PLEG): container finished" podID="bc89250c-cc76-42a0-9e25-78515b3b9c48" containerID="ca175102b33eda55d955f8e230515f113d4f6285d23207c41a9f57f7c0002164" exitCode=255 Jun 11 16:49:12.150441 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.150376 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" event={"ID":"bc89250c-cc76-42a0-9e25-78515b3b9c48","Type":"ContainerDied","Data":"ca175102b33eda55d955f8e230515f113d4f6285d23207c41a9f57f7c0002164"} Jun 11 16:49:12.150441 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.150413 2558 scope.go:117] "RemoveContainer" containerID="cd350c4a4769a99711c72d72c34f64ef1cfda23e9d5119e8ac1f7ac9c4b85649" Jun 11 16:49:12.155712 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.155207 2558 generic.go:356] "Generic (PLEG): container finished" podID="02e45afc-150c-44bc-b030-b856498bc700" containerID="5d39b55a03a4f96270843c9d57af820ddb318ff6a681e8680a7706e9393385f1" exitCode=1 Jun 11 16:49:12.155712 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.155270 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" event={"ID":"02e45afc-150c-44bc-b030-b856498bc700","Type":"ContainerDied","Data":"5d39b55a03a4f96270843c9d57af820ddb318ff6a681e8680a7706e9393385f1"} Jun 11 16:49:12.155712 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.155580 2558 scope.go:117] "RemoveContainer" containerID="5d39b55a03a4f96270843c9d57af820ddb318ff6a681e8680a7706e9393385f1" Jun 11 16:49:12.156257 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:49:12.155999 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-86d58fc85c-brblz_open-cluster-management-agent-addon(02e45afc-150c-44bc-b030-b856498bc700)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" podUID="02e45afc-150c-44bc-b030-b856498bc700" Jun 11 16:49:12.161064 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.161045 2558 scope.go:117] "RemoveContainer" containerID="ca175102b33eda55d955f8e230515f113d4f6285d23207c41a9f57f7c0002164" Jun 11 16:49:12.161240 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:49:12.161222 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-66595d9478-gjsz9_open-cluster-management-agent-addon(bc89250c-cc76-42a0-9e25-78515b3b9c48)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" podUID="bc89250c-cc76-42a0-9e25-78515b3b9c48" Jun 11 16:49:12.168311 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.168284 2558 scope.go:117] "RemoveContainer" containerID="2c4e28aea4567769112938b5b0333b57d0e0b1f98520f10990c8e7f4112da256" Jun 11 16:49:12.754512 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:12.754478 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:49:13.100548 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:13.100511 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:13.163757 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:13.163709 2558 scope.go:117] "RemoveContainer" containerID="5d39b55a03a4f96270843c9d57af820ddb318ff6a681e8680a7706e9393385f1" Jun 11 16:49:13.164210 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:49:13.163950 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-86d58fc85c-brblz_open-cluster-management-agent-addon(02e45afc-150c-44bc-b030-b856498bc700)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" podUID="02e45afc-150c-44bc-b030-b856498bc700" Jun 11 16:49:13.165777 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:13.165752 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlpkm" event={"ID":"ee42bb51-de23-4c4b-8409-22e26272b1a2","Type":"ContainerStarted","Data":"ee3062e38477ee7b1b8911e4bf6544868f9db06097180aec8bb88d65d303eda4"} Jun 11 16:49:13.165885 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:13.165803 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlpkm" event={"ID":"ee42bb51-de23-4c4b-8409-22e26272b1a2","Type":"ContainerStarted","Data":"2820a1877583bcb95579dc3428d1944ab708dc9a4b4a2d6d3349aed8fe72c67f"} Jun 11 16:49:13.183368 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:13.183338 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:13.197165 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:13.197095 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dlpkm" podStartSLOduration=2.182869234 podStartE2EDuration="3.197078104s" totalImagesPullingTime="926.121949ms" totalInitContainerRuntime="88.086921ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:13.196312069 +0000 UTC m=+287.577870623" watchObservedRunningTime="2026-06-11 16:49:13.197078104 +0000 UTC m=+287.578636639" Jun 11 16:49:13.337056 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:13.337012 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:13.397776 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:13.397679 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:13.776211 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:13.776181 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:13.970306 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:13.970271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:14.795014 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:14.794968 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" Jun 11 16:49:14.795471 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:14.795420 2558 scope.go:117] "RemoveContainer" containerID="ca175102b33eda55d955f8e230515f113d4f6285d23207c41a9f57f7c0002164" Jun 11 16:49:14.795644 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:49:14.795614 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-66595d9478-gjsz9_open-cluster-management-agent-addon(bc89250c-cc76-42a0-9e25-78515b3b9c48)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" podUID="bc89250c-cc76-42a0-9e25-78515b3b9c48" Jun 11 16:49:14.818235 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:14.818201 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:49:14.818588 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:14.818573 2558 scope.go:117] "RemoveContainer" containerID="5d39b55a03a4f96270843c9d57af820ddb318ff6a681e8680a7706e9393385f1" Jun 11 16:49:14.818767 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:49:14.818742 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-86d58fc85c-brblz_open-cluster-management-agent-addon(02e45afc-150c-44bc-b030-b856498bc700)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" podUID="02e45afc-150c-44bc-b030-b856498bc700" Jun 11 16:49:15.070296 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:15.070222 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:15.170245 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:15.170198 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:15.726816 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:15.726775 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:16.348654 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.348617 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:16.397824 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.397785 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78c49c79cf-8j27b"] Jun 11 16:49:16.401166 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.401146 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.404340 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.404315 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:49:16.404466 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.404416 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:49:16.405447 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.405426 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fvk45\"" Jun 11 16:49:16.405553 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.405519 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:49:16.405602 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.405555 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:49:16.405652 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.405591 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:49:16.409956 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.409933 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:49:16.422975 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.422948 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78c49c79cf-8j27b"] Jun 11 16:49:16.463599 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.463561 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:16.540042 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.540003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxzg6\" (UniqueName: \"kubernetes.io/projected/a211fced-6b17-42b4-8269-8e1491b1e347-kube-api-access-xxzg6\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.540224 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.540068 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-console-config\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.540224 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.540101 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-service-ca\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.540224 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.540124 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-trusted-ca-bundle\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.540224 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.540154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-oauth-serving-cert\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.540383 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.540225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-serving-cert\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.540383 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.540259 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-oauth-config\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.641279 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.641194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-console-config\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.641279 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.641245 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-service-ca\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.641279 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.641276 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-trusted-ca-bundle\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.641558 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.641293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-oauth-serving-cert\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.641558 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.641352 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-serving-cert\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.641669 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.641563 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-oauth-config\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.641669 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.641622 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxzg6\" (UniqueName: \"kubernetes.io/projected/a211fced-6b17-42b4-8269-8e1491b1e347-kube-api-access-xxzg6\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.642134 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.642111 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-console-config\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.642232 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.642137 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-service-ca\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.642315 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.642291 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-trusted-ca-bundle\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.642549 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.642522 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-oauth-serving-cert\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.644074 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.644050 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-serving-cert\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.644186 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.644168 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-oauth-config\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.650798 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.650774 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxzg6\" (UniqueName: \"kubernetes.io/projected/a211fced-6b17-42b4-8269-8e1491b1e347-kube-api-access-xxzg6\") pod \"console-78c49c79cf-8j27b\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.718214 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.718177 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:16.768099 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:16.768064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:18.141272 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:18.141231 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:18.248580 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:18.248547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:20.220204 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.220176 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78c49c79cf-8j27b"] Jun 11 16:49:20.225304 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:49:20.225258 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda211fced_6b17_42b4_8269_8e1491b1e347.slice/crio-61ffb5c109f8851e8af2db8b6599b5422247b32cace5b0b18f8486fb0f31a9e3 WatchSource:0}: Error finding container 61ffb5c109f8851e8af2db8b6599b5422247b32cace5b0b18f8486fb0f31a9e3: Status 404 returned error can't find the container with id 61ffb5c109f8851e8af2db8b6599b5422247b32cace5b0b18f8486fb0f31a9e3 Jun 11 16:49:20.343285 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.343203 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78c49c79cf-8j27b"] Jun 11 16:49:20.372787 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.372752 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-566b7c54cd-llggw"] Jun 11 16:49:20.377030 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.377006 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.387170 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.387145 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566b7c54cd-llggw"] Jun 11 16:49:20.477123 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.477087 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-oauth-serving-cert\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.477292 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.477140 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-oauth-config\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.477292 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.477165 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-service-ca\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.477292 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.477225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnfgw\" (UniqueName: \"kubernetes.io/projected/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-kube-api-access-cnfgw\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.477471 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.477318 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-serving-cert\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.477471 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.477358 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-config\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.477471 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.477388 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-trusted-ca-bundle\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.578342 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.578300 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-oauth-config\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.578342 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.578346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-service-ca\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.578614 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.578372 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnfgw\" (UniqueName: \"kubernetes.io/projected/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-kube-api-access-cnfgw\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.578614 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.578419 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-serving-cert\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.578614 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.578443 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-config\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.578614 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.578466 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-trusted-ca-bundle\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.578614 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.578561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-oauth-serving-cert\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.579194 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.579161 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-service-ca\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.579303 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.579222 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-oauth-serving-cert\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.579523 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.579488 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-config\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.579961 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.579932 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-trusted-ca-bundle\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.581685 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.581658 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-serving-cert\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.581858 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.581752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-oauth-config\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.587262 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.587238 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnfgw\" (UniqueName: \"kubernetes.io/projected/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-kube-api-access-cnfgw\") pod \"console-566b7c54cd-llggw\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.625779 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.625673 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:20.679258 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.679220 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:20.687975 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.687943 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:20.887678 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.887596 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566b7c54cd-llggw"] Jun 11 16:49:20.890888 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:49:20.890844 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdcea87c_2cf4_4d64_bc9a_b6fcc9daf830.slice/crio-6cac0e4e0be6704f7a0b363ec0e1719eab78e6d72122f9e6680934a54092bcbb WatchSource:0}: Error finding container 6cac0e4e0be6704f7a0b363ec0e1719eab78e6d72122f9e6680934a54092bcbb: Status 404 returned error can't find the container with id 6cac0e4e0be6704f7a0b363ec0e1719eab78e6d72122f9e6680934a54092bcbb Jun 11 16:49:20.961872 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:20.961812 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:21.032129 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.032082 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:21.203944 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.203378 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-sll6m" event={"ID":"f40369d7-b678-4803-b347-cbdbc6b6c2d1","Type":"ContainerStarted","Data":"adbf76bf9c1ba49420d3bbf0bd342c6f046464ff2ba60ac6b60df00173b3486f"} Jun 11 16:49:21.203944 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.203679 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-sll6m" Jun 11 16:49:21.205175 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.205146 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566b7c54cd-llggw" event={"ID":"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830","Type":"ContainerStarted","Data":"6cac0e4e0be6704f7a0b363ec0e1719eab78e6d72122f9e6680934a54092bcbb"} Jun 11 16:49:21.207068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.207043 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c49c79cf-8j27b" event={"ID":"a211fced-6b17-42b4-8269-8e1491b1e347","Type":"ContainerStarted","Data":"61ffb5c109f8851e8af2db8b6599b5422247b32cace5b0b18f8486fb0f31a9e3"} Jun 11 16:49:21.209229 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.209206 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8whw" event={"ID":"e915cfae-2400-40f3-a789-72932ee96199","Type":"ContainerStarted","Data":"2ac0f1ce8081deeed245f415fbc02ae48c982c9dd186f6721d3dc785e0d6f4f1"} Jun 11 16:49:21.209335 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.209292 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8whw" event={"ID":"e915cfae-2400-40f3-a789-72932ee96199","Type":"ContainerStarted","Data":"086dca96bcd0e5bf5d00b3ae2b01a17dc002021fbaf9b71df3a9120c08488ca7"} Jun 11 16:49:21.209394 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.209382 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h8whw" Jun 11 16:49:21.218480 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.218456 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-sll6m" Jun 11 16:49:21.224068 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.223922 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-sll6m" podStartSLOduration=2.489616525 podStartE2EDuration="20.223901716s" totalImagesPullingTime="17.734285191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:21.221824819 +0000 UTC m=+295.603383376" watchObservedRunningTime="2026-06-11 16:49:21.223901716 +0000 UTC m=+295.605460293" Jun 11 16:49:21.272883 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:21.272502 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h8whw" podStartSLOduration=252.130060349 podStartE2EDuration="4m20.272479331s" totalImagesPullingTime="8.142418982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:21.270509769 +0000 UTC m=+295.652068328" watchObservedRunningTime="2026-06-11 16:49:21.272479331 +0000 UTC m=+295.654037868" Jun 11 16:49:22.110575 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:49:22.110533 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2hn9p" podUID="25230cfa-9fff-47b3-bba0-3f4023c53bdc" Jun 11 16:49:24.116207 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:24.116178 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bcd958576-2rhbg" Jun 11 16:49:24.268511 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:24.268465 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:24.333452 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:24.333416 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:24.437951 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:24.437921 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:24.540255 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:24.540215 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:25.232076 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:25.232025 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566b7c54cd-llggw" event={"ID":"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830","Type":"ContainerStarted","Data":"70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17"} Jun 11 16:49:25.233913 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:25.233883 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c49c79cf-8j27b" event={"ID":"a211fced-6b17-42b4-8269-8e1491b1e347","Type":"ContainerStarted","Data":"a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf"} Jun 11 16:49:25.251545 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:25.251230 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-566b7c54cd-llggw" podStartSLOduration=1.566809107 podStartE2EDuration="5.251208222s" totalImagesPullingTime="3.684399115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:25.250495945 +0000 UTC m=+299.632054506" watchObservedRunningTime="2026-06-11 16:49:25.251208222 +0000 UTC m=+299.632766758" Jun 11 16:49:25.269229 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:25.269174 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78c49c79cf-8j27b" podStartSLOduration=4.9270190419999995 podStartE2EDuration="9.269156109s" totalImagesPullingTime="4.342137067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:49:25.268023777 +0000 UTC m=+299.649582314" watchObservedRunningTime="2026-06-11 16:49:25.269156109 +0000 UTC m=+299.650714645" Jun 11 16:49:25.375316 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:25.375266 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:25.476793 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:25.476707 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:26.047635 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:26.047602 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 16:49:26.048071 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:26.048042 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 16:49:26.058201 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:26.058177 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 16:49:26.059053 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:26.059030 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 16:49:26.067267 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:26.067248 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:49:26.111907 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:26.111745 2558 scope.go:117] "RemoveContainer" containerID="5d39b55a03a4f96270843c9d57af820ddb318ff6a681e8680a7706e9393385f1" Jun 11 16:49:26.606978 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:26.242535 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" event={"ID":"02e45afc-150c-44bc-b030-b856498bc700","Type":"ContainerStarted","Data":"99eca8c0b41b11321fc8adf9a8b964d477685fbf5a9949d54c47adfe942b52aa"} Jun 11 16:49:26.606978 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:26.243145 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:49:26.606978 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:26.244440 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d58fc85c-brblz" Jun 11 16:49:26.719032 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:26.718992 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:28.117324 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:28.117297 2558 scope.go:117] "RemoveContainer" containerID="ca175102b33eda55d955f8e230515f113d4f6285d23207c41a9f57f7c0002164" Jun 11 16:49:28.253942 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:28.253902 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66595d9478-gjsz9" event={"ID":"bc89250c-cc76-42a0-9e25-78515b3b9c48","Type":"ContainerStarted","Data":"972a5c7e75bdfa3a4f6fd0378a00619bee6d43edd6dc3d5ffbf1f592103ec889"} Jun 11 16:49:30.688293 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:30.688257 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:30.688824 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:30.688321 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:30.693407 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:30.693382 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:31.218153 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:31.218119 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h8whw" Jun 11 16:49:31.267365 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:31.267338 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:49:31.511699 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:31.511657 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:31.606053 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:31.606018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:34.109632 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:34.109597 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:49:40.374607 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:40.374575 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:40.437824 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:40.437785 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:49:50.256712 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.256676 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78c49c79cf-8j27b" podUID="a211fced-6b17-42b4-8269-8e1491b1e347" containerName="console" containerID="cri-o://a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf" gracePeriod=15 Jun 11 16:49:50.329791 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.329759 2558 generic.go:356] "Generic (PLEG): container finished" podID="68ab36b6-32a0-4669-b9c1-115829e40bd1" containerID="6f00064342319a34444d30e7032562e916e4fcc2d822cf1c0db87d4c16bf3db3" exitCode=0 Jun 11 16:49:50.329948 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.329832 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-99f9g" event={"ID":"68ab36b6-32a0-4669-b9c1-115829e40bd1","Type":"ContainerDied","Data":"6f00064342319a34444d30e7032562e916e4fcc2d822cf1c0db87d4c16bf3db3"} Jun 11 16:49:50.330245 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.330220 2558 scope.go:117] "RemoveContainer" containerID="6f00064342319a34444d30e7032562e916e4fcc2d822cf1c0db87d4c16bf3db3" Jun 11 16:49:50.331320 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.331293 2558 generic.go:356] "Generic (PLEG): container finished" podID="fc74bc96-466b-4a41-a6a5-43990fa60108" containerID="f7b8a99f783f2d54df757f7d5ce17deb09cf47e313357127953515e45a9260c9" exitCode=0 Jun 11 16:49:50.331424 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.331358 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" event={"ID":"fc74bc96-466b-4a41-a6a5-43990fa60108","Type":"ContainerDied","Data":"f7b8a99f783f2d54df757f7d5ce17deb09cf47e313357127953515e45a9260c9"} Jun 11 16:49:50.331618 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.331605 2558 scope.go:117] "RemoveContainer" containerID="f7b8a99f783f2d54df757f7d5ce17deb09cf47e313357127953515e45a9260c9" Jun 11 16:49:50.555313 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.555289 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:50.646557 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.646522 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-oauth-config\") pod \"a211fced-6b17-42b4-8269-8e1491b1e347\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " Jun 11 16:49:50.646762 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.646566 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-serving-cert\") pod \"a211fced-6b17-42b4-8269-8e1491b1e347\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " Jun 11 16:49:50.646762 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.646628 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxzg6\" (UniqueName: \"kubernetes.io/projected/a211fced-6b17-42b4-8269-8e1491b1e347-kube-api-access-xxzg6\") pod \"a211fced-6b17-42b4-8269-8e1491b1e347\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " Jun 11 16:49:50.646762 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.646667 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-trusted-ca-bundle\") pod \"a211fced-6b17-42b4-8269-8e1491b1e347\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " Jun 11 16:49:50.646762 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.646705 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-service-ca\") pod \"a211fced-6b17-42b4-8269-8e1491b1e347\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " Jun 11 16:49:50.646762 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.646751 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-oauth-serving-cert\") pod \"a211fced-6b17-42b4-8269-8e1491b1e347\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " Jun 11 16:49:50.647025 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.646778 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-console-config\") pod \"a211fced-6b17-42b4-8269-8e1491b1e347\" (UID: \"a211fced-6b17-42b4-8269-8e1491b1e347\") " Jun 11 16:49:50.647115 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.647087 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-service-ca" (OuterVolumeSpecName: "service-ca") pod "a211fced-6b17-42b4-8269-8e1491b1e347" (UID: "a211fced-6b17-42b4-8269-8e1491b1e347"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:49:50.647312 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.647281 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-console-config" (OuterVolumeSpecName: "console-config") pod "a211fced-6b17-42b4-8269-8e1491b1e347" (UID: "a211fced-6b17-42b4-8269-8e1491b1e347"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:49:50.647312 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.647294 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a211fced-6b17-42b4-8269-8e1491b1e347" (UID: "a211fced-6b17-42b4-8269-8e1491b1e347"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:49:50.647434 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.647393 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a211fced-6b17-42b4-8269-8e1491b1e347" (UID: "a211fced-6b17-42b4-8269-8e1491b1e347"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:49:50.649280 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.649253 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a211fced-6b17-42b4-8269-8e1491b1e347" (UID: "a211fced-6b17-42b4-8269-8e1491b1e347"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:49:50.649378 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.649300 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a211fced-6b17-42b4-8269-8e1491b1e347" (UID: "a211fced-6b17-42b4-8269-8e1491b1e347"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:49:50.649378 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.649309 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a211fced-6b17-42b4-8269-8e1491b1e347-kube-api-access-xxzg6" (OuterVolumeSpecName: "kube-api-access-xxzg6") pod "a211fced-6b17-42b4-8269-8e1491b1e347" (UID: "a211fced-6b17-42b4-8269-8e1491b1e347"). InnerVolumeSpecName "kube-api-access-xxzg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:49:50.748169 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.748128 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxzg6\" (UniqueName: \"kubernetes.io/projected/a211fced-6b17-42b4-8269-8e1491b1e347-kube-api-access-xxzg6\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:49:50.748169 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.748161 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-trusted-ca-bundle\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:49:50.748169 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.748174 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-service-ca\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:49:50.748396 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.748186 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-oauth-serving-cert\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:49:50.748396 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.748198 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a211fced-6b17-42b4-8269-8e1491b1e347-console-config\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:49:50.748396 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.748209 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-oauth-config\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:49:50.748396 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:50.748219 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a211fced-6b17-42b4-8269-8e1491b1e347-console-serving-cert\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:49:51.164453 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.164370 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jtsv8_19a845c8-e5c5-4523-96f0-b4cef88ff648/serve-healthcheck-canary/0.log" Jun 11 16:49:51.336621 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.336580 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-99f9g" event={"ID":"68ab36b6-32a0-4669-b9c1-115829e40bd1","Type":"ContainerStarted","Data":"f319d9dc3524129e51afe8b0495b8109869df9df9d9c2b132a4e3817df018a69"} Jun 11 16:49:51.338308 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.338278 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mxm4c" event={"ID":"fc74bc96-466b-4a41-a6a5-43990fa60108","Type":"ContainerStarted","Data":"b86b78b75bd158f1b551222a8edcba375eabcf6d11e205c195ce2fb22ffafb9a"} Jun 11 16:49:51.339380 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.339357 2558 generic.go:356] "Generic (PLEG): container finished" podID="a211fced-6b17-42b4-8269-8e1491b1e347" containerID="a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf" exitCode=0 Jun 11 16:49:51.339492 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.339405 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c49c79cf-8j27b" Jun 11 16:49:51.339492 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.339429 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c49c79cf-8j27b" event={"ID":"a211fced-6b17-42b4-8269-8e1491b1e347","Type":"ContainerDied","Data":"a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf"} Jun 11 16:49:51.339492 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.339464 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c49c79cf-8j27b" event={"ID":"a211fced-6b17-42b4-8269-8e1491b1e347","Type":"ContainerDied","Data":"61ffb5c109f8851e8af2db8b6599b5422247b32cace5b0b18f8486fb0f31a9e3"} Jun 11 16:49:51.339492 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.339486 2558 scope.go:117] "RemoveContainer" containerID="a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf" Jun 11 16:49:51.354189 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.354162 2558 scope.go:117] "RemoveContainer" containerID="a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf" Jun 11 16:49:51.354602 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:49:51.354572 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf\": container with ID starting with a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf not found: ID does not exist" containerID="a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf" Jun 11 16:49:51.354740 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.354604 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf"} err="failed to get container status \"a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf\": rpc error: code = NotFound desc = could not find container \"a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf\": container with ID starting with a2dda65ade0cd973e83dd9d2b23742c2b0146ad88293dbf98217643baa6e08bf not found: ID does not exist" Jun 11 16:49:51.385454 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.385423 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78c49c79cf-8j27b"] Jun 11 16:49:51.391655 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:51.391625 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78c49c79cf-8j27b"] Jun 11 16:49:52.114148 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:49:52.114118 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a211fced-6b17-42b4-8269-8e1491b1e347" path="/var/lib/kubelet/pods/a211fced-6b17-42b4-8269-8e1491b1e347/volumes" Jun 11 16:50:03.220687 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:03.220644 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:03.320711 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:03.320620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:03.380700 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:03.380663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:18.996542 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:18.996460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:19.073391 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:19.073361 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:22.879030 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:22.878988 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:22.952331 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:22.952296 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:26.564464 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:26.564390 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:26.626711 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:26.626673 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:36.105296 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:36.105252 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:36.200191 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:36.200155 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:38.442263 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:38.442224 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:38.543418 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:38.543386 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:39.065168 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:39.065123 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:50:39.067478 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:39.067460 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25230cfa-9fff-47b3-bba0-3f4023c53bdc-metrics-certs\") pod \"network-metrics-daemon-2hn9p\" (UID: \"25230cfa-9fff-47b3-bba0-3f4023c53bdc\") " pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:50:39.212856 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:39.212818 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bmxfr\"" Jun 11 16:50:39.221082 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:39.221064 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hn9p" Jun 11 16:50:39.345947 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:39.345888 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2hn9p"] Jun 11 16:50:39.348223 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:50:39.348197 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25230cfa_9fff_47b3_bba0_3f4023c53bdc.slice/crio-9f2c4040011905fb525d7dd1158774a53ea21055bb5aa8a33d19222746ef2904 WatchSource:0}: Error finding container 9f2c4040011905fb525d7dd1158774a53ea21055bb5aa8a33d19222746ef2904: Status 404 returned error can't find the container with id 9f2c4040011905fb525d7dd1158774a53ea21055bb5aa8a33d19222746ef2904 Jun 11 16:50:39.350062 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:39.350046 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:50:39.509908 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:39.509875 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2hn9p" event={"ID":"25230cfa-9fff-47b3-bba0-3f4023c53bdc","Type":"ContainerStarted","Data":"9f2c4040011905fb525d7dd1158774a53ea21055bb5aa8a33d19222746ef2904"} Jun 11 16:50:40.515930 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:40.515891 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2hn9p" event={"ID":"25230cfa-9fff-47b3-bba0-3f4023c53bdc","Type":"ContainerStarted","Data":"ffc83934786623f40b323fe714b1356baa18c5aafa6da2612922374bd64ca560"} Jun 11 16:50:41.521099 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:41.521065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2hn9p" event={"ID":"25230cfa-9fff-47b3-bba0-3f4023c53bdc","Type":"ContainerStarted","Data":"21beb9c76eca413f20e487733c2a15ebd47c55673c4532db00164a62fdfac55e"} Jun 11 16:50:41.540262 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:41.540209 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2hn9p" podStartSLOduration=374.496565099 podStartE2EDuration="6m15.540193426s" totalImagesPullingTime="1.043628327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:50:41.538321092 +0000 UTC m=+375.919879626" watchObservedRunningTime="2026-06-11 16:50:41.540193426 +0000 UTC m=+375.921751961" Jun 11 16:50:41.630632 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:41.630596 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:41.731996 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:41.731968 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:47.084406 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:47.084370 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566b7c54cd-llggw"] Jun 11 16:50:47.228600 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:47.228561 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:47.329392 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:47.329360 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:55.383999 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:55.383953 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:50:55.484961 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:50:55.484914 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:51:00.812214 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:00.812181 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:51:12.109275 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.109213 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-566b7c54cd-llggw" podUID="cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" containerName="console" containerID="cri-o://70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17" gracePeriod=15 Jun 11 16:51:12.353232 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.353208 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:51:12.430594 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.430509 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-oauth-serving-cert\") pod \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " Jun 11 16:51:12.430594 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.430548 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnfgw\" (UniqueName: \"kubernetes.io/projected/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-kube-api-access-cnfgw\") pod \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " Jun 11 16:51:12.430594 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.430568 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-service-ca\") pod \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " Jun 11 16:51:12.430594 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.430589 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-config\") pod \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " Jun 11 16:51:12.430942 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.430631 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-oauth-config\") pod \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " Jun 11 16:51:12.430942 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.430650 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-trusted-ca-bundle\") pod \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " Jun 11 16:51:12.430942 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.430676 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-serving-cert\") pod \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\" (UID: \"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830\") " Jun 11 16:51:12.431104 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.431075 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" (UID: "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:51:12.431156 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.431089 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-service-ca" (OuterVolumeSpecName: "service-ca") pod "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" (UID: "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:51:12.431156 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.431130 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-config" (OuterVolumeSpecName: "console-config") pod "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" (UID: "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:51:12.431256 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.431158 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" (UID: "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:51:12.432762 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.432740 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-kube-api-access-cnfgw" (OuterVolumeSpecName: "kube-api-access-cnfgw") pod "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" (UID: "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830"). InnerVolumeSpecName "kube-api-access-cnfgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:51:12.432866 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.432753 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" (UID: "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:51:12.432866 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.432844 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" (UID: "cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:51:12.531291 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.531258 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-serving-cert\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:51:12.531291 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.531287 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-oauth-serving-cert\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:51:12.531291 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.531296 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnfgw\" (UniqueName: \"kubernetes.io/projected/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-kube-api-access-cnfgw\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:51:12.531491 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.531307 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-service-ca\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:51:12.531491 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.531315 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-config\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:51:12.531491 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.531323 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-console-oauth-config\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:51:12.531491 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.531332 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830-trusted-ca-bundle\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 16:51:12.631027 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.630994 2558 generic.go:356] "Generic (PLEG): container finished" podID="cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" containerID="70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17" exitCode=0 Jun 11 16:51:12.631172 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.631041 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566b7c54cd-llggw" Jun 11 16:51:12.631172 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.631081 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566b7c54cd-llggw" event={"ID":"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830","Type":"ContainerDied","Data":"70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17"} Jun 11 16:51:12.631172 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.631135 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566b7c54cd-llggw" event={"ID":"cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830","Type":"ContainerDied","Data":"6cac0e4e0be6704f7a0b363ec0e1719eab78e6d72122f9e6680934a54092bcbb"} Jun 11 16:51:12.631172 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.631156 2558 scope.go:117] "RemoveContainer" containerID="70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17" Jun 11 16:51:12.639194 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.639177 2558 scope.go:117] "RemoveContainer" containerID="70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17" Jun 11 16:51:12.639433 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:51:12.639415 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17\": container with ID starting with 70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17 not found: ID does not exist" containerID="70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17" Jun 11 16:51:12.639479 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.639440 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17"} err="failed to get container status \"70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17\": rpc error: code = NotFound desc = could not find container \"70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17\": container with ID starting with 70c3f28eb0db5960420cbac370774dab07e40ad9006f76a0a2012ef8bb0c3b17 not found: ID does not exist" Jun 11 16:51:12.651760 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.651739 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566b7c54cd-llggw"] Jun 11 16:51:12.657485 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:12.657462 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566b7c54cd-llggw"] Jun 11 16:51:14.113376 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:14.113342 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" path="/var/lib/kubelet/pods/cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830/volumes" Jun 11 16:51:21.327392 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:21.327353 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:51:21.381748 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:21.381700 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:51:39.284748 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:39.284624 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:51:39.390079 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:51:39.390045 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:06.126163 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:06.126128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:07.151364 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:07.151331 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:10.351537 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:10.351507 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:10.447213 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:10.447184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:13.197007 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:13.196967 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:13.291777 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:13.291745 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:13.622824 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:13.622786 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:13.963501 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:13.963423 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:15.953873 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.953837 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf"] Jun 11 16:52:15.954333 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.954195 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" containerName="console" Jun 11 16:52:15.954333 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.954212 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" containerName="console" Jun 11 16:52:15.954333 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.954235 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a211fced-6b17-42b4-8269-8e1491b1e347" containerName="console" Jun 11 16:52:15.954333 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.954243 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a211fced-6b17-42b4-8269-8e1491b1e347" containerName="console" Jun 11 16:52:15.954333 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.954302 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a211fced-6b17-42b4-8269-8e1491b1e347" containerName="console" Jun 11 16:52:15.954333 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.954312 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdcea87c-2cf4-4d64-bc9a-b6fcc9daf830" containerName="console" Jun 11 16:52:15.957229 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.957208 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" Jun 11 16:52:15.960745 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.960709 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 16:52:15.961645 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.961626 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lgwcf\"" Jun 11 16:52:15.961697 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.961674 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 16:52:15.979071 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:15.979039 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf"] Jun 11 16:52:16.039996 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.039940 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:16.122642 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.122613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2hmc\" (UniqueName: \"kubernetes.io/projected/f9c141d0-70ef-487e-8134-1e1a8e8d65b3-kube-api-access-k2hmc\") pod \"cert-manager-webhook-7dc76cbb94-hb9xf\" (UID: \"f9c141d0-70ef-487e-8134-1e1a8e8d65b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" Jun 11 16:52:16.122642 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.122646 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9c141d0-70ef-487e-8134-1e1a8e8d65b3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hb9xf\" (UID: \"f9c141d0-70ef-487e-8134-1e1a8e8d65b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" Jun 11 16:52:16.140015 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.139988 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:16.224009 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.223983 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2hmc\" (UniqueName: \"kubernetes.io/projected/f9c141d0-70ef-487e-8134-1e1a8e8d65b3-kube-api-access-k2hmc\") pod \"cert-manager-webhook-7dc76cbb94-hb9xf\" (UID: \"f9c141d0-70ef-487e-8134-1e1a8e8d65b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" Jun 11 16:52:16.224165 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.224021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9c141d0-70ef-487e-8134-1e1a8e8d65b3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hb9xf\" (UID: \"f9c141d0-70ef-487e-8134-1e1a8e8d65b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" Jun 11 16:52:16.232476 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.232449 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9c141d0-70ef-487e-8134-1e1a8e8d65b3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-hb9xf\" (UID: \"f9c141d0-70ef-487e-8134-1e1a8e8d65b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" Jun 11 16:52:16.232583 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.232516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2hmc\" (UniqueName: \"kubernetes.io/projected/f9c141d0-70ef-487e-8134-1e1a8e8d65b3-kube-api-access-k2hmc\") pod \"cert-manager-webhook-7dc76cbb94-hb9xf\" (UID: \"f9c141d0-70ef-487e-8134-1e1a8e8d65b3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" Jun 11 16:52:16.266056 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.266027 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" Jun 11 16:52:16.395082 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.395059 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf"] Jun 11 16:52:16.397610 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:52:16.397578 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9c141d0_70ef_487e_8134_1e1a8e8d65b3.slice/crio-d5fa088536c26c611b4b9a6a7c95e77f2d62389f5928dcc6318d2c9f5f1f381c WatchSource:0}: Error finding container d5fa088536c26c611b4b9a6a7c95e77f2d62389f5928dcc6318d2c9f5f1f381c: Status 404 returned error can't find the container with id d5fa088536c26c611b4b9a6a7c95e77f2d62389f5928dcc6318d2c9f5f1f381c Jun 11 16:52:16.714398 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.714315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:16.849537 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:16.849504 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" event={"ID":"f9c141d0-70ef-487e-8134-1e1a8e8d65b3","Type":"ContainerStarted","Data":"d5fa088536c26c611b4b9a6a7c95e77f2d62389f5928dcc6318d2c9f5f1f381c"} Jun 11 16:52:17.168167 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:17.168136 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:19.862614 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:19.862575 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" event={"ID":"f9c141d0-70ef-487e-8134-1e1a8e8d65b3","Type":"ContainerStarted","Data":"4ef32aeac9b94ffa7ad28444caa145ebafc2e1faa4bfe033e98746ab411cea63"} Jun 11 16:52:19.863013 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:19.862824 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" Jun 11 16:52:24.292871 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:24.292834 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:25.038249 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:25.038221 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:25.136364 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:25.136330 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:25.868520 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:25.868493 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" Jun 11 16:52:25.903151 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:25.903089 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-hb9xf" podStartSLOduration=7.977169977 podStartE2EDuration="10.903070296s" totalImagesPullingTime="2.925900319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:19.888506976 +0000 UTC m=+474.270065511" watchObservedRunningTime="2026-06-11 16:52:25.903070296 +0000 UTC m=+480.284628834" Jun 11 16:52:31.020850 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:31.020813 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:31.121479 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:31.121448 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:33.385131 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:33.385100 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:34.171102 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.171067 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-rdf2c"] Jun 11 16:52:34.175875 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.175858 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-rdf2c" Jun 11 16:52:34.179414 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.179392 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mjvd5\"" Jun 11 16:52:34.200877 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.200848 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-rdf2c"] Jun 11 16:52:34.362638 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.362605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6315174-ab09-47b6-9767-b54c82cfb231-bound-sa-token\") pod \"cert-manager-59c77684cc-rdf2c\" (UID: \"a6315174-ab09-47b6-9767-b54c82cfb231\") " pod="cert-manager/cert-manager-59c77684cc-rdf2c" Jun 11 16:52:34.362638 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.362639 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sbtt\" (UniqueName: \"kubernetes.io/projected/a6315174-ab09-47b6-9767-b54c82cfb231-kube-api-access-7sbtt\") pod \"cert-manager-59c77684cc-rdf2c\" (UID: \"a6315174-ab09-47b6-9767-b54c82cfb231\") " pod="cert-manager/cert-manager-59c77684cc-rdf2c" Jun 11 16:52:34.464085 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.463999 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6315174-ab09-47b6-9767-b54c82cfb231-bound-sa-token\") pod \"cert-manager-59c77684cc-rdf2c\" (UID: \"a6315174-ab09-47b6-9767-b54c82cfb231\") " pod="cert-manager/cert-manager-59c77684cc-rdf2c" Jun 11 16:52:34.464085 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.464035 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sbtt\" (UniqueName: \"kubernetes.io/projected/a6315174-ab09-47b6-9767-b54c82cfb231-kube-api-access-7sbtt\") pod \"cert-manager-59c77684cc-rdf2c\" (UID: \"a6315174-ab09-47b6-9767-b54c82cfb231\") " pod="cert-manager/cert-manager-59c77684cc-rdf2c" Jun 11 16:52:34.473195 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.473164 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6315174-ab09-47b6-9767-b54c82cfb231-bound-sa-token\") pod \"cert-manager-59c77684cc-rdf2c\" (UID: \"a6315174-ab09-47b6-9767-b54c82cfb231\") " pod="cert-manager/cert-manager-59c77684cc-rdf2c" Jun 11 16:52:34.473335 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.473316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sbtt\" (UniqueName: \"kubernetes.io/projected/a6315174-ab09-47b6-9767-b54c82cfb231-kube-api-access-7sbtt\") pod \"cert-manager-59c77684cc-rdf2c\" (UID: \"a6315174-ab09-47b6-9767-b54c82cfb231\") " pod="cert-manager/cert-manager-59c77684cc-rdf2c" Jun 11 16:52:34.484778 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.484758 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-rdf2c" Jun 11 16:52:34.608305 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.608273 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-rdf2c"] Jun 11 16:52:34.611702 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:52:34.611671 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6315174_ab09_47b6_9767_b54c82cfb231.slice/crio-d9dfba63df0fb7918e441fb37a395705cd664845672d41006646450d62ad258f WatchSource:0}: Error finding container d9dfba63df0fb7918e441fb37a395705cd664845672d41006646450d62ad258f: Status 404 returned error can't find the container with id d9dfba63df0fb7918e441fb37a395705cd664845672d41006646450d62ad258f Jun 11 16:52:34.917609 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.917569 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-rdf2c" event={"ID":"a6315174-ab09-47b6-9767-b54c82cfb231","Type":"ContainerStarted","Data":"c67ae98ae1e2db1368ca5a50bea211c392ec06a4f4794ef6100976bce82a5caa"} Jun 11 16:52:34.917820 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.917618 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-rdf2c" event={"ID":"a6315174-ab09-47b6-9767-b54c82cfb231","Type":"ContainerStarted","Data":"d9dfba63df0fb7918e441fb37a395705cd664845672d41006646450d62ad258f"} Jun 11 16:52:34.937255 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:34.937205 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-rdf2c" podStartSLOduration=0.937189799 podStartE2EDuration="937.189799ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:34.936137741 +0000 UTC m=+489.317696276" watchObservedRunningTime="2026-06-11 16:52:34.937189799 +0000 UTC m=+489.318748334" Jun 11 16:52:43.261560 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:43.261528 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:43.362511 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:43.362471 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:48.800016 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:48.799982 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:49.393913 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:49.393873 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:49.509286 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:49.509255 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:50.070923 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.070887 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:50.164465 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.164431 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:50.240433 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.240401 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp"] Jun 11 16:52:50.243925 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.243906 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.259597 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.259566 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:52:50.264460 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.264439 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:52:50.264600 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.264558 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:52:50.267254 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.267239 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:52:50.267356 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.267340 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vh62b\"" Jun 11 16:52:50.277666 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.277636 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae84eef7-5811-4500-8a28-0ec1a4221e2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.277788 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.277686 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae84eef7-5811-4500-8a28-0ec1a4221e2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.277788 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.277765 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae84eef7-5811-4500-8a28-0ec1a4221e2a-tmp\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.277879 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.277795 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae84eef7-5811-4500-8a28-0ec1a4221e2a-manifests\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.277879 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.277822 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzslx\" (UniqueName: \"kubernetes.io/projected/ae84eef7-5811-4500-8a28-0ec1a4221e2a-kube-api-access-tzslx\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.285908 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.285887 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp"] Jun 11 16:52:50.378988 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.378904 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae84eef7-5811-4500-8a28-0ec1a4221e2a-tmp\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.378988 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.378937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae84eef7-5811-4500-8a28-0ec1a4221e2a-manifests\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.378988 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.378960 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzslx\" (UniqueName: \"kubernetes.io/projected/ae84eef7-5811-4500-8a28-0ec1a4221e2a-kube-api-access-tzslx\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.379198 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.379005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae84eef7-5811-4500-8a28-0ec1a4221e2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.379198 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.379029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae84eef7-5811-4500-8a28-0ec1a4221e2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.379387 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.379359 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae84eef7-5811-4500-8a28-0ec1a4221e2a-manifests\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.381195 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.381167 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae84eef7-5811-4500-8a28-0ec1a4221e2a-tmp\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.381487 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.381467 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae84eef7-5811-4500-8a28-0ec1a4221e2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.381555 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.381468 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae84eef7-5811-4500-8a28-0ec1a4221e2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.390279 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.390257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzslx\" (UniqueName: \"kubernetes.io/projected/ae84eef7-5811-4500-8a28-0ec1a4221e2a-kube-api-access-tzslx\") pod \"opendatahub-operator-controller-manager-f54898884-95xpp\" (UID: \"ae84eef7-5811-4500-8a28-0ec1a4221e2a\") " pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.492093 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.492052 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:50.554364 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.554333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:50.590877 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.590847 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:50.665621 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.665585 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:50.691665 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.691645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp"] Jun 11 16:52:50.693949 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:52:50.693924 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae84eef7_5811_4500_8a28_0ec1a4221e2a.slice/crio-746a4893b6c68ba22510f0034a6d1ed378967b7859bd157070659c95960013ec WatchSource:0}: Error finding container 746a4893b6c68ba22510f0034a6d1ed378967b7859bd157070659c95960013ec: Status 404 returned error can't find the container with id 746a4893b6c68ba22510f0034a6d1ed378967b7859bd157070659c95960013ec Jun 11 16:52:50.738868 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.738833 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:50.847014 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.846987 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:50.939393 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.939306 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:52:50.975357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:50.975318 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" event={"ID":"ae84eef7-5811-4500-8a28-0ec1a4221e2a","Type":"ContainerStarted","Data":"746a4893b6c68ba22510f0034a6d1ed378967b7859bd157070659c95960013ec"} Jun 11 16:52:53.991625 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:53.991586 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" event={"ID":"ae84eef7-5811-4500-8a28-0ec1a4221e2a","Type":"ContainerStarted","Data":"1866f1011bc8b3443abe6cd72c2686b6cec7198bdcb239311748e119dfe61740"} Jun 11 16:52:54.997123 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:54.997088 2558 generic.go:356] "Generic (PLEG): container finished" podID="ae84eef7-5811-4500-8a28-0ec1a4221e2a" containerID="1866f1011bc8b3443abe6cd72c2686b6cec7198bdcb239311748e119dfe61740" exitCode=0 Jun 11 16:52:54.997500 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:54.997154 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" event={"ID":"ae84eef7-5811-4500-8a28-0ec1a4221e2a","Type":"ContainerDied","Data":"1866f1011bc8b3443abe6cd72c2686b6cec7198bdcb239311748e119dfe61740"} Jun 11 16:52:56.004255 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:56.004221 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" event={"ID":"ae84eef7-5811-4500-8a28-0ec1a4221e2a","Type":"ContainerStarted","Data":"172c08bbfbb27d84fb1a368a624aac0e7ba27ccef0861868ded60937e9309067"} Jun 11 16:52:56.004744 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:56.004402 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:52:56.039338 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:52:56.039282 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" podStartSLOduration=1.765952084 podStartE2EDuration="6.039264808s" totalImagesPullingTime="3.213284237s" totalInitContainerRuntime="1.060028487s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:52:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:52:56.036556602 +0000 UTC m=+510.418115161" watchObservedRunningTime="2026-06-11 16:52:56.039264808 +0000 UTC m=+510.420823342" Jun 11 16:53:00.622540 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:00.622507 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:00.757357 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:00.757327 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:07.011904 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:07.011824 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f54898884-95xpp" Jun 11 16:53:10.078113 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:10.078064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:10.274491 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:10.274449 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:10.557203 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:10.557165 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:11.085985 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.085950 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bncnn"] Jun 11 16:53:11.093494 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.093465 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:11.096997 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.096962 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6lqh2\"" Jun 11 16:53:11.097502 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.097479 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 16:53:11.110160 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.110130 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bncnn"] Jun 11 16:53:11.148219 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.148182 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26a7a4f-6597-4adb-b33e-672f555ace54-cert\") pod \"odh-model-controller-6dc94f689f-bncnn\" (UID: \"a26a7a4f-6597-4adb-b33e-672f555ace54\") " pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:11.148219 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.148231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w98fm\" (UniqueName: \"kubernetes.io/projected/a26a7a4f-6597-4adb-b33e-672f555ace54-kube-api-access-w98fm\") pod \"odh-model-controller-6dc94f689f-bncnn\" (UID: \"a26a7a4f-6597-4adb-b33e-672f555ace54\") " pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:11.206173 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.206138 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:11.249064 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.249025 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26a7a4f-6597-4adb-b33e-672f555ace54-cert\") pod \"odh-model-controller-6dc94f689f-bncnn\" (UID: \"a26a7a4f-6597-4adb-b33e-672f555ace54\") " pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:11.249224 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.249077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w98fm\" (UniqueName: \"kubernetes.io/projected/a26a7a4f-6597-4adb-b33e-672f555ace54-kube-api-access-w98fm\") pod \"odh-model-controller-6dc94f689f-bncnn\" (UID: \"a26a7a4f-6597-4adb-b33e-672f555ace54\") " pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:11.249224 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:53:11.249170 2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 16:53:11.249294 ip-10-0-143-112 kubenswrapper[2558]: E0611 16:53:11.249245 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a26a7a4f-6597-4adb-b33e-672f555ace54-cert podName:a26a7a4f-6597-4adb-b33e-672f555ace54 nodeName:}" failed. No retries permitted until 2026-06-11 16:53:11.74922698 +0000 UTC m=+526.130785494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a26a7a4f-6597-4adb-b33e-672f555ace54-cert") pod "odh-model-controller-6dc94f689f-bncnn" (UID: "a26a7a4f-6597-4adb-b33e-672f555ace54") : secret "odh-model-controller-webhook-cert" not found Jun 11 16:53:11.270145 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.270117 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w98fm\" (UniqueName: \"kubernetes.io/projected/a26a7a4f-6597-4adb-b33e-672f555ace54-kube-api-access-w98fm\") pod \"odh-model-controller-6dc94f689f-bncnn\" (UID: \"a26a7a4f-6597-4adb-b33e-672f555ace54\") " pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:11.398868 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.398780 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:11.618983 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.618952 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:11.753113 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.753083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26a7a4f-6597-4adb-b33e-672f555ace54-cert\") pod \"odh-model-controller-6dc94f689f-bncnn\" (UID: \"a26a7a4f-6597-4adb-b33e-672f555ace54\") " pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:11.755437 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.755413 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a26a7a4f-6597-4adb-b33e-672f555ace54-cert\") pod \"odh-model-controller-6dc94f689f-bncnn\" (UID: \"a26a7a4f-6597-4adb-b33e-672f555ace54\") " pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:11.778431 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:11.778399 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:12.004175 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.004079 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:12.161186 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.161147 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:12.162073 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.162048 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bncnn"] Jun 11 16:53:12.163262 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:53:12.163238 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26a7a4f_6597_4adb_b33e_672f555ace54.slice/crio-08719ac6c4c612501481a46b1829a333404461d37b47c0b28a3b4561086acd90 WatchSource:0}: Error finding container 08719ac6c4c612501481a46b1829a333404461d37b47c0b28a3b4561086acd90: Status 404 returned error can't find the container with id 08719ac6c4c612501481a46b1829a333404461d37b47c0b28a3b4561086acd90 Jun 11 16:53:12.165686 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.165662 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ph5mn"] Jun 11 16:53:12.170215 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.170199 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" Jun 11 16:53:12.173100 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.173081 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-r88wz\"" Jun 11 16:53:12.173198 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.173101 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 16:53:12.186892 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.186492 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ph5mn"] Jun 11 16:53:12.257512 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.257429 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be99b20a-447b-4925-b4ab-21d94b242468-tls-certs\") pod \"model-serving-api-5dd488fc48-ph5mn\" (UID: \"be99b20a-447b-4925-b4ab-21d94b242468\") " pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" Jun 11 16:53:12.257512 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.257476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqs6d\" (UniqueName: \"kubernetes.io/projected/be99b20a-447b-4925-b4ab-21d94b242468-kube-api-access-gqs6d\") pod \"model-serving-api-5dd488fc48-ph5mn\" (UID: \"be99b20a-447b-4925-b4ab-21d94b242468\") " pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" Jun 11 16:53:12.334950 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.334913 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:12.358529 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.358481 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be99b20a-447b-4925-b4ab-21d94b242468-tls-certs\") pod \"model-serving-api-5dd488fc48-ph5mn\" (UID: \"be99b20a-447b-4925-b4ab-21d94b242468\") " pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" Jun 11 16:53:12.358529 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.358540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqs6d\" (UniqueName: \"kubernetes.io/projected/be99b20a-447b-4925-b4ab-21d94b242468-kube-api-access-gqs6d\") pod \"model-serving-api-5dd488fc48-ph5mn\" (UID: \"be99b20a-447b-4925-b4ab-21d94b242468\") " pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" Jun 11 16:53:12.360914 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.360893 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be99b20a-447b-4925-b4ab-21d94b242468-tls-certs\") pod \"model-serving-api-5dd488fc48-ph5mn\" (UID: \"be99b20a-447b-4925-b4ab-21d94b242468\") " pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" Jun 11 16:53:12.368509 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.368486 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqs6d\" (UniqueName: \"kubernetes.io/projected/be99b20a-447b-4925-b4ab-21d94b242468-kube-api-access-gqs6d\") pod \"model-serving-api-5dd488fc48-ph5mn\" (UID: \"be99b20a-447b-4925-b4ab-21d94b242468\") " pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" Jun 11 16:53:12.480846 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.480813 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" Jun 11 16:53:12.615229 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:12.615203 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ph5mn"] Jun 11 16:53:12.617811 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:53:12.617779 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe99b20a_447b_4925_b4ab_21d94b242468.slice/crio-e9f00752679905710ad89b49f498f70611e3a2aff73b72f1f43ea22626055f95 WatchSource:0}: Error finding container e9f00752679905710ad89b49f498f70611e3a2aff73b72f1f43ea22626055f95: Status 404 returned error can't find the container with id e9f00752679905710ad89b49f498f70611e3a2aff73b72f1f43ea22626055f95 Jun 11 16:53:13.082509 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:13.082463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" event={"ID":"be99b20a-447b-4925-b4ab-21d94b242468","Type":"ContainerStarted","Data":"e9f00752679905710ad89b49f498f70611e3a2aff73b72f1f43ea22626055f95"} Jun 11 16:53:13.085385 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:13.085348 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" event={"ID":"a26a7a4f-6597-4adb-b33e-672f555ace54","Type":"ContainerStarted","Data":"08719ac6c4c612501481a46b1829a333404461d37b47c0b28a3b4561086acd90"} Jun 11 16:53:13.858567 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:13.858517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:13.958796 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:13.958754 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:16.101491 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.101461 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" event={"ID":"be99b20a-447b-4925-b4ab-21d94b242468","Type":"ContainerStarted","Data":"e80b94f0cc203dfa92f93fb3e08fe54dce2822cac3cd35f2b0e898dea10490dc"} Jun 11 16:53:16.101941 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.101550 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" Jun 11 16:53:16.103184 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.103158 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" event={"ID":"a26a7a4f-6597-4adb-b33e-672f555ace54","Type":"ContainerStarted","Data":"fab526b50c78413bac92a6843ec7ed8d465370b3c13cc66e8e66531e3218702c"} Jun 11 16:53:16.103298 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.103287 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:16.119680 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.119442 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" podStartSLOduration=0.696173246 podStartE2EDuration="4.119424194s" totalImagesPullingTime="3.423250948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:16.118814871 +0000 UTC m=+530.500373406" watchObservedRunningTime="2026-06-11 16:53:16.119424194 +0000 UTC m=+530.500982731" Jun 11 16:53:16.139240 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.139188 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" podStartSLOduration=1.299613451 podStartE2EDuration="5.13917338s" totalImagesPullingTime="3.839559929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:16.137188114 +0000 UTC m=+530.518746648" watchObservedRunningTime="2026-06-11 16:53:16.13917338 +0000 UTC m=+530.520731946" Jun 11 16:53:16.193737 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.193696 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:16.292953 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.292859 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:16.399244 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.399203 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb"] Jun 11 16:53:16.402525 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.402500 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.418081 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.418056 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b7x4l\"" Jun 11 16:53:16.418320 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.418290 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:53:16.418413 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.418362 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 16:53:16.418413 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.418378 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:53:16.418413 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.418391 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 16:53:16.452955 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.452925 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb"] Jun 11 16:53:16.495649 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.495610 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc42947e-9eba-42ad-9a71-3b3732224e99-tls-certs\") pod \"kube-auth-proxy-588969d7f4-tkdsb\" (UID: \"bc42947e-9eba-42ad-9a71-3b3732224e99\") " pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.495867 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.495674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc42947e-9eba-42ad-9a71-3b3732224e99-tmp\") pod \"kube-auth-proxy-588969d7f4-tkdsb\" (UID: \"bc42947e-9eba-42ad-9a71-3b3732224e99\") " pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.495867 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.495739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8khhn\" (UniqueName: \"kubernetes.io/projected/bc42947e-9eba-42ad-9a71-3b3732224e99-kube-api-access-8khhn\") pod \"kube-auth-proxy-588969d7f4-tkdsb\" (UID: \"bc42947e-9eba-42ad-9a71-3b3732224e99\") " pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.587812 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.587703 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:16.596601 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.596565 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc42947e-9eba-42ad-9a71-3b3732224e99-tls-certs\") pod \"kube-auth-proxy-588969d7f4-tkdsb\" (UID: \"bc42947e-9eba-42ad-9a71-3b3732224e99\") " pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.596601 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.596607 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc42947e-9eba-42ad-9a71-3b3732224e99-tmp\") pod \"kube-auth-proxy-588969d7f4-tkdsb\" (UID: \"bc42947e-9eba-42ad-9a71-3b3732224e99\") " pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.596882 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.596634 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8khhn\" (UniqueName: \"kubernetes.io/projected/bc42947e-9eba-42ad-9a71-3b3732224e99-kube-api-access-8khhn\") pod \"kube-auth-proxy-588969d7f4-tkdsb\" (UID: \"bc42947e-9eba-42ad-9a71-3b3732224e99\") " pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.599452 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.599412 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc42947e-9eba-42ad-9a71-3b3732224e99-tmp\") pod \"kube-auth-proxy-588969d7f4-tkdsb\" (UID: \"bc42947e-9eba-42ad-9a71-3b3732224e99\") " pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.599580 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.599505 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc42947e-9eba-42ad-9a71-3b3732224e99-tls-certs\") pod \"kube-auth-proxy-588969d7f4-tkdsb\" (UID: \"bc42947e-9eba-42ad-9a71-3b3732224e99\") " pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.606283 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.606255 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8khhn\" (UniqueName: \"kubernetes.io/projected/bc42947e-9eba-42ad-9a71-3b3732224e99-kube-api-access-8khhn\") pod \"kube-auth-proxy-588969d7f4-tkdsb\" (UID: \"bc42947e-9eba-42ad-9a71-3b3732224e99\") " pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.715799 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.715758 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" Jun 11 16:53:16.856870 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:53:16.856838 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc42947e_9eba_42ad_9a71_3b3732224e99.slice/crio-adc2e09846c80854dcd523cd837ff7f3c13a691653745425359f8fbf57fdb89f WatchSource:0}: Error finding container adc2e09846c80854dcd523cd837ff7f3c13a691653745425359f8fbf57fdb89f: Status 404 returned error can't find the container with id adc2e09846c80854dcd523cd837ff7f3c13a691653745425359f8fbf57fdb89f Jun 11 16:53:16.857517 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:16.857435 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb"] Jun 11 16:53:17.109208 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:17.109126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" event={"ID":"bc42947e-9eba-42ad-9a71-3b3732224e99","Type":"ContainerStarted","Data":"adc2e09846c80854dcd523cd837ff7f3c13a691653745425359f8fbf57fdb89f"} Jun 11 16:53:20.121847 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:20.121807 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" event={"ID":"bc42947e-9eba-42ad-9a71-3b3732224e99","Type":"ContainerStarted","Data":"ee921628fade04867e54c6256e5c5bb8225dfd5de8dff987cfcd654bb646d684"} Jun 11 16:53:20.141227 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:20.141173 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-588969d7f4-tkdsb" podStartSLOduration=1.708114065 podStartE2EDuration="4.141158266s" totalImagesPullingTime="2.433044201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:20.140091218 +0000 UTC m=+534.521649755" watchObservedRunningTime="2026-06-11 16:53:20.141158266 +0000 UTC m=+534.522716801" Jun 11 16:53:22.152172 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.152136 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:22.232405 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.232369 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qlws2"] Jun 11 16:53:22.235986 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.235967 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" Jun 11 16:53:22.239001 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.238979 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6cwdb\"" Jun 11 16:53:22.239247 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.239213 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 16:53:22.259455 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.259425 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td"] Jun 11 16:53:22.263008 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.262986 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qlws2"] Jun 11 16:53:22.263141 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.263091 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" Jun 11 16:53:22.267696 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.267673 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jwhc2\"" Jun 11 16:53:22.267931 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.267912 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 16:53:22.284252 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.284227 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td"] Jun 11 16:53:22.288275 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.288249 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:22.349500 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.349466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl8mm\" (UniqueName: \"kubernetes.io/projected/7b8fde6e-1632-4b9d-b5b2-1fe613bf4848-kube-api-access-nl8mm\") pod \"kserve-controller-manager-69fc866d76-qlws2\" (UID: \"7b8fde6e-1632-4b9d-b5b2-1fe613bf4848\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" Jun 11 16:53:22.349500 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.349516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vccnr\" (UniqueName: \"kubernetes.io/projected/0dbcc482-8758-4c39-a761-3e686f90e23f-kube-api-access-vccnr\") pod \"llmisvc-controller-manager-864bfd7bc9-5w6td\" (UID: \"0dbcc482-8758-4c39-a761-3e686f90e23f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" Jun 11 16:53:22.349729 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.349539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b8fde6e-1632-4b9d-b5b2-1fe613bf4848-cert\") pod \"kserve-controller-manager-69fc866d76-qlws2\" (UID: \"7b8fde6e-1632-4b9d-b5b2-1fe613bf4848\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" Jun 11 16:53:22.349729 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.349620 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbcc482-8758-4c39-a761-3e686f90e23f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5w6td\" (UID: \"0dbcc482-8758-4c39-a761-3e686f90e23f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" Jun 11 16:53:22.391176 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.391129 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:22.450818 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.450707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl8mm\" (UniqueName: \"kubernetes.io/projected/7b8fde6e-1632-4b9d-b5b2-1fe613bf4848-kube-api-access-nl8mm\") pod \"kserve-controller-manager-69fc866d76-qlws2\" (UID: \"7b8fde6e-1632-4b9d-b5b2-1fe613bf4848\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" Jun 11 16:53:22.450818 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.450780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vccnr\" (UniqueName: \"kubernetes.io/projected/0dbcc482-8758-4c39-a761-3e686f90e23f-kube-api-access-vccnr\") pod \"llmisvc-controller-manager-864bfd7bc9-5w6td\" (UID: \"0dbcc482-8758-4c39-a761-3e686f90e23f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" Jun 11 16:53:22.450818 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.450805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b8fde6e-1632-4b9d-b5b2-1fe613bf4848-cert\") pod \"kserve-controller-manager-69fc866d76-qlws2\" (UID: \"7b8fde6e-1632-4b9d-b5b2-1fe613bf4848\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" Jun 11 16:53:22.451053 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.450839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbcc482-8758-4c39-a761-3e686f90e23f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5w6td\" (UID: \"0dbcc482-8758-4c39-a761-3e686f90e23f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" Jun 11 16:53:22.453464 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.453439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbcc482-8758-4c39-a761-3e686f90e23f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5w6td\" (UID: \"0dbcc482-8758-4c39-a761-3e686f90e23f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" Jun 11 16:53:22.453464 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.453450 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b8fde6e-1632-4b9d-b5b2-1fe613bf4848-cert\") pod \"kserve-controller-manager-69fc866d76-qlws2\" (UID: \"7b8fde6e-1632-4b9d-b5b2-1fe613bf4848\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" Jun 11 16:53:22.457753 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.457689 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:22.460761 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.460701 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vccnr\" (UniqueName: \"kubernetes.io/projected/0dbcc482-8758-4c39-a761-3e686f90e23f-kube-api-access-vccnr\") pod \"llmisvc-controller-manager-864bfd7bc9-5w6td\" (UID: \"0dbcc482-8758-4c39-a761-3e686f90e23f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" Jun 11 16:53:22.460903 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.460785 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl8mm\" (UniqueName: \"kubernetes.io/projected/7b8fde6e-1632-4b9d-b5b2-1fe613bf4848-kube-api-access-nl8mm\") pod \"kserve-controller-manager-69fc866d76-qlws2\" (UID: \"7b8fde6e-1632-4b9d-b5b2-1fe613bf4848\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" Jun 11 16:53:22.547180 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.547139 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" Jun 11 16:53:22.573561 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.573528 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" Jun 11 16:53:22.707452 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.707417 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qlws2"] Jun 11 16:53:22.707635 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.707617 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:22.709954 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:53:22.709930 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8fde6e_1632_4b9d_b5b2_1fe613bf4848.slice/crio-23b45b0bb29e5caf2c40af3e91befb734cc47f8f09d6b65ec8ae531168bd3f39 WatchSource:0}: Error finding container 23b45b0bb29e5caf2c40af3e91befb734cc47f8f09d6b65ec8ae531168bd3f39: Status 404 returned error can't find the container with id 23b45b0bb29e5caf2c40af3e91befb734cc47f8f09d6b65ec8ae531168bd3f39 Jun 11 16:53:22.746619 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:22.746535 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td"] Jun 11 16:53:22.749018 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:53:22.748994 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0dbcc482_8758_4c39_a761_3e686f90e23f.slice/crio-b61b16a185873d9e21176ead1510481cf1a39fa4a1da3a5925163962e867c5d8 WatchSource:0}: Error finding container b61b16a185873d9e21176ead1510481cf1a39fa4a1da3a5925163962e867c5d8: Status 404 returned error can't find the container with id b61b16a185873d9e21176ead1510481cf1a39fa4a1da3a5925163962e867c5d8 Jun 11 16:53:23.134428 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:23.134394 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" event={"ID":"0dbcc482-8758-4c39-a761-3e686f90e23f","Type":"ContainerStarted","Data":"b61b16a185873d9e21176ead1510481cf1a39fa4a1da3a5925163962e867c5d8"} Jun 11 16:53:23.135582 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:23.135559 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" event={"ID":"7b8fde6e-1632-4b9d-b5b2-1fe613bf4848","Type":"ContainerStarted","Data":"23b45b0bb29e5caf2c40af3e91befb734cc47f8f09d6b65ec8ae531168bd3f39"} Jun 11 16:53:23.362384 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:23.362346 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:23.523419 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:23.523389 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:23.686313 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:23.686270 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:24.216859 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:24.216819 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:24.295752 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:24.295691 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:25.146512 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:25.146477 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" event={"ID":"7b8fde6e-1632-4b9d-b5b2-1fe613bf4848","Type":"ContainerStarted","Data":"61b4294c6b82cba7a775030fdf6c2d327eb7c6dec82fd290d9cdcc1e66d0b117"} Jun 11 16:53:25.147033 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:25.146588 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" Jun 11 16:53:25.168305 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:25.168211 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" podStartSLOduration=0.967705147 podStartE2EDuration="3.168196956s" totalImagesPullingTime="2.200491809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:25.165680487 +0000 UTC m=+539.547239041" watchObservedRunningTime="2026-06-11 16:53:25.168196956 +0000 UTC m=+539.549755490" Jun 11 16:53:26.151556 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:26.151476 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" event={"ID":"0dbcc482-8758-4c39-a761-3e686f90e23f","Type":"ContainerStarted","Data":"e753169e35ded0beeed9ee313407e24c1aa72aed41b78bb74a27fe54b1be00c8"} Jun 11 16:53:26.151965 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:26.151674 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" Jun 11 16:53:26.171665 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:26.171614 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" podStartSLOduration=1.133699783 podStartE2EDuration="4.171598745s" totalImagesPullingTime="3.037898962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:26.170267637 +0000 UTC m=+540.551826172" watchObservedRunningTime="2026-06-11 16:53:26.171598745 +0000 UTC m=+540.553157279" Jun 11 16:53:27.111965 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:27.111935 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-bncnn" Jun 11 16:53:27.113918 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:27.113896 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-ph5mn" Jun 11 16:53:29.295619 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:29.295582 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:29.404023 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:29.403989 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:30.050927 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:30.050893 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:31.620185 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:31.620149 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:31.820320 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:31.820283 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:32.106066 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:32.106031 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:32.308732 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:32.308688 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:33.054613 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.054562 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:33.468108 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.468033 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6879556547-kbsh4"] Jun 11 16:53:33.473073 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.473053 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6879556547-kbsh4" Jun 11 16:53:33.476296 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.476274 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 16:53:33.476447 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.476384 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t59l5\"" Jun 11 16:53:33.491842 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.491806 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6879556547-kbsh4"] Jun 11 16:53:33.552100 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.552065 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:33.654104 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.654064 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr8jx\" (UniqueName: \"kubernetes.io/projected/b815b1b9-f751-4724-8d8f-090b83484b3e-kube-api-access-nr8jx\") pod \"dashboard-redirect-6879556547-kbsh4\" (UID: \"b815b1b9-f751-4724-8d8f-090b83484b3e\") " pod="opendatahub/dashboard-redirect-6879556547-kbsh4" Jun 11 16:53:33.654257 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.654122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b815b1b9-f751-4724-8d8f-090b83484b3e-redirect-config\") pod \"dashboard-redirect-6879556547-kbsh4\" (UID: \"b815b1b9-f751-4724-8d8f-090b83484b3e\") " pod="opendatahub/dashboard-redirect-6879556547-kbsh4" Jun 11 16:53:33.754961 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.754924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr8jx\" (UniqueName: \"kubernetes.io/projected/b815b1b9-f751-4724-8d8f-090b83484b3e-kube-api-access-nr8jx\") pod \"dashboard-redirect-6879556547-kbsh4\" (UID: \"b815b1b9-f751-4724-8d8f-090b83484b3e\") " pod="opendatahub/dashboard-redirect-6879556547-kbsh4" Jun 11 16:53:33.755136 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.754976 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b815b1b9-f751-4724-8d8f-090b83484b3e-redirect-config\") pod \"dashboard-redirect-6879556547-kbsh4\" (UID: \"b815b1b9-f751-4724-8d8f-090b83484b3e\") " pod="opendatahub/dashboard-redirect-6879556547-kbsh4" Jun 11 16:53:33.755657 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.755637 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b815b1b9-f751-4724-8d8f-090b83484b3e-redirect-config\") pod \"dashboard-redirect-6879556547-kbsh4\" (UID: \"b815b1b9-f751-4724-8d8f-090b83484b3e\") " pod="opendatahub/dashboard-redirect-6879556547-kbsh4" Jun 11 16:53:33.767709 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.767681 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr8jx\" (UniqueName: \"kubernetes.io/projected/b815b1b9-f751-4724-8d8f-090b83484b3e-kube-api-access-nr8jx\") pod \"dashboard-redirect-6879556547-kbsh4\" (UID: \"b815b1b9-f751-4724-8d8f-090b83484b3e\") " pod="opendatahub/dashboard-redirect-6879556547-kbsh4" Jun 11 16:53:33.792188 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.792149 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6879556547-kbsh4" Jun 11 16:53:33.946260 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:33.946234 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6879556547-kbsh4"] Jun 11 16:53:33.948633 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:53:33.948602 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb815b1b9_f751_4724_8d8f_090b83484b3e.slice/crio-5ae7f8becfc4c8b78bbf08a0d06970f286c81ef16fe54b4f01dbded61251dc3f WatchSource:0}: Error finding container 5ae7f8becfc4c8b78bbf08a0d06970f286c81ef16fe54b4f01dbded61251dc3f: Status 404 returned error can't find the container with id 5ae7f8becfc4c8b78bbf08a0d06970f286c81ef16fe54b4f01dbded61251dc3f Jun 11 16:53:34.119298 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.119220 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-r42tv"] Jun 11 16:53:34.123769 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.123743 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" Jun 11 16:53:34.128286 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.128263 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-2qk8c\"" Jun 11 16:53:34.128575 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.128560 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 16:53:34.129088 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.129074 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 16:53:34.187738 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.187680 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6879556547-kbsh4" event={"ID":"b815b1b9-f751-4724-8d8f-090b83484b3e","Type":"ContainerStarted","Data":"5ae7f8becfc4c8b78bbf08a0d06970f286c81ef16fe54b4f01dbded61251dc3f"} Jun 11 16:53:34.236281 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.236250 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-r42tv"] Jun 11 16:53:34.259049 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.259019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkrzx\" (UniqueName: \"kubernetes.io/projected/ef973a65-8caa-47c3-a54b-ebeaa768cc73-kube-api-access-fkrzx\") pod \"servicemesh-operator3-57f65f65fb-r42tv\" (UID: \"ef973a65-8caa-47c3-a54b-ebeaa768cc73\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" Jun 11 16:53:34.259195 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.259123 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ef973a65-8caa-47c3-a54b-ebeaa768cc73-operator-config\") pod \"servicemesh-operator3-57f65f65fb-r42tv\" (UID: \"ef973a65-8caa-47c3-a54b-ebeaa768cc73\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" Jun 11 16:53:34.360249 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.360214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ef973a65-8caa-47c3-a54b-ebeaa768cc73-operator-config\") pod \"servicemesh-operator3-57f65f65fb-r42tv\" (UID: \"ef973a65-8caa-47c3-a54b-ebeaa768cc73\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" Jun 11 16:53:34.360421 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.360303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkrzx\" (UniqueName: \"kubernetes.io/projected/ef973a65-8caa-47c3-a54b-ebeaa768cc73-kube-api-access-fkrzx\") pod \"servicemesh-operator3-57f65f65fb-r42tv\" (UID: \"ef973a65-8caa-47c3-a54b-ebeaa768cc73\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" Jun 11 16:53:34.362822 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.362798 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ef973a65-8caa-47c3-a54b-ebeaa768cc73-operator-config\") pod \"servicemesh-operator3-57f65f65fb-r42tv\" (UID: \"ef973a65-8caa-47c3-a54b-ebeaa768cc73\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" Jun 11 16:53:34.370386 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.370334 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkrzx\" (UniqueName: \"kubernetes.io/projected/ef973a65-8caa-47c3-a54b-ebeaa768cc73-kube-api-access-fkrzx\") pod \"servicemesh-operator3-57f65f65fb-r42tv\" (UID: \"ef973a65-8caa-47c3-a54b-ebeaa768cc73\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" Jun 11 16:53:34.433362 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.433329 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" Jun 11 16:53:34.579077 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:34.579052 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-r42tv"] Jun 11 16:53:34.579956 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:53:34.579931 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef973a65_8caa_47c3_a54b_ebeaa768cc73.slice/crio-dcf511c91587dd5124b93ddca6f33996e8098484f05c66a12e800adf7f765fe1 WatchSource:0}: Error finding container dcf511c91587dd5124b93ddca6f33996e8098484f05c66a12e800adf7f765fe1: Status 404 returned error can't find the container with id dcf511c91587dd5124b93ddca6f33996e8098484f05c66a12e800adf7f765fe1 Jun 11 16:53:35.197481 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:35.197401 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" event={"ID":"ef973a65-8caa-47c3-a54b-ebeaa768cc73","Type":"ContainerStarted","Data":"dcf511c91587dd5124b93ddca6f33996e8098484f05c66a12e800adf7f765fe1"} Jun 11 16:53:40.229597 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:40.229551 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" event={"ID":"ef973a65-8caa-47c3-a54b-ebeaa768cc73","Type":"ContainerStarted","Data":"16408cb0feedbc9e7b15fb35ad8df51fda0768305a69eac75882972d72c90b86"} Jun 11 16:53:40.230084 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:40.229651 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" Jun 11 16:53:40.231686 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:40.231646 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6879556547-kbsh4" event={"ID":"b815b1b9-f751-4724-8d8f-090b83484b3e","Type":"ContainerStarted","Data":"ed72a1b24ab1866991d9c8834b83cfaa67c0c8509fe7952952e846a7239d01b4"} Jun 11 16:53:40.253438 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:40.253396 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" podStartSLOduration=0.917234764 podStartE2EDuration="6.253373919s" totalImagesPullingTime="5.336139155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:40.251144904 +0000 UTC m=+554.632703439" watchObservedRunningTime="2026-06-11 16:53:40.253373919 +0000 UTC m=+554.634932454" Jun 11 16:53:40.271392 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:40.271331 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6879556547-kbsh4" podStartSLOduration=1.29554151 podStartE2EDuration="7.271312025s" totalImagesPullingTime="5.975770515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:40.268381395 +0000 UTC m=+554.649939931" watchObservedRunningTime="2026-06-11 16:53:40.271312025 +0000 UTC m=+554.652870561" Jun 11 16:53:42.760440 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:42.760394 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:42.869844 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:42.869790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:45.806465 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.806429 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr"] Jun 11 16:53:45.809184 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.809139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:45.811052 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.811034 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.813610 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.813588 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 16:53:45.813759 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.813607 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ldp2f\"" Jun 11 16:53:45.813759 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.813588 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 16:53:45.813759 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.813592 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 16:53:45.813912 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.813886 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 16:53:45.823048 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.823023 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr"] Jun 11 16:53:45.856538 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.856513 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.856677 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.856548 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.856677 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.856568 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.856781 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.856672 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.856781 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.856699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.856781 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.856763 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.856875 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.856786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpp6x\" (UniqueName: \"kubernetes.io/projected/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-kube-api-access-vpp6x\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.889667 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.889631 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:45.957960 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.957919 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.958146 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.957968 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.958146 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.957993 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.958146 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.958029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.958146 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.958061 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpp6x\" (UniqueName: \"kubernetes.io/projected/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-kube-api-access-vpp6x\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.958146 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.958113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.958469 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.958152 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.958768 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.958743 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.960980 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.960956 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.961104 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.960991 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.961104 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.961039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.961104 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.961053 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.966037 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.966011 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpp6x\" (UniqueName: \"kubernetes.io/projected/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-kube-api-access-vpp6x\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:45.966435 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:45.966408 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-6mqcr\" (UID: \"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:46.119748 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:46.119646 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:46.263945 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:46.263916 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr"] Jun 11 16:53:46.266098 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:53:46.266071 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ba6ed8_a5cd_4ff5_8f67_65160a33aa76.slice/crio-32ba706fd42200d16b70650c275a1fd1e2f72e1f0ffbd64474bfe92c077fec6b WatchSource:0}: Error finding container 32ba706fd42200d16b70650c275a1fd1e2f72e1f0ffbd64474bfe92c077fec6b: Status 404 returned error can't find the container with id 32ba706fd42200d16b70650c275a1fd1e2f72e1f0ffbd64474bfe92c077fec6b Jun 11 16:53:46.272737 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:46.272690 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:47.265909 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:47.265869 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" event={"ID":"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76","Type":"ContainerStarted","Data":"32ba706fd42200d16b70650c275a1fd1e2f72e1f0ffbd64474bfe92c077fec6b"} Jun 11 16:53:49.305481 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:49.305447 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 11 16:53:49.305759 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:49.305511 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 11 16:53:50.283191 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:50.283146 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" event={"ID":"e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76","Type":"ContainerStarted","Data":"8704b743a27a9f88303b91fd4124e30a1acb57fd565d36ad32411b422fe66989"} Jun 11 16:53:50.284386 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:50.284327 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:50.286361 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:50.286327 2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-6mqcr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 16:53:50.286584 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:50.286388 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" podUID="e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:53:50.309125 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:50.309068 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" podStartSLOduration=2.272028997 podStartE2EDuration="5.309053253s" totalImagesPullingTime="3.037024256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:53:50.307314475 +0000 UTC m=+564.688873002" watchObservedRunningTime="2026-06-11 16:53:50.309053253 +0000 UTC m=+564.690611787" Jun 11 16:53:50.321851 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:50.321819 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:50.424409 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:50.424374 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:50.617511 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:50.617436 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:50.861601 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:50.861566 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:51.060100 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:51.060067 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:51.238603 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:51.238570 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-r42tv" Jun 11 16:53:51.288086 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:51.288061 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-6mqcr" Jun 11 16:53:52.002639 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:52.002605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:53:56.156990 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:56.156962 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-qlws2" Jun 11 16:53:57.160134 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:53:57.160106 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5w6td" Jun 11 16:54:11.657703 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:11.657665 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:11.763649 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:11.763622 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:11.858164 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:11.858133 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:26.078935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:26.078902 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 16:54:26.082109 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:26.082083 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 16:54:26.084150 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:26.084129 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 16:54:26.086782 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:26.086762 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 16:54:28.216811 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:28.216779 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:39.138245 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:39.138159 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:39.237426 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:39.237398 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:39.339004 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:39.338969 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:42.693244 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:42.693206 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:43.284117 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:43.284071 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:43.761584 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:43.761544 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:43.895344 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:43.895308 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:47.847202 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:47.847169 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:50.120404 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:50.120371 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:50.568842 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:50.568814 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:52.076498 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:52.076460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:53.917042 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:53.917011 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:54.164967 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:54.164929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:55.747231 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:55.747200 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc"] Jun 11 16:54:55.750794 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:55.750778 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc" Jun 11 16:54:55.755051 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:55.755027 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:54:55.755615 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:55.755597 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 16:54:55.755665 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:55.755620 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mqxms\"" Jun 11 16:54:55.755665 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:55.755632 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:54:55.820085 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:55.820048 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc"] Jun 11 16:54:55.874387 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:55.874349 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdvnq\" (UniqueName: \"kubernetes.io/projected/0489de78-5804-45a7-8708-6f65cb1b7327-kube-api-access-gdvnq\") pod \"dns-operator-controller-manager-864dd78c4c-ngndc\" (UID: \"0489de78-5804-45a7-8708-6f65cb1b7327\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc" Jun 11 16:54:55.975421 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:55.975384 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdvnq\" (UniqueName: \"kubernetes.io/projected/0489de78-5804-45a7-8708-6f65cb1b7327-kube-api-access-gdvnq\") pod \"dns-operator-controller-manager-864dd78c4c-ngndc\" (UID: \"0489de78-5804-45a7-8708-6f65cb1b7327\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc" Jun 11 16:54:55.988725 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:55.988692 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdvnq\" (UniqueName: \"kubernetes.io/projected/0489de78-5804-45a7-8708-6f65cb1b7327-kube-api-access-gdvnq\") pod \"dns-operator-controller-manager-864dd78c4c-ngndc\" (UID: \"0489de78-5804-45a7-8708-6f65cb1b7327\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc" Jun 11 16:54:56.062095 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:56.061998 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc" Jun 11 16:54:56.201418 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:56.201363 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc"] Jun 11 16:54:56.203852 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:54:56.203821 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0489de78_5804_45a7_8708_6f65cb1b7327.slice/crio-78aa1147fa5c1f6309c14706974d198f18f840bc6444e371d9d3b39220a55456 WatchSource:0}: Error finding container 78aa1147fa5c1f6309c14706974d198f18f840bc6444e371d9d3b39220a55456: Status 404 returned error can't find the container with id 78aa1147fa5c1f6309c14706974d198f18f840bc6444e371d9d3b39220a55456 Jun 11 16:54:56.578147 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:56.578117 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc" event={"ID":"0489de78-5804-45a7-8708-6f65cb1b7327","Type":"ContainerStarted","Data":"78aa1147fa5c1f6309c14706974d198f18f840bc6444e371d9d3b39220a55456"} Jun 11 16:54:56.917443 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:56.917341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:57.010688 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:57.010656 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:57.313469 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:57.313427 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:57.415863 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:57.415831 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:54:58.588986 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:58.588940 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc" event={"ID":"0489de78-5804-45a7-8708-6f65cb1b7327","Type":"ContainerStarted","Data":"02d0a71ed57d059384b14e1fa6b7a87bccd114c96161b97c2259cb6be0565c5e"} Jun 11 16:54:58.589382 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:58.589008 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc" Jun 11 16:54:58.613432 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:54:58.613331 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc" podStartSLOduration=1.608165345 podStartE2EDuration="3.613312018s" totalImagesPullingTime="2.005146673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:54:58.612060804 +0000 UTC m=+632.993619339" watchObservedRunningTime="2026-06-11 16:54:58.613312018 +0000 UTC m=+632.994870556" Jun 11 16:55:01.157225 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:01.157191 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:01.255681 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:01.255647 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:04.696256 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:04.696217 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:04.913916 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:04.913879 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:09.595964 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:09.595934 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ngndc" Jun 11 16:55:11.258601 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:11.258569 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:11.467971 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:11.467935 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:12.197453 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:12.197420 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk"] Jun 11 16:55:12.200749 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:12.200708 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk" Jun 11 16:55:12.204428 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:12.204403 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kw78c\"" Jun 11 16:55:12.221783 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:12.221756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlc9f\" (UniqueName: \"kubernetes.io/projected/c6303f57-1d68-41e2-990f-c6dcf47010d5-kube-api-access-rlc9f\") pod \"limitador-operator-controller-manager-859d7b78bd-c44lk\" (UID: \"c6303f57-1d68-41e2-990f-c6dcf47010d5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk" Jun 11 16:55:12.223518 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:12.223498 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk"] Jun 11 16:55:12.322241 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:12.322201 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlc9f\" (UniqueName: \"kubernetes.io/projected/c6303f57-1d68-41e2-990f-c6dcf47010d5-kube-api-access-rlc9f\") pod \"limitador-operator-controller-manager-859d7b78bd-c44lk\" (UID: \"c6303f57-1d68-41e2-990f-c6dcf47010d5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk" Jun 11 16:55:12.355439 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:12.355407 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlc9f\" (UniqueName: \"kubernetes.io/projected/c6303f57-1d68-41e2-990f-c6dcf47010d5-kube-api-access-rlc9f\") pod \"limitador-operator-controller-manager-859d7b78bd-c44lk\" (UID: \"c6303f57-1d68-41e2-990f-c6dcf47010d5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk" Jun 11 16:55:12.511815 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:12.511785 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk" Jun 11 16:55:12.654959 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:12.654925 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk"] Jun 11 16:55:12.656976 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:55:12.656944 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6303f57_1d68_41e2_990f_c6dcf47010d5.slice/crio-522889932ae1c109e312d887672b72ac9c4b1bf2d6a5375a8462e6263ccc0323 WatchSource:0}: Error finding container 522889932ae1c109e312d887672b72ac9c4b1bf2d6a5375a8462e6263ccc0323: Status 404 returned error can't find the container with id 522889932ae1c109e312d887672b72ac9c4b1bf2d6a5375a8462e6263ccc0323 Jun 11 16:55:13.664034 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:13.663995 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk" event={"ID":"c6303f57-1d68-41e2-990f-c6dcf47010d5","Type":"ContainerStarted","Data":"522889932ae1c109e312d887672b72ac9c4b1bf2d6a5375a8462e6263ccc0323"} Jun 11 16:55:14.670205 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:14.670175 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk" event={"ID":"c6303f57-1d68-41e2-990f-c6dcf47010d5","Type":"ContainerStarted","Data":"1e60641b017f07f6d6aa89f89dab883dca7e2c6c75ca6dcf566c5cecfd08fc3d"} Jun 11 16:55:14.670585 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:14.670303 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk" Jun 11 16:55:14.696813 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:14.696771 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk" podStartSLOduration=1.198827703 podStartE2EDuration="2.696757958s" totalImagesPullingTime="1.497930255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:14.695368831 +0000 UTC m=+649.076927366" watchObservedRunningTime="2026-06-11 16:55:14.696757958 +0000 UTC m=+649.078316493" Jun 11 16:55:16.594425 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:16.594392 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:16.699329 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:16.699300 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:17.019274 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:17.019242 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:17.152699 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:17.152663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:20.593710 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:20.593664 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:20.697929 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:20.697878 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:24.591202 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:24.591162 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:24.695445 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:24.695413 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:25.676364 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:25.676333 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c44lk" Jun 11 16:55:32.372586 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:32.372548 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:32.473625 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:32.473585 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:52.716929 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:52.716893 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:53.209559 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:53.209523 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:54.009586 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.009553 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:54.102482 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.102432 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:54.379425 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.379333 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:54.482620 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.482560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:54.552402 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.552372 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:54.708758 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.708655 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 16:55:54.715548 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.715527 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" Jun 11 16:55:54.718426 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.718401 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qfjql\"" Jun 11 16:55:54.718548 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.718412 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 16:55:54.724351 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.724325 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 16:55:54.755543 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.755514 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 16:55:54.892151 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.892113 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ec3320be-7368-47a0-9950-f24a200cc12a-config-file\") pod \"limitador-limitador-54d6d988d5-lk9g6\" (UID: \"ec3320be-7368-47a0-9950-f24a200cc12a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" Jun 11 16:55:54.892326 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.892172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmmqg\" (UniqueName: \"kubernetes.io/projected/ec3320be-7368-47a0-9950-f24a200cc12a-kube-api-access-tmmqg\") pod \"limitador-limitador-54d6d988d5-lk9g6\" (UID: \"ec3320be-7368-47a0-9950-f24a200cc12a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" Jun 11 16:55:54.993088 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.993051 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmqg\" (UniqueName: \"kubernetes.io/projected/ec3320be-7368-47a0-9950-f24a200cc12a-kube-api-access-tmmqg\") pod \"limitador-limitador-54d6d988d5-lk9g6\" (UID: \"ec3320be-7368-47a0-9950-f24a200cc12a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" Jun 11 16:55:54.993246 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.993127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ec3320be-7368-47a0-9950-f24a200cc12a-config-file\") pod \"limitador-limitador-54d6d988d5-lk9g6\" (UID: \"ec3320be-7368-47a0-9950-f24a200cc12a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" Jun 11 16:55:54.993747 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:54.993700 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ec3320be-7368-47a0-9950-f24a200cc12a-config-file\") pod \"limitador-limitador-54d6d988d5-lk9g6\" (UID: \"ec3320be-7368-47a0-9950-f24a200cc12a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" Jun 11 16:55:55.002745 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:55.002697 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmmqg\" (UniqueName: \"kubernetes.io/projected/ec3320be-7368-47a0-9950-f24a200cc12a-kube-api-access-tmmqg\") pod \"limitador-limitador-54d6d988d5-lk9g6\" (UID: \"ec3320be-7368-47a0-9950-f24a200cc12a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" Jun 11 16:55:55.027714 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:55.027683 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" Jun 11 16:55:55.161865 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:55.161833 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 16:55:55.165126 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:55:55.165097 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3320be_7368_47a0_9950_f24a200cc12a.slice/crio-aa94313650bc3dd983cabcb347e474b1124278a7aa734094595255d9f1e1c759 WatchSource:0}: Error finding container aa94313650bc3dd983cabcb347e474b1124278a7aa734094595255d9f1e1c759: Status 404 returned error can't find the container with id aa94313650bc3dd983cabcb347e474b1124278a7aa734094595255d9f1e1c759 Jun 11 16:55:55.167195 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:55.167176 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:55:55.283451 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:55.283349 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:55.408595 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:55.408559 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:55:55.858097 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:55.858065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" event={"ID":"ec3320be-7368-47a0-9950-f24a200cc12a","Type":"ContainerStarted","Data":"aa94313650bc3dd983cabcb347e474b1124278a7aa734094595255d9f1e1c759"} Jun 11 16:55:57.870935 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:57.870847 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" event={"ID":"ec3320be-7368-47a0-9950-f24a200cc12a","Type":"ContainerStarted","Data":"df5a962704d306463f2c58d41a8c103a9cb8189d553b00fb3aceab96f323e9f9"} Jun 11 16:55:57.871281 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:57.870949 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" Jun 11 16:55:57.888071 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:55:57.888024 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" podStartSLOduration=1.473459222 podStartE2EDuration="3.888006787s" totalImagesPullingTime="2.414547565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:55:57.886107143 +0000 UTC m=+692.267665692" watchObservedRunningTime="2026-06-11 16:55:57.888006787 +0000 UTC m=+692.269565322" Jun 11 16:56:00.780759 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:56:00.780702 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:56:00.881812 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:56:00.881765 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:56:08.877248 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:56:08.877163 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lk9g6" Jun 11 16:56:10.502856 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:56:10.502824 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:56:20.800215 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:56:20.800178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:56:20.888300 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:56:20.888265 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:56:21.038283 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:56:21.038249 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:56:44.834819 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:56:44.834773 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:56:44.935374 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:56:44.935333 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:56:45.035146 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:56:45.035112 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:16.327874 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:16.327835 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:16.911565 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:16.911527 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:22.658290 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.658251 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:22.759625 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.759592 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:22.827259 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.827226 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:22.856570 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.856534 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c786bc658-r465h"] Jun 11 16:57:22.860024 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.859999 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 16:57:22.862781 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.862754 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pzdvc\"" Jun 11 16:57:22.862781 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.862775 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 16:57:22.864062 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.864044 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 16:57:22.867367 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.867341 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-694hp\" (UniqueName: \"kubernetes.io/projected/41daf867-5017-40cc-87e8-2b41a339f47a-kube-api-access-694hp\") pod \"maas-controller-7c786bc658-r465h\" (UID: \"41daf867-5017-40cc-87e8-2b41a339f47a\") " pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 16:57:22.867594 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.867570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41daf867-5017-40cc-87e8-2b41a339f47a-webhook-cert\") pod \"maas-controller-7c786bc658-r465h\" (UID: \"41daf867-5017-40cc-87e8-2b41a339f47a\") " pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 16:57:22.869981 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.869957 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c786bc658-r465h"] Jun 11 16:57:22.968047 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.967950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-694hp\" (UniqueName: \"kubernetes.io/projected/41daf867-5017-40cc-87e8-2b41a339f47a-kube-api-access-694hp\") pod \"maas-controller-7c786bc658-r465h\" (UID: \"41daf867-5017-40cc-87e8-2b41a339f47a\") " pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 16:57:22.968047 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.968023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41daf867-5017-40cc-87e8-2b41a339f47a-webhook-cert\") pod \"maas-controller-7c786bc658-r465h\" (UID: \"41daf867-5017-40cc-87e8-2b41a339f47a\") " pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 16:57:22.970488 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.970464 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41daf867-5017-40cc-87e8-2b41a339f47a-webhook-cert\") pod \"maas-controller-7c786bc658-r465h\" (UID: \"41daf867-5017-40cc-87e8-2b41a339f47a\") " pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 16:57:22.977384 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:22.977342 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-694hp\" (UniqueName: \"kubernetes.io/projected/41daf867-5017-40cc-87e8-2b41a339f47a-kube-api-access-694hp\") pod \"maas-controller-7c786bc658-r465h\" (UID: \"41daf867-5017-40cc-87e8-2b41a339f47a\") " pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 16:57:23.171276 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:23.171238 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 16:57:23.313132 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:23.313106 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c786bc658-r465h"] Jun 11 16:57:23.315287 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:57:23.315256 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41daf867_5017_40cc_87e8_2b41a339f47a.slice/crio-6089c269e405a5a54f07409ac86f090ddf5782ff4409130038e024414d471c0b WatchSource:0}: Error finding container 6089c269e405a5a54f07409ac86f090ddf5782ff4409130038e024414d471c0b: Status 404 returned error can't find the container with id 6089c269e405a5a54f07409ac86f090ddf5782ff4409130038e024414d471c0b Jun 11 16:57:24.274797 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:24.274756 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c786bc658-r465h" event={"ID":"41daf867-5017-40cc-87e8-2b41a339f47a","Type":"ContainerStarted","Data":"6089c269e405a5a54f07409ac86f090ddf5782ff4409130038e024414d471c0b"} Jun 11 16:57:25.885227 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:25.885173 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:26.027308 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:26.027264 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:26.284532 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:26.284496 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c786bc658-r465h" event={"ID":"41daf867-5017-40cc-87e8-2b41a339f47a","Type":"ContainerStarted","Data":"790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8"} Jun 11 16:57:26.284741 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:26.284592 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 16:57:26.315998 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:26.315941 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c786bc658-r465h" podStartSLOduration=1.8327523239999999 podStartE2EDuration="4.315920778s" totalImagesPullingTime="2.483168454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:57:26.315629189 +0000 UTC m=+780.697187744" watchObservedRunningTime="2026-06-11 16:57:26.315920778 +0000 UTC m=+780.697479314" Jun 11 16:57:37.294702 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:37.294624 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 16:57:37.544996 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:37.544890 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:55.085183 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.085148 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:55.345896 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.345816 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:55.578238 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.578193 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:55.677300 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.677216 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:57:55.727391 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.727360 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-jsfwb"] Jun 11 16:57:55.731062 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.731043 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-jsfwb" Jun 11 16:57:55.734248 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.734226 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6bfsd\"" Jun 11 16:57:55.734248 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.734235 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 16:57:55.745171 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.745149 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-jsfwb"] Jun 11 16:57:55.830187 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.830150 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 16:57:55.852006 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.851972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npq6h\" (UniqueName: \"kubernetes.io/projected/94f6ac45-bb41-47d4-b87d-55acb31aafbe-kube-api-access-npq6h\") pod \"payload-processing-699b6cd6c-jsfwb\" (UID: \"94f6ac45-bb41-47d4-b87d-55acb31aafbe\") " pod="openshift-ingress/payload-processing-699b6cd6c-jsfwb" Jun 11 16:57:55.953453 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.953354 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npq6h\" (UniqueName: \"kubernetes.io/projected/94f6ac45-bb41-47d4-b87d-55acb31aafbe-kube-api-access-npq6h\") pod \"payload-processing-699b6cd6c-jsfwb\" (UID: \"94f6ac45-bb41-47d4-b87d-55acb31aafbe\") " pod="openshift-ingress/payload-processing-699b6cd6c-jsfwb" Jun 11 16:57:55.962444 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:55.962415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npq6h\" (UniqueName: \"kubernetes.io/projected/94f6ac45-bb41-47d4-b87d-55acb31aafbe-kube-api-access-npq6h\") pod \"payload-processing-699b6cd6c-jsfwb\" (UID: \"94f6ac45-bb41-47d4-b87d-55acb31aafbe\") " pod="openshift-ingress/payload-processing-699b6cd6c-jsfwb" Jun 11 16:57:56.042114 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:56.042080 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-jsfwb" Jun 11 16:57:56.192242 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:56.192210 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-jsfwb"] Jun 11 16:57:56.196245 ip-10-0-143-112 kubenswrapper[2558]: W0611 16:57:56.196202 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f6ac45_bb41_47d4_b87d_55acb31aafbe.slice/crio-2ee2dd4164caf8ff75c6c38735034147bc3fca0a6c3dba2983db0bc8e4228c07 WatchSource:0}: Error finding container 2ee2dd4164caf8ff75c6c38735034147bc3fca0a6c3dba2983db0bc8e4228c07: Status 404 returned error can't find the container with id 2ee2dd4164caf8ff75c6c38735034147bc3fca0a6c3dba2983db0bc8e4228c07 Jun 11 16:57:56.422688 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:56.422654 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-jsfwb" event={"ID":"94f6ac45-bb41-47d4-b87d-55acb31aafbe","Type":"ContainerStarted","Data":"2ee2dd4164caf8ff75c6c38735034147bc3fca0a6c3dba2983db0bc8e4228c07"} Jun 11 16:57:58.434557 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:58.434521 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-jsfwb" event={"ID":"94f6ac45-bb41-47d4-b87d-55acb31aafbe","Type":"ContainerStarted","Data":"e96ea8da5c1c79d62be3c57ae018d938d37ebc572a20535f5230ee9e092a16cd"} Jun 11 16:57:58.434973 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:58.434710 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-jsfwb" Jun 11 16:57:58.456948 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:57:58.456901 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-jsfwb" podStartSLOduration=1.361637161 podStartE2EDuration="3.456885222s" totalImagesPullingTime="2.095248061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:57:58.454235136 +0000 UTC m=+812.835793699" watchObservedRunningTime="2026-06-11 16:57:58.456885222 +0000 UTC m=+812.838443758" Jun 11 16:58:09.442469 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:58:09.442439 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-jsfwb" Jun 11 16:58:28.369152 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:58:28.369110 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:58:48.835985 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:58:48.835946 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:21.411576 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:59:21.411497 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 16:59:26.106032 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:59:26.106001 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 16:59:26.109521 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:59:26.109500 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 16:59:26.111981 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:59:26.111956 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 16:59:26.115656 ip-10-0-143-112 kubenswrapper[2558]: I0611 16:59:26.115638 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:00:48.664262 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:00:48.664178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:00:48.762325 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:00:48.762289 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:01.355429 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:01.355394 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:06.051165 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.051129 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2"] Jun 11 17:01:06.054898 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.054880 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.058736 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.058703 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 17:01:06.058916 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.058752 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 17:01:06.059022 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.058800 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8fhbj\"" Jun 11 17:01:06.059022 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.058840 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 17:01:06.064901 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.064877 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2"] Jun 11 17:01:06.075486 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.075461 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:06.116557 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.115595 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.116557 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.115648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ljws\" (UniqueName: \"kubernetes.io/projected/c0b7993f-b508-4334-b481-299bcdbb0e4a-kube-api-access-9ljws\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.116557 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.115708 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.116557 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.115777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b7993f-b508-4334-b481-299bcdbb0e4a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.116557 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.115818 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.116557 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.115881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.217295 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.217259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b7993f-b508-4334-b481-299bcdbb0e4a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.217494 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.217303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.217494 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.217373 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.217494 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.217392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.217494 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.217428 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ljws\" (UniqueName: \"kubernetes.io/projected/c0b7993f-b508-4334-b481-299bcdbb0e4a-kube-api-access-9ljws\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.217494 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.217490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.217811 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.217786 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.217892 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.217870 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.218156 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.218134 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.219941 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.219912 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0b7993f-b508-4334-b481-299bcdbb0e4a-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.220098 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.220078 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b7993f-b508-4334-b481-299bcdbb0e4a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.226097 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.226073 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ljws\" (UniqueName: \"kubernetes.io/projected/c0b7993f-b508-4334-b481-299bcdbb0e4a-kube-api-access-9ljws\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2\" (UID: \"c0b7993f-b508-4334-b481-299bcdbb0e4a\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.365989 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.365896 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:06.495060 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.495027 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:01:06.506178 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.506154 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2"] Jun 11 17:01:06.507837 ip-10-0-143-112 kubenswrapper[2558]: W0611 17:01:06.507809 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b7993f_b508_4334_b481_299bcdbb0e4a.slice/crio-b3037c38d2d8bfda7d7b5b87e0d59cbf9b479bb0dc16b7619ba566edad44755d WatchSource:0}: Error finding container b3037c38d2d8bfda7d7b5b87e0d59cbf9b479bb0dc16b7619ba566edad44755d: Status 404 returned error can't find the container with id b3037c38d2d8bfda7d7b5b87e0d59cbf9b479bb0dc16b7619ba566edad44755d Jun 11 17:01:06.509819 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:06.509800 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 17:01:07.343894 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:07.343861 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" event={"ID":"c0b7993f-b508-4334-b481-299bcdbb0e4a","Type":"ContainerStarted","Data":"b3037c38d2d8bfda7d7b5b87e0d59cbf9b479bb0dc16b7619ba566edad44755d"} Jun 11 17:01:11.371112 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:11.371072 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" event={"ID":"c0b7993f-b508-4334-b481-299bcdbb0e4a","Type":"ContainerStarted","Data":"558b08754dea97c6e57f54906549d72e4b04ed5afaafabdfd916c9351a0cc87b"} Jun 11 17:01:12.377183 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:12.377090 2558 generic.go:356] "Generic (PLEG): container finished" podID="c0b7993f-b508-4334-b481-299bcdbb0e4a" containerID="558b08754dea97c6e57f54906549d72e4b04ed5afaafabdfd916c9351a0cc87b" exitCode=0 Jun 11 17:01:12.377615 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:12.377192 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" event={"ID":"c0b7993f-b508-4334-b481-299bcdbb0e4a","Type":"ContainerDied","Data":"558b08754dea97c6e57f54906549d72e4b04ed5afaafabdfd916c9351a0cc87b"} Jun 11 17:01:14.390302 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:14.390267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" event={"ID":"c0b7993f-b508-4334-b481-299bcdbb0e4a","Type":"ContainerStarted","Data":"0ee1ab6a0fc0ddafae7cbc5f83e8574611ba590d53a902fda6cd3e64045a3a60"} Jun 11 17:01:14.412043 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:14.411994 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" podStartSLOduration=1.687056916 podStartE2EDuration="8.411977772s" totalImagesPullingTime="5.442288243s" totalInitContainerRuntime="1.282632613s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:01:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:01:14.40981161 +0000 UTC m=+1008.791370166" watchObservedRunningTime="2026-06-11 17:01:14.411977772 +0000 UTC m=+1008.793536307" Jun 11 17:01:16.366276 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:16.366240 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:16.366663 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:16.366316 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:16.378935 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:16.378906 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:16.411120 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:16.411092 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2" Jun 11 17:01:29.033000 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.032966 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:29.364243 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.364172 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8"] Jun 11 17:01:29.368793 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.368768 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.371809 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.371788 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 17:01:29.379961 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.379935 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8"] Jun 11 17:01:29.399770 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.399742 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:29.524953 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.524904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.525112 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.524989 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.525112 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.525024 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.525112 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.525047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7k89\" (UniqueName: \"kubernetes.io/projected/e9eef58c-f012-4eb0-9109-2569ebbb1564-kube-api-access-b7k89\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.525282 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.525113 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.525282 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.525207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9eef58c-f012-4eb0-9109-2569ebbb1564-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.626649 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.626549 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9eef58c-f012-4eb0-9109-2569ebbb1564-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.626649 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.626622 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.626921 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.626668 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.626921 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.626698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.626921 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.626749 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7k89\" (UniqueName: \"kubernetes.io/projected/e9eef58c-f012-4eb0-9109-2569ebbb1564-kube-api-access-b7k89\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.626921 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.626780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.627190 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.627077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.627190 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.627126 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.627289 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.627190 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.629039 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.629013 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9eef58c-f012-4eb0-9109-2569ebbb1564-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.629211 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.629196 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9eef58c-f012-4eb0-9109-2569ebbb1564-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.636617 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.636598 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7k89\" (UniqueName: \"kubernetes.io/projected/e9eef58c-f012-4eb0-9109-2569ebbb1564-kube-api-access-b7k89\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-tzrs8\" (UID: \"e9eef58c-f012-4eb0-9109-2569ebbb1564\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.679760 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.679707 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:29.820694 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.820519 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8"] Jun 11 17:01:29.823785 ip-10-0-143-112 kubenswrapper[2558]: W0611 17:01:29.823756 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9eef58c_f012_4eb0_9109_2569ebbb1564.slice/crio-3f9048016054582cf0504500899d2e1c03d109cd93ec6f5940025486d1095f82 WatchSource:0}: Error finding container 3f9048016054582cf0504500899d2e1c03d109cd93ec6f5940025486d1095f82: Status 404 returned error can't find the container with id 3f9048016054582cf0504500899d2e1c03d109cd93ec6f5940025486d1095f82 Jun 11 17:01:29.889948 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:29.889918 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:01:30.476230 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:30.476195 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" event={"ID":"e9eef58c-f012-4eb0-9109-2569ebbb1564","Type":"ContainerStarted","Data":"9a170023e965a4c7c1289ab477fc7f7f0a2814c8cf437d74c57883fc8644f4a9"} Jun 11 17:01:30.476650 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:30.476267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" event={"ID":"e9eef58c-f012-4eb0-9109-2569ebbb1564","Type":"ContainerStarted","Data":"3f9048016054582cf0504500899d2e1c03d109cd93ec6f5940025486d1095f82"} Jun 11 17:01:31.482658 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:31.482628 2558 generic.go:356] "Generic (PLEG): container finished" podID="e9eef58c-f012-4eb0-9109-2569ebbb1564" containerID="9a170023e965a4c7c1289ab477fc7f7f0a2814c8cf437d74c57883fc8644f4a9" exitCode=0 Jun 11 17:01:31.483060 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:31.482672 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" event={"ID":"e9eef58c-f012-4eb0-9109-2569ebbb1564","Type":"ContainerDied","Data":"9a170023e965a4c7c1289ab477fc7f7f0a2814c8cf437d74c57883fc8644f4a9"} Jun 11 17:01:32.489102 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:32.489071 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" event={"ID":"e9eef58c-f012-4eb0-9109-2569ebbb1564","Type":"ContainerStarted","Data":"6f1cfa9d55e2c7ae1b7fe6ba0c4f317136f9ae3fae4dab78a7a46717b14bb745"} Jun 11 17:01:32.512966 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:32.512920 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" podStartSLOduration=2.014069816 podStartE2EDuration="3.512904589s" totalImagesPullingTime="230.386784ms" totalInitContainerRuntime="1.268447989s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:01:32.511951592 +0000 UTC m=+1026.893510129" watchObservedRunningTime="2026-06-11 17:01:32.512904589 +0000 UTC m=+1026.894463125" Jun 11 17:01:34.951972 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:34.951936 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm"] Jun 11 17:01:34.955490 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:34.955473 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:34.960986 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:34.960958 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 17:01:34.967151 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:34.967127 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pnqz\" (UniqueName: \"kubernetes.io/projected/e5d304f5-f30c-420b-8023-6c23372048e8-kube-api-access-8pnqz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:34.967259 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:34.967173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:34.967259 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:34.967194 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5d304f5-f30c-420b-8023-6c23372048e8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:34.967259 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:34.967208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:34.967259 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:34.967227 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:34.967415 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:34.967317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:34.973613 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:34.973591 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm"] Jun 11 17:01:35.008787 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.008756 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:35.068753 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.068689 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.068921 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.068785 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnqz\" (UniqueName: \"kubernetes.io/projected/e5d304f5-f30c-420b-8023-6c23372048e8-kube-api-access-8pnqz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.068921 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.068854 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.068921 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.068885 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5d304f5-f30c-420b-8023-6c23372048e8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.068921 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.068910 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.069121 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.068940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.069179 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.069159 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.069234 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.069215 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.069314 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.069292 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.071287 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.071259 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5d304f5-f30c-420b-8023-6c23372048e8-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.071752 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.071733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5d304f5-f30c-420b-8023-6c23372048e8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.080933 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.080906 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pnqz\" (UniqueName: \"kubernetes.io/projected/e5d304f5-f30c-420b-8023-6c23372048e8-kube-api-access-8pnqz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm\" (UID: \"e5d304f5-f30c-420b-8023-6c23372048e8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.265633 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.265594 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:01:35.426138 ip-10-0-143-112 kubenswrapper[2558]: W0611 17:01:35.426108 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d304f5_f30c_420b_8023_6c23372048e8.slice/crio-09abb5bf76ee6407be14f6e86b440d4f298487a6d3c60b1e95b8ea9c92e05857 WatchSource:0}: Error finding container 09abb5bf76ee6407be14f6e86b440d4f298487a6d3c60b1e95b8ea9c92e05857: Status 404 returned error can't find the container with id 09abb5bf76ee6407be14f6e86b440d4f298487a6d3c60b1e95b8ea9c92e05857 Jun 11 17:01:35.427610 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.427579 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm"] Jun 11 17:01:35.505611 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.505570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" event={"ID":"e5d304f5-f30c-420b-8023-6c23372048e8","Type":"ContainerStarted","Data":"858c340b871c904da0726f57751be3f0246e833b9c03142efe7f74128accdd96"} Jun 11 17:01:35.505782 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.505629 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" event={"ID":"e5d304f5-f30c-420b-8023-6c23372048e8","Type":"ContainerStarted","Data":"09abb5bf76ee6407be14f6e86b440d4f298487a6d3c60b1e95b8ea9c92e05857"} Jun 11 17:01:35.786092 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:35.786057 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:01:39.680862 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:39.680822 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:39.681259 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:39.680892 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:39.693125 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:39.693099 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:40.539914 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:40.539878 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-tzrs8" Jun 11 17:01:48.142183 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.142151 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d"] Jun 11 17:01:48.158930 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.158895 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d"] Jun 11 17:01:48.159123 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.159052 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.163004 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.162968 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 17:01:48.181377 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.181352 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.181518 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.181404 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.181591 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.181565 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.181694 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.181682 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b761d5f7-178d-41fd-b7b0-89b25b5102a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.181802 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.181783 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg99m\" (UniqueName: \"kubernetes.io/projected/b761d5f7-178d-41fd-b7b0-89b25b5102a9-kube-api-access-zg99m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.181936 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.181913 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.186265 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.186241 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:48.282978 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.282932 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.283144 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.283037 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b761d5f7-178d-41fd-b7b0-89b25b5102a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.283144 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.283100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg99m\" (UniqueName: \"kubernetes.io/projected/b761d5f7-178d-41fd-b7b0-89b25b5102a9-kube-api-access-zg99m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.283144 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.283134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.283328 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.283170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.283328 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.283210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.283493 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.283410 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.283550 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.283515 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.283644 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.283627 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.285497 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.285474 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b761d5f7-178d-41fd-b7b0-89b25b5102a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.285730 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.285700 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b761d5f7-178d-41fd-b7b0-89b25b5102a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.293191 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.293166 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg99m\" (UniqueName: \"kubernetes.io/projected/b761d5f7-178d-41fd-b7b0-89b25b5102a9-kube-api-access-zg99m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d\" (UID: \"b761d5f7-178d-41fd-b7b0-89b25b5102a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.472695 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.472600 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:01:48.612541 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:48.612435 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d"] Jun 11 17:01:48.615003 ip-10-0-143-112 kubenswrapper[2558]: W0611 17:01:48.614972 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb761d5f7_178d_41fd_b7b0_89b25b5102a9.slice/crio-8ea6f6ff3d516d5a82f387525161e6f8f681288c7f225dea098602e401211226 WatchSource:0}: Error finding container 8ea6f6ff3d516d5a82f387525161e6f8f681288c7f225dea098602e401211226: Status 404 returned error can't find the container with id 8ea6f6ff3d516d5a82f387525161e6f8f681288c7f225dea098602e401211226 Jun 11 17:01:49.105046 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:49.105005 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:01:49.582025 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:49.581986 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" event={"ID":"b761d5f7-178d-41fd-b7b0-89b25b5102a9","Type":"ContainerStarted","Data":"1c6c484a7e252799e13e68b5398ad9de52df43d238c11c3f36d8bee94351b240"} Jun 11 17:01:49.582405 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:49.582075 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" event={"ID":"b761d5f7-178d-41fd-b7b0-89b25b5102a9","Type":"ContainerStarted","Data":"8ea6f6ff3d516d5a82f387525161e6f8f681288c7f225dea098602e401211226"} Jun 11 17:01:53.150393 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:53.150357 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:01:54.196345 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:01:54.196308 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:02:05.111737 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.111674 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t"] Jun 11 17:02:05.116435 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.116409 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.119361 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.119338 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 17:02:05.128798 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.128777 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t"] Jun 11 17:02:05.153683 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.153653 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:02:05.235605 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.235576 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf79l\" (UniqueName: \"kubernetes.io/projected/56ae4d94-4992-45f0-bb28-c0a42636e9f6-kube-api-access-xf79l\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.235808 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.235634 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.235808 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.235750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.235808 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.235784 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.235808 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.235805 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56ae4d94-4992-45f0-bb28-c0a42636e9f6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.236040 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.235863 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.337196 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.337154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.337385 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.337217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.337385 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.337240 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.337385 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.337262 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56ae4d94-4992-45f0-bb28-c0a42636e9f6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.337385 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.337326 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.337385 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.337369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf79l\" (UniqueName: \"kubernetes.io/projected/56ae4d94-4992-45f0-bb28-c0a42636e9f6-kube-api-access-xf79l\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.337970 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.337662 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.337970 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.337696 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.337970 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.337793 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.339614 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.339592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56ae4d94-4992-45f0-bb28-c0a42636e9f6-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.339816 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.339799 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56ae4d94-4992-45f0-bb28-c0a42636e9f6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.346104 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.346082 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf79l\" (UniqueName: \"kubernetes.io/projected/56ae4d94-4992-45f0-bb28-c0a42636e9f6-kube-api-access-xf79l\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bbv2t\" (UID: \"56ae4d94-4992-45f0-bb28-c0a42636e9f6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.426081 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.426043 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:05.571075 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.571029 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t"] Jun 11 17:02:05.574707 ip-10-0-143-112 kubenswrapper[2558]: W0611 17:02:05.574680 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ae4d94_4992_45f0_bb28_c0a42636e9f6.slice/crio-be713b3f9480381df4ed94198f4ea22071728bdfc719ec2b514c01ef0d538492 WatchSource:0}: Error finding container be713b3f9480381df4ed94198f4ea22071728bdfc719ec2b514c01ef0d538492: Status 404 returned error can't find the container with id be713b3f9480381df4ed94198f4ea22071728bdfc719ec2b514c01ef0d538492 Jun 11 17:02:05.669147 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.669112 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" event={"ID":"56ae4d94-4992-45f0-bb28-c0a42636e9f6","Type":"ContainerStarted","Data":"1b4e65c4adeb584562cf421980a4f580238dcef5ca10c3259e0866b75adea631"} Jun 11 17:02:05.669321 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:05.669160 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" event={"ID":"56ae4d94-4992-45f0-bb28-c0a42636e9f6","Type":"ContainerStarted","Data":"be713b3f9480381df4ed94198f4ea22071728bdfc719ec2b514c01ef0d538492"} Jun 11 17:02:06.392186 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:06.392152 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:02:07.685695 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:07.685661 2558 generic.go:356] "Generic (PLEG): container finished" podID="56ae4d94-4992-45f0-bb28-c0a42636e9f6" containerID="1b4e65c4adeb584562cf421980a4f580238dcef5ca10c3259e0866b75adea631" exitCode=0 Jun 11 17:02:07.686132 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:07.685703 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" event={"ID":"56ae4d94-4992-45f0-bb28-c0a42636e9f6","Type":"ContainerDied","Data":"1b4e65c4adeb584562cf421980a4f580238dcef5ca10c3259e0866b75adea631"} Jun 11 17:02:08.693215 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:08.693182 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" event={"ID":"56ae4d94-4992-45f0-bb28-c0a42636e9f6","Type":"ContainerStarted","Data":"ec3533368a53fd98541dccfc6de8c31667d315f668bb82a2054244a3430b96fb"} Jun 11 17:02:08.714105 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:08.714056 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" podStartSLOduration=1.9752342710000002 podStartE2EDuration="3.714038869s" totalImagesPullingTime="244.509278ms" totalInitContainerRuntime="1.49429532s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:02:08.712413126 +0000 UTC m=+1063.093971685" watchObservedRunningTime="2026-06-11 17:02:08.714038869 +0000 UTC m=+1063.095597408" Jun 11 17:02:15.427110 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:15.427072 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:15.427577 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:15.427126 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:15.439849 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:15.439819 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:15.738814 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:15.738784 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bbv2t" Jun 11 17:02:28.792785 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:28.792746 2558 generic.go:356] "Generic (PLEG): container finished" podID="e5d304f5-f30c-420b-8023-6c23372048e8" containerID="858c340b871c904da0726f57751be3f0246e833b9c03142efe7f74128accdd96" exitCode=0 Jun 11 17:02:28.793168 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:28.792795 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" event={"ID":"e5d304f5-f30c-420b-8023-6c23372048e8","Type":"ContainerDied","Data":"858c340b871c904da0726f57751be3f0246e833b9c03142efe7f74128accdd96"} Jun 11 17:02:29.799854 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:29.799819 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" event={"ID":"e5d304f5-f30c-420b-8023-6c23372048e8","Type":"ContainerStarted","Data":"fd162fa30e04e4a7192bc18507a171d507e23bdd46b7b7308595fc6b4b768aa7"} Jun 11 17:02:29.821579 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:29.821523 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" podStartSLOduration=2.873738499 podStartE2EDuration="55.821508461s" totalImagesPullingTime="233.14649ms" totalInitContainerRuntime="52.714623472s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:02:29.820148226 +0000 UTC m=+1084.201706780" watchObservedRunningTime="2026-06-11 17:02:29.821508461 +0000 UTC m=+1084.203066995" Jun 11 17:02:35.266357 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:35.266312 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:02:35.266814 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:35.266400 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:02:35.278923 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:35.278901 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:02:35.847876 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:02:35.847849 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm" Jun 11 17:03:37.147888 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:37.147852 2558 generic.go:356] "Generic (PLEG): container finished" podID="b761d5f7-178d-41fd-b7b0-89b25b5102a9" containerID="1c6c484a7e252799e13e68b5398ad9de52df43d238c11c3f36d8bee94351b240" exitCode=0 Jun 11 17:03:37.148310 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:37.147924 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" event={"ID":"b761d5f7-178d-41fd-b7b0-89b25b5102a9","Type":"ContainerDied","Data":"1c6c484a7e252799e13e68b5398ad9de52df43d238c11c3f36d8bee94351b240"} Jun 11 17:03:38.154596 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:38.154565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" event={"ID":"b761d5f7-178d-41fd-b7b0-89b25b5102a9","Type":"ContainerStarted","Data":"296ca37cda8f5240725cc92bc20fd57945b16ee46a9b3f97ee8386cd510d236c"} Jun 11 17:03:38.176621 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:38.176570 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" podStartSLOduration=2.220045468 podStartE2EDuration="1m50.176554539s" totalImagesPullingTime="234.477641ms" totalInitContainerRuntime="1m47.72203143s" isStatefulPod=false podCreationTimestamp="2026-06-11 17:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:03:38.175126734 +0000 UTC m=+1152.556685270" watchObservedRunningTime="2026-06-11 17:03:38.176554539 +0000 UTC m=+1152.558113074" Jun 11 17:03:38.473565 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:38.473531 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:03:38.473755 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:38.473589 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:03:38.486271 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:38.486247 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:03:39.171068 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:39.171036 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d" Jun 11 17:03:40.975234 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:40.975199 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:41.063879 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:41.063837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:41.994132 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:41.994095 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:03:42.091080 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:03:42.091034 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:12.293853 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:12.293818 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:04:23.240015 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:23.239976 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:04:23.997089 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:23.997049 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:25.253483 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:25.253439 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:04:26.138004 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:26.137978 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:04:26.142500 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:26.142476 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:04:26.143435 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:26.143396 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:04:26.147918 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:26.147897 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:04:31.594115 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:31.594080 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:04:41.401382 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:41.401346 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:04:50.802644 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:04:50.802605 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:05:01.793537 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:01.793505 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:05:09.076512 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.076427 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:09.101592 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.101559 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c786bc658-r465h"] Jun 11 17:05:09.101780 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.101756 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7c786bc658-r465h" podUID="41daf867-5017-40cc-87e8-2b41a339f47a" containerName="manager" containerID="cri-o://790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8" gracePeriod=30 Jun 11 17:05:09.356194 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.356171 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 17:05:09.410570 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.410543 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41daf867-5017-40cc-87e8-2b41a339f47a-webhook-cert\") pod \"41daf867-5017-40cc-87e8-2b41a339f47a\" (UID: \"41daf867-5017-40cc-87e8-2b41a339f47a\") " Jun 11 17:05:09.410756 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.410644 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-694hp\" (UniqueName: \"kubernetes.io/projected/41daf867-5017-40cc-87e8-2b41a339f47a-kube-api-access-694hp\") pod \"41daf867-5017-40cc-87e8-2b41a339f47a\" (UID: \"41daf867-5017-40cc-87e8-2b41a339f47a\") " Jun 11 17:05:09.412999 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.412966 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41daf867-5017-40cc-87e8-2b41a339f47a-kube-api-access-694hp" (OuterVolumeSpecName: "kube-api-access-694hp") pod "41daf867-5017-40cc-87e8-2b41a339f47a" (UID: "41daf867-5017-40cc-87e8-2b41a339f47a"). InnerVolumeSpecName "kube-api-access-694hp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 17:05:09.413131 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.413027 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41daf867-5017-40cc-87e8-2b41a339f47a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "41daf867-5017-40cc-87e8-2b41a339f47a" (UID: "41daf867-5017-40cc-87e8-2b41a339f47a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 17:05:09.512342 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.512299 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-694hp\" (UniqueName: \"kubernetes.io/projected/41daf867-5017-40cc-87e8-2b41a339f47a-kube-api-access-694hp\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 17:05:09.512342 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.512337 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41daf867-5017-40cc-87e8-2b41a339f47a-webhook-cert\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 11 17:05:09.616043 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.615951 2558 generic.go:356] "Generic (PLEG): container finished" podID="41daf867-5017-40cc-87e8-2b41a339f47a" containerID="790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8" exitCode=0 Jun 11 17:05:09.616043 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.615996 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c786bc658-r465h" Jun 11 17:05:09.616223 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.616040 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c786bc658-r465h" event={"ID":"41daf867-5017-40cc-87e8-2b41a339f47a","Type":"ContainerDied","Data":"790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8"} Jun 11 17:05:09.616223 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.616088 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c786bc658-r465h" event={"ID":"41daf867-5017-40cc-87e8-2b41a339f47a","Type":"ContainerDied","Data":"6089c269e405a5a54f07409ac86f090ddf5782ff4409130038e024414d471c0b"} Jun 11 17:05:09.616223 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.616109 2558 scope.go:117] "RemoveContainer" containerID="790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8" Jun 11 17:05:09.625770 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.625753 2558 scope.go:117] "RemoveContainer" containerID="790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8" Jun 11 17:05:09.626006 ip-10-0-143-112 kubenswrapper[2558]: E0611 17:05:09.625987 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8\": container with ID starting with 790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8 not found: ID does not exist" containerID="790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8" Jun 11 17:05:09.626061 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.626015 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8"} err="failed to get container status \"790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8\": rpc error: code = NotFound desc = could not find container \"790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8\": container with ID starting with 790391b6db00d98653fcfd9b4b95e40d9aa0e30e6bc9e2f13fea6b16fcd70fd8 not found: ID does not exist" Jun 11 17:05:09.653682 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.653647 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c786bc658-r465h"] Jun 11 17:05:09.670960 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:09.670930 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c786bc658-r465h"] Jun 11 17:05:10.116808 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:10.116766 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41daf867-5017-40cc-87e8-2b41a339f47a" path="/var/lib/kubelet/pods/41daf867-5017-40cc-87e8-2b41a339f47a/volumes" Jun 11 17:05:10.385011 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:10.384931 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:34.540727 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:34.540690 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:05:39.991061 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:39.991024 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:05:53.654963 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:53.654927 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:05:53.816179 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:05:53.816142 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:01.429478 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:06:01.429437 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:02.158206 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:06:02.158166 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:08.044937 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:06:08.044899 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:08.144224 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:06:08.144183 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:17.743584 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:06:17.743549 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:06:33.693319 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:06:33.693278 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:06:40.308235 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:06:40.308152 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:06:40.420439 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:06:40.420348 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:04.429541 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:04.429503 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:11.170947 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:11.170882 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:11.355534 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:11.355499 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:11.453979 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:11.453889 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:11.607546 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:11.607502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:11.778887 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:11.778854 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:13.171953 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:13.171920 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:07:28.424295 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:28.424254 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:28.615487 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:28.615451 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:28.768262 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:28.768220 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:30.144427 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:30.144391 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:07:35.906002 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:35.905962 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:36.001743 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:36.001685 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:44.219307 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:44.219264 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:44.422486 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:44.422442 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:44.549610 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:44.549578 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:07:45.822548 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:45.822504 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:07:50.478429 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:07:50.478389 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:00.880105 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:00.880066 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:00.981206 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:00.981171 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:01.097691 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:01.097651 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:01.895798 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:01.895762 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:08:08.484116 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:08.484026 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:08.650518 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:08.650476 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:25.521752 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:25.521700 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:25.630676 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:25.630638 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:30.750628 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:30.750589 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:30.850879 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:30.850824 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:30.959620 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:30.959585 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:31.089336 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:31.089250 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:37.058948 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:37.058914 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:08:37.160234 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:08:37.160201 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:09:03.713410 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:09:03.713374 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:09:12.603839 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:09:12.603800 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:09:26.168964 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:09:26.168933 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:09:26.173525 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:09:26.173498 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:09:26.173800 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:09:26.173786 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:09:26.178564 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:09:26.178546 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:09:29.484542 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:09:29.484511 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:09:37.882514 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:09:37.882429 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:09:55.396784 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:09:55.396748 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:10:03.795133 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:10:03.795095 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:10:36.194366 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:10:36.194326 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:10:44.286769 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:10:44.286726 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:10:47.682729 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:10:47.682678 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:10:54.015088 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:10:54.015043 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:11:01.416842 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:11:01.416803 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:11:09.894600 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:11:09.894511 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:11:10.427095 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:11:10.427065 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:11:11.757371 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:11:11.757331 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:11:35.387875 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:11:35.387844 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:11:49.695736 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:11:49.695685 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:12:37.998940 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:12:37.998846 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:12:46.000415 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:12:46.000380 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:13:04.910565 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:13:04.910530 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:13:13.410668 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:13:13.410626 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:13:22.456690 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:13:22.456653 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:13:31.308323 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:13:31.308284 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:13:40.265119 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:13:40.265082 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:13:49.122318 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:13:49.122285 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:13:52.257444 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:13:52.257412 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:13:57.892515 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:13:57.892476 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:14:06.223569 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:14:06.223481 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:14:14.910101 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:14:14.910063 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:14:23.183660 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:14:23.183618 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:14:26.199733 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:14:26.199682 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:14:26.205141 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:14:26.205110 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:14:26.205530 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:14:26.205502 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:14:26.210832 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:14:26.210816 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:14:50.397728 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:14:50.397691 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:16:50.115978 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:16:50.115942 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:16:55.792391 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:16:55.792354 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:17:22.343465 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:17:22.343430 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:17:27.330900 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:17:27.330860 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:17:36.528136 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:17:36.528099 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:17:46.518367 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:17:46.518329 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:17:55.964486 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:17:55.964441 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:18:06.621439 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:18:06.621404 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:18:15.566805 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:18:15.566770 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:18:26.016159 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:18:26.016121 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:18:35.001808 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:18:35.001772 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:18:45.734308 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:18:45.734210 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:18:54.700385 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:18:54.700339 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:18:59.545470 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:18:59.545434 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:19:00.732985 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:19:00.732954 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:19:26.229502 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:19:26.229469 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:19:26.234856 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:19:26.234834 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:19:26.236275 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:19:26.236258 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:19:26.241371 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:19:26.241355 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:19:29.595628 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:19:29.595590 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:20:12.716501 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:20:12.716416 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:20:21.214121 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:20:21.214087 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:20:29.891900 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:20:29.891863 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:20:38.604567 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:20:38.604528 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:20:51.827315 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:20:51.827282 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:20:52.486136 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:20:52.486088 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:20:52.650953 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:20:52.650917 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:21:04.116339 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:21:04.116305 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:21:13.123846 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:21:13.123804 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:21:18.504426 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:21:18.504391 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:21:25.505680 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:21:25.505645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:21:27.483088 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:21:27.483026 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:21:32.000859 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:21:32.000826 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:21:34.026656 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:21:34.026621 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:21:42.039125 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:21:42.039038 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:21:56.632092 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:21:56.632050 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:22:06.752659 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:22:06.752623 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:22:23.525326 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:22:23.525282 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:22:32.025495 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:22:32.025461 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:22:40.707962 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:22:40.707924 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:22:49.137352 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:22:49.137310 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:23:06.104401 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:23:06.104318 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:23:13.792046 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:23:13.792005 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:23:23.411130 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:23:23.411090 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:23:32.094328 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:23:32.094294 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:23:40.792290 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:23:40.792252 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:23:49.100269 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:23:49.100233 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:23:58.201886 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:23:58.201849 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:24:11.186761 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:24:11.186712 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:24:20.594616 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:24:20.594580 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:24:26.263273 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:24:26.263246 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:24:26.268694 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:24:26.268665 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:24:26.270890 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:24:26.270868 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:24:26.276028 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:24:26.276008 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4799k_2af92175-3ed1-4425-9f77-47907e96c5b6/ovn-acl-logging/0.log" Jun 11 17:24:31.588367 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:24:31.588333 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:24:41.092227 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:24:41.092141 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:24:46.706084 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:24:46.706051 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:24:53.430124 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:24:53.430086 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:25:00.103846 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:25:00.103807 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:25:13.513493 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:25:13.513455 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:25:22.195122 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:25:22.195088 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:25:30.202849 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:25:30.202813 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:25:31.615662 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:25:31.615624 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:25:35.597224 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:25:35.597193 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:25:38.105363 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:25:38.105325 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:25:59.851252 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:25:59.851215 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:01.203729 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:01.203678 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:26:12.933498 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:12.933462 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:13.808223 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:13.808184 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lk9g6"] Jun 11 17:26:14.645096 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:14.645060 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:14.854668 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:14.854587 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:15.009601 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:15.009566 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:18.288731 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:18.288688 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:20.831512 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:20.831479 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:21.008529 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:21.008496 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:21.107129 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:21.107046 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:22.254601 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:22.254570 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:27.306955 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:27.306920 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:27.398915 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:27.398876 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:27.629995 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:27.629915 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:27.771425 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:27.771390 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:27.891221 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:27.891130 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:31.041285 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:31.041251 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:33.851746 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:33.851700 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:35.029529 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:35.029497 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:35.128420 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:35.128376 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:36.489220 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:36.489189 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:41.113054 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:41.113018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:41.213892 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:41.213856 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:26:53.433711 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:53.433680 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6879556547-kbsh4_b815b1b9-f751-4724-8d8f-090b83484b3e/nginx/0.log" Jun 11 17:26:53.544905 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:53.544874 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-qlws2_7b8fde6e-1632-4b9d-b5b2-1fe613bf4848/manager/0.log" Jun 11 17:26:53.680088 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:53.680053 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5w6td_0dbcc482-8758-4c39-a761-3e686f90e23f/manager/0.log" Jun 11 17:26:54.279322 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:54.279292 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-ph5mn_be99b20a-447b-4925-b4ab-21d94b242468/server/0.log" Jun 11 17:26:54.396274 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:54.396239 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-bncnn_a26a7a4f-6597-4adb-b33e-672f555ace54/manager/0.log" Jun 11 17:26:54.514400 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:54.514366 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f54898884-95xpp_ae84eef7-5811-4500-8a28-0ec1a4221e2a/manager/0.log" Jun 11 17:26:54.524848 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:54.524827 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f54898884-95xpp_ae84eef7-5811-4500-8a28-0ec1a4221e2a/copy-manifests/0.log" Jun 11 17:26:56.445441 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:56.445409 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ngndc_0489de78-5804-45a7-8708-6f65cb1b7327/manager/0.log" Jun 11 17:26:56.926601 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:56.926567 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lk9g6_ec3320be-7368-47a0-9950-f24a200cc12a/limitador/0.log" Jun 11 17:26:57.044162 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:57.044132 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-c44lk_c6303f57-1d68-41e2-990f-c6dcf47010d5/manager/0.log" Jun 11 17:26:57.528259 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:57.528225 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6mqcr_e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76/discovery/0.log" Jun 11 17:26:57.757964 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:57.757935 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-588969d7f4-tkdsb_bc42947e-9eba-42ad-9a71-3b3732224e99/kube-auth-proxy/0.log" Jun 11 17:26:58.136106 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:58.136075 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-jsfwb_94f6ac45-bb41-47d4-b87d-55acb31aafbe/payload-processing/0.log" Jun 11 17:26:58.595422 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:58.595365 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2_c0b7993f-b508-4334-b481-299bcdbb0e4a/main/0.log" Jun 11 17:26:58.602908 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:58.602888 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jdzk2_c0b7993f-b508-4334-b481-299bcdbb0e4a/storage-initializer/0.log" Jun 11 17:26:58.711617 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:58.711589 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-tzrs8_e9eef58c-f012-4eb0-9109-2569ebbb1564/storage-initializer/0.log" Jun 11 17:26:58.720592 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:58.720570 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-tzrs8_e9eef58c-f012-4eb0-9109-2569ebbb1564/main/0.log" Jun 11 17:26:58.838816 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:58.838778 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm_e5d304f5-f30c-420b-8023-6c23372048e8/storage-initializer/0.log" Jun 11 17:26:58.855083 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:58.855008 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-994rm_e5d304f5-f30c-420b-8023-6c23372048e8/main/0.log" Jun 11 17:26:58.967537 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:58.967508 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d_b761d5f7-178d-41fd-b7b0-89b25b5102a9/storage-initializer/0.log" Jun 11 17:26:58.979907 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:58.979882 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4699d_b761d5f7-178d-41fd-b7b0-89b25b5102a9/main/0.log" Jun 11 17:26:59.212651 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:59.212572 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-bbv2t_56ae4d94-4992-45f0-bb28-c0a42636e9f6/storage-initializer/0.log" Jun 11 17:26:59.225496 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:26:59.225470 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-bbv2t_56ae4d94-4992-45f0-bb28-c0a42636e9f6/main/0.log" Jun 11 17:27:03.816897 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:03.816852 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:27:03.890906 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:03.890873 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:27:04.926879 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:04.926843 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" limit=1024 Jun 11 17:27:07.230232 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:07.230205 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7b27n_70e6dac7-acbb-4dd2-bf07-4fd2bc1df83e/global-pull-secret-syncer/0.log" Jun 11 17:27:07.418204 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:07.418176 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l4z5b_90aeba2e-9e10-4a7a-907c-9f8fa617198a/konnectivity-agent/0.log" Jun 11 17:27:07.587151 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:07.587075 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-112.ec2.internal_9cf0603ecf25c26ddaba857696c5a239/haproxy/0.log" Jun 11 17:27:11.202126 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:11.202078 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-r42tv_ef973a65-8caa-47c3-a54b-ebeaa768cc73/sail-operator/0.log" Jun 11 17:27:12.472801 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:12.472770 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ngndc_0489de78-5804-45a7-8708-6f65cb1b7327/manager/0.log" Jun 11 17:27:12.648802 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:12.648768 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lk9g6_ec3320be-7368-47a0-9950-f24a200cc12a/limitador/0.log" Jun 11 17:27:12.708502 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:12.708466 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-c44lk_c6303f57-1d68-41e2-990f-c6dcf47010d5/manager/0.log" Jun 11 17:27:14.484175 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:14.484121 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-qk6ld_4bfc1750-3b96-42e9-8c54-3b55c422781a/cluster-monitoring-operator/0.log" Jun 11 17:27:14.708182 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:14.708155 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlpkm_ee42bb51-de23-4c4b-8409-22e26272b1a2/node-exporter/0.log" Jun 11 17:27:14.738334 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:14.738253 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlpkm_ee42bb51-de23-4c4b-8409-22e26272b1a2/kube-rbac-proxy/0.log" Jun 11 17:27:14.766600 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:14.766577 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlpkm_ee42bb51-de23-4c4b-8409-22e26272b1a2/init-textfile/0.log" Jun 11 17:27:17.716355 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:17.716317 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/1.log" Jun 11 17:27:17.720219 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:17.720198 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-87nxf_c8239c37-9dc5-4cf2-bee3-047a6eb79bae/console-operator/2.log" Jun 11 17:27:18.345796 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.345758 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-sll6m_f40369d7-b678-4803-b347-cbdbc6b6c2d1/download-server/0.log" Jun 11 17:27:18.523125 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.523090 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh"] Jun 11 17:27:18.523547 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.523527 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41daf867-5017-40cc-87e8-2b41a339f47a" containerName="manager" Jun 11 17:27:18.523547 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.523546 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="41daf867-5017-40cc-87e8-2b41a339f47a" containerName="manager" Jun 11 17:27:18.523708 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.523621 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="41daf867-5017-40cc-87e8-2b41a339f47a" containerName="manager" Jun 11 17:27:18.526822 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.526806 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.529672 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.529636 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7wbff\"/\"openshift-service-ca.crt\"" Jun 11 17:27:18.529795 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.529696 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7wbff\"/\"kube-root-ca.crt\"" Jun 11 17:27:18.530635 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.530620 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7wbff\"/\"default-dockercfg-wqlrp\"" Jun 11 17:27:18.538853 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.538830 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh"] Jun 11 17:27:18.599939 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.599842 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-lib-modules\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.599939 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.599890 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-podres\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.600132 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.599986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-proc\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.600132 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.600021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc9qx\" (UniqueName: \"kubernetes.io/projected/1d365fcb-45b0-4703-8968-44b26782cf29-kube-api-access-fc9qx\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.600132 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.600045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-sys\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.700811 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.700772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-sys\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.700922 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.700851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-lib-modules\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.700922 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.700879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-podres\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.700922 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.700898 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-sys\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.701020 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.700925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-proc\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.701020 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.700951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc9qx\" (UniqueName: \"kubernetes.io/projected/1d365fcb-45b0-4703-8968-44b26782cf29-kube-api-access-fc9qx\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.701020 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.700999 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-podres\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.701116 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.701014 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-lib-modules\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.701116 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.701044 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d365fcb-45b0-4703-8968-44b26782cf29-proc\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.712899 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.712875 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc9qx\" (UniqueName: \"kubernetes.io/projected/1d365fcb-45b0-4703-8968-44b26782cf29-kube-api-access-fc9qx\") pod \"perf-node-gather-daemonset-jc8gh\" (UID: \"1d365fcb-45b0-4703-8968-44b26782cf29\") " pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.838110 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.838074 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:18.972378 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:18.972350 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh"] Jun 11 17:27:18.974202 ip-10-0-143-112 kubenswrapper[2558]: W0611 17:27:18.974175 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1d365fcb_45b0_4703_8968_44b26782cf29.slice/crio-79197f3faa512b18c4821fa0502bca0f87d45cae6191a8861ad1326c38a5e4ef WatchSource:0}: Error finding container 79197f3faa512b18c4821fa0502bca0f87d45cae6191a8861ad1326c38a5e4ef: Status 404 returned error can't find the container with id 79197f3faa512b18c4821fa0502bca0f87d45cae6191a8861ad1326c38a5e4ef Jun 11 17:27:19.250148 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:19.250118 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" event={"ID":"1d365fcb-45b0-4703-8968-44b26782cf29","Type":"ContainerStarted","Data":"c5b77c88fffba459744f111b69a27163e1eedd9a29d5433f3a34a08f47aac781"} Jun 11 17:27:19.250334 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:19.250167 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" event={"ID":"1d365fcb-45b0-4703-8968-44b26782cf29","Type":"ContainerStarted","Data":"79197f3faa512b18c4821fa0502bca0f87d45cae6191a8861ad1326c38a5e4ef"} Jun 11 17:27:19.250334 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:19.250229 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:19.269995 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:19.269936 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" podStartSLOduration=1.269921456 podStartE2EDuration="1.269921456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 17:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 17:27:19.267471521 +0000 UTC m=+2573.649030072" watchObservedRunningTime="2026-06-11 17:27:19.269921456 +0000 UTC m=+2573.651480020" Jun 11 17:27:20.307130 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:20.307103 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h8whw_e915cfae-2400-40f3-a789-72932ee96199/dns/0.log" Jun 11 17:27:20.332529 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:20.332502 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h8whw_e915cfae-2400-40f3-a789-72932ee96199/kube-rbac-proxy/0.log" Jun 11 17:27:20.432819 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:20.432789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9p8bj_c5c8209e-966a-4d35-9f72-5075e2cca944/dns-node-resolver/0.log" Jun 11 17:27:21.104266 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:21.104233 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bcd958576-2rhbg_75448089-e93b-4b6f-a4d4-da4e732e6304/registry/0.log" Jun 11 17:27:21.159243 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:21.159209 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fgzxb_d5dafdd3-b1a0-40bd-8144-6839cf079de0/node-ca/0.log" Jun 11 17:27:22.288292 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:22.288261 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6mqcr_e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76/discovery/0.log" Jun 11 17:27:22.354328 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:22.354292 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-588969d7f4-tkdsb_bc42947e-9eba-42ad-9a71-3b3732224e99/kube-auth-proxy/0.log" Jun 11 17:27:22.532118 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:22.532086 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-jsfwb_94f6ac45-bb41-47d4-b87d-55acb31aafbe/payload-processing/0.log" Jun 11 17:27:23.343575 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:23.343541 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jtsv8_19a845c8-e5c5-4523-96f0-b4cef88ff648/serve-healthcheck-canary/0.log" Jun 11 17:27:23.903152 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:23.903124 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-99f9g_68ab36b6-32a0-4669-b9c1-115829e40bd1/insights-operator/0.log" Jun 11 17:27:23.903960 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:23.903943 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-99f9g_68ab36b6-32a0-4669-b9c1-115829e40bd1/insights-operator/1.log" Jun 11 17:27:23.938355 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:23.938325 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98xmm_47246775-d162-4106-901d-0e510ebe3c36/kube-rbac-proxy/0.log" Jun 11 17:27:23.968892 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:23.968865 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98xmm_47246775-d162-4106-901d-0e510ebe3c36/exporter/0.log" Jun 11 17:27:24.014126 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:24.014102 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98xmm_47246775-d162-4106-901d-0e510ebe3c36/extractor/0.log" Jun 11 17:27:25.265437 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:25.265411 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7wbff/perf-node-gather-daemonset-jc8gh" Jun 11 17:27:26.690794 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:26.690752 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6879556547-kbsh4_b815b1b9-f751-4724-8d8f-090b83484b3e/nginx/0.log" Jun 11 17:27:26.722481 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:26.722442 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-qlws2_7b8fde6e-1632-4b9d-b5b2-1fe613bf4848/manager/0.log" Jun 11 17:27:26.812586 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:26.812555 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5w6td_0dbcc482-8758-4c39-a761-3e686f90e23f/manager/0.log" Jun 11 17:27:27.029237 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:27.029216 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-ph5mn_be99b20a-447b-4925-b4ab-21d94b242468/server/0.log" Jun 11 17:27:27.084895 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:27.084869 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-bncnn_a26a7a4f-6597-4adb-b33e-672f555ace54/manager/0.log" Jun 11 17:27:27.167985 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:27.167955 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f54898884-95xpp_ae84eef7-5811-4500-8a28-0ec1a4221e2a/manager/0.log" Jun 11 17:27:27.234414 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:27.234383 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f54898884-95xpp_ae84eef7-5811-4500-8a28-0ec1a4221e2a/copy-manifests/0.log" Jun 11 17:27:31.863530 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:31.863491 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6mqcr_e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76/discovery/0.log" Jun 11 17:27:31.897243 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:31.897216 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-588969d7f4-tkdsb_bc42947e-9eba-42ad-9a71-3b3732224e99/kube-auth-proxy/0.log" Jun 11 17:27:32.071002 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:32.070970 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-jsfwb_94f6ac45-bb41-47d4-b87d-55acb31aafbe/payload-processing/0.log" Jun 11 17:27:33.239203 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:33.239170 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6mqcr_e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76/discovery/0.log" Jun 11 17:27:33.270730 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:33.270697 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-588969d7f4-tkdsb_bc42947e-9eba-42ad-9a71-3b3732224e99/kube-auth-proxy/0.log" Jun 11 17:27:33.439049 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:33.439019 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-jsfwb_94f6ac45-bb41-47d4-b87d-55acb31aafbe/payload-processing/0.log" Jun 11 17:27:35.193912 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:35.193878 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-6mqcr_e5ba6ed8-a5cd-4ff5-8f67-65160a33aa76/discovery/0.log" Jun 11 17:27:35.218910 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:35.218880 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-588969d7f4-tkdsb_bc42947e-9eba-42ad-9a71-3b3732224e99/kube-auth-proxy/0.log" Jun 11 17:27:35.383337 ip-10-0-143-112 kubenswrapper[2558]: I0611 17:27:35.383307 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-jsfwb_94f6ac45-bb41-47d4-b87d-55acb31aafbe/payload-processing/0.log"