Jun 09 14:37:00.541240 ip-10-0-143-219 systemd[1]: Starting Kubernetes Kubelet... Jun 09 14:37:00.907375 ip-10-0-143-219 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:37:00.907375 ip-10-0-143-219 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 14:37:00.907375 ip-10-0-143-219 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:37:00.907375 ip-10-0-143-219 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 14:37:00.907375 ip-10-0-143-219 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:37:00.908185 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.907445 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 14:37:00.914529 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914508 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:37:00.914529 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914526 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:37:00.914529 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914531 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914538 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914542 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914546 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914549 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914553 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914557 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914561 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914565 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914569 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914572 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914577 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914581 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914584 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914588 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914592 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914596 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914600 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914604 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:37:00.914737 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914608 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914611 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914615 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914619 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914623 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914629 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914633 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914637 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914641 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914645 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914650 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914653 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914657 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914662 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914667 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914671 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914676 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914680 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914685 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:37:00.915539 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914689 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914697 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914703 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914708 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914713 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914717 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914722 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914726 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914733 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914738 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914742 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914747 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914751 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914756 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914761 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914766 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914770 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914775 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914779 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:37:00.916334 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914783 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914788 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914792 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914796 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914800 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914804 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914808 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914813 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914818 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914823 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914827 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914832 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914836 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914840 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914844 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914848 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914852 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914857 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914861 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914865 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914869 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:37:00.917145 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914875 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914880 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914884 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914888 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914892 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914896 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914900 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914904 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914909 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914913 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914917 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914921 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914940 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914945 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914950 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914954 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914958 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914963 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.914968 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916133 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:37:00.918051 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916142 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916148 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916153 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916158 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916162 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916166 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916171 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916175 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916180 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916185 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916189 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916194 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916198 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916202 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916206 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916211 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916215 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916219 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916223 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916227 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:37:00.918889 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916232 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916236 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916240 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916245 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916250 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916254 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916259 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916263 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916268 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916272 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916276 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916281 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916285 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916290 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916294 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916298 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916302 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916307 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916311 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:37:00.919611 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916315 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916319 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916326 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916329 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916333 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916337 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916341 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916346 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916352 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916358 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916363 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916368 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916375 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916381 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916388 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916394 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916399 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916403 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916407 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:37:00.920253 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916412 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916416 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916421 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916425 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916429 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916433 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916438 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916442 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916446 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916450 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916454 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916459 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916463 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916467 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916474 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916479 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916485 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916489 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916493 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:37:00.920808 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916498 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916502 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916507 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916511 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916515 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916520 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916524 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916528 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916532 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916538 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916542 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916547 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916551 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916555 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916560 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916564 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916568 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916572 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916576 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916580 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:37:00.921300 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.916585 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917182 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917191 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917195 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917200 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917206 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917210 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917214 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917219 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917224 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917228 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917232 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917237 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917241 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917249 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917254 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917258 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917263 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917267 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917271 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:37:00.921911 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917276 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917280 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917285 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917288 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917292 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917296 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917301 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917305 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917309 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917313 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917317 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917322 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917326 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917330 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917335 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917341 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917346 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917350 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917354 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:37:00.922432 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917360 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917364 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917368 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917374 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917379 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917383 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917391 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917396 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917401 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917405 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917409 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917413 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917417 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917422 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917426 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917430 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917434 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917439 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917443 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917447 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:37:00.922916 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917451 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917455 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917459 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917463 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917468 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917472 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917476 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917480 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917485 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917492 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917497 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917502 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917509 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917513 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917517 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917522 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917526 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917531 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917536 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:37:00.923441 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917544 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917550 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917555 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917559 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917564 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917568 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917572 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917576 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917580 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917584 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917589 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917594 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917598 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917602 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917606 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917611 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917615 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917619 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917623 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917627 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:37:00.923948 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917632 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.917636 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917743 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917753 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917764 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917771 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917777 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917782 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917788 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917795 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917801 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917808 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917815 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917820 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917825 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917830 2577 flags.go:64] FLAG: --cgroup-root="" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917835 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917841 2577 flags.go:64] FLAG: --client-ca-file="" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917845 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917850 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917856 2577 flags.go:64] FLAG: --cluster-domain="" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917861 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917866 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917871 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 14:37:00.924431 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917877 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917882 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917887 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917892 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917897 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917902 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917907 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917912 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917917 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917922 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917944 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917949 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917955 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917959 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917964 2577 flags.go:64] FLAG: --enable-server="true" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917969 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917976 2577 flags.go:64] FLAG: --event-burst="100" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917981 2577 flags.go:64] FLAG: --event-qps="50" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917986 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.917993 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918000 2577 flags.go:64] FLAG: --eviction-hard="" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918006 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918011 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918015 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918020 2577 flags.go:64] FLAG: --eviction-soft="" Jun 09 14:37:00.925121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918025 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918030 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918035 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918040 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918044 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918049 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918053 2577 flags.go:64] FLAG: --feature-gates="" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918059 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918064 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918068 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918073 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918078 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918084 2577 flags.go:64] FLAG: --help="false" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918088 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-143-219.ec2.internal" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918094 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918099 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918103 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918109 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918115 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918119 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918124 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918128 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918133 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 14:37:00.925718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918138 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918143 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918148 2577 flags.go:64] FLAG: --kube-reserved="" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918154 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918161 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918166 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918171 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918176 2577 flags.go:64] FLAG: --lock-file="" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918181 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918195 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918200 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918208 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918213 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918218 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918223 2577 flags.go:64] FLAG: --logging-format="text" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918227 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918233 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918237 2577 flags.go:64] FLAG: --manifest-url="" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918242 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918248 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918254 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918260 2577 flags.go:64] FLAG: --max-pods="110" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918265 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918270 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918274 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 14:37:00.926417 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918279 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918284 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918288 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918293 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918305 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918309 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918314 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918319 2577 flags.go:64] FLAG: --pod-cidr="" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918324 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918333 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918337 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918344 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918350 2577 flags.go:64] FLAG: --port="10250" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918356 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918360 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f06bba6f3dac6113" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918365 2577 flags.go:64] FLAG: --qos-reserved="" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918370 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918375 2577 flags.go:64] FLAG: --register-node="true" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918380 2577 flags.go:64] FLAG: --register-with-taints="" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918386 2577 flags.go:64] FLAG: --registry-burst="10" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918390 2577 flags.go:64] FLAG: --registry-qps="5" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918395 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918399 2577 flags.go:64] FLAG: --reserved-memory="" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918406 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918411 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 14:37:00.927056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918416 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918420 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918425 2577 flags.go:64] FLAG: --runonce="false" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918430 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918435 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918440 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918445 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918449 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918454 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918459 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918464 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918469 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918473 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918478 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918483 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918488 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918492 2577 flags.go:64] FLAG: --system-cgroups="" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918497 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918508 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918513 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918519 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918525 2577 flags.go:64] FLAG: --tls-min-version="" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918530 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918535 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918540 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 14:37:00.927667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918544 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918549 2577 flags.go:64] FLAG: --v="2" Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918556 2577 flags.go:64] FLAG: --version="false" Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918562 2577 flags.go:64] FLAG: --vmodule="" Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918567 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.918573 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918752 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918758 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918763 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918767 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918772 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918777 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918783 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918788 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918792 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918796 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918801 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918807 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918813 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918817 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:37:00.928289 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918823 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918829 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918834 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918839 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918844 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918851 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918856 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918861 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918867 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918872 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918877 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918881 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918886 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918890 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918894 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918898 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918903 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918907 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918911 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:37:00.928763 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918915 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918919 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918942 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918947 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918951 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918956 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918960 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918964 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918969 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918973 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918977 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918981 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918986 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918990 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918994 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.918998 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919005 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919009 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919015 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919020 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:37:00.929252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919024 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919028 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919033 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919038 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919042 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919046 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919051 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919055 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919059 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919063 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919068 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919072 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919076 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919081 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919086 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919090 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919094 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919099 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919103 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919107 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:37:00.929730 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919111 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919116 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919120 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919124 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919129 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919133 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919137 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919142 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919147 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919152 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919161 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919167 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919172 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919177 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919181 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919187 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919192 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919196 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919200 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:37:00.930249 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919205 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919209 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919213 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919217 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919221 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919226 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.919230 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.919244 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.926206 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.926317 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.927026 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.927033 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927092 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927098 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927102 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:37:00.930707 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927105 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927108 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927111 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927114 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927116 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927119 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927121 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927124 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927127 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927130 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927132 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927136 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927140 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927143 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927147 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927151 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927153 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927156 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927159 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:37:00.931150 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927163 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927165 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927168 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927171 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927174 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927176 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927179 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927182 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927185 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927188 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927191 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927193 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927196 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927199 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927202 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927204 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927207 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927209 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927212 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927215 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:37:00.931616 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927217 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927219 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927222 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927224 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927228 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927230 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927233 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927236 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927238 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927241 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927245 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927249 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927252 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927255 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927258 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927261 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927263 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927266 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927268 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:37:00.932125 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927272 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927275 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927277 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927280 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927282 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927285 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927287 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927290 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927292 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927295 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927297 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927300 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927302 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927305 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927308 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927310 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927313 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927316 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927318 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:37:00.932592 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927321 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927323 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927326 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927329 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927332 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927335 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927338 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927340 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927343 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927345 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927348 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927350 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927353 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927356 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927359 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927362 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927364 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927367 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:37:00.933066 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927369 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.927375 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927485 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927490 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927493 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927496 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927499 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927502 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927504 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927507 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927510 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927512 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927515 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927517 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:37:00.933505 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927520 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927522 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927525 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927528 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927531 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927535 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927538 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927541 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927544 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927546 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927549 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927551 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927554 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927556 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927559 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927562 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927564 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927568 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927570 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:37:00.933854 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927573 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927575 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927578 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927580 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927583 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927586 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927589 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927592 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927595 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927598 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927601 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927603 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927606 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927608 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927611 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927614 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927616 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927619 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927622 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927625 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:37:00.934338 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927627 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927629 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927632 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927635 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927637 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927640 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927643 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927645 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927647 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927650 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927652 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927655 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927657 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927659 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927662 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927665 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927667 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927669 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927672 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927675 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:37:00.934813 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927677 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927681 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927685 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927688 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927690 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927693 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927696 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927699 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927701 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927704 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927708 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927710 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927713 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927716 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927719 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927721 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927724 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927727 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927729 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927731 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:37:00.935322 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927734 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927736 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927739 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927741 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927744 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927746 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927749 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:00.927751 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.927756 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.927853 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.930059 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.931760 2577 server.go:1019] "Starting client certificate rotation" Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.931863 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 14:37:00.935985 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.932535 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 14:37:00.936490 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.936060 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 14:37:00.937513 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.937497 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 14:37:00.945333 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.945312 2577 log.go:25] "Validated CRI v1 runtime API" Jun 09 14:37:00.949206 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.949193 2577 log.go:25] "Validated CRI v1 image API" Jun 09 14:37:00.949993 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.949978 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 14:37:00.952215 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.952195 2577 fs.go:135] Filesystem UUIDs: map[1dcfde98-6587-4f9e-a07a-8c66dab6268f:/dev/nvme0n1p4 57989640-ccf2-4bd6-b343-f929d7452875:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 09 14:37:00.952277 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.952215 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 14:37:00.957142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.957044 2577 manager.go:216] Machine: {Timestamp:2026-06-09 14:37:00.95581551 +0000 UTC m=+0.308895331 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101879 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2915f0418025b69992c89f4af4c5d7 SystemUUID:ec2915f0-4180-25b6-9992-c89f4af4c5d7 BootID:e8404d39-145f-4ce4-965b-adb6454bb144 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f5:f2:b8:ed:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f5:f2:b8:ed:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:60:2e:d2:2f:9b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 14:37:00.957142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.957140 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 14:37:00.957287 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.957247 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 14:37:00.959943 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.959905 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 14:37:00.960098 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.959944 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-219.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 14:37:00.960679 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.960665 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 14:37:00.960727 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.960684 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 14:37:00.960727 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.960694 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 14:37:00.960727 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.960713 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 14:37:00.961537 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.961526 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 14:37:00.964564 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.964552 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 14:37:00.964680 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.964671 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 14:37:00.964710 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.964704 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 09 14:37:00.964737 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.964719 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 14:37:00.964780 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.964743 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 14:37:00.964780 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.964756 2577 kubelet.go:398] "Adding apiserver pod source" Jun 09 14:37:00.964780 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.964767 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 14:37:00.965238 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.965225 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 14:37:00.965300 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.965244 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 14:37:00.967288 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.967271 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 14:37:00.967716 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.967699 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 14:37:00.968948 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.968917 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 14:37:00.969022 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.968967 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 14:37:00.970230 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970170 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 14:37:00.970326 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970238 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 14:37:00.970326 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970251 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 14:37:00.970326 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970261 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 14:37:00.970326 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970282 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 14:37:00.970326 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970291 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 14:37:00.970326 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970303 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 14:37:00.970326 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970312 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 14:37:00.970628 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970337 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 14:37:00.970628 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970361 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 14:37:00.970628 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970373 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 14:37:00.970628 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.970382 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 14:37:00.971219 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.971204 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 14:37:00.971257 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.971233 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 14:37:00.974699 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.974684 2577 server.go:1268] "Started kubelet" Jun 09 14:37:00.974820 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.974797 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 14:37:00.974877 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.974832 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 14:37:00.974922 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.974897 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 14:37:00.975898 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.975868 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-219.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 14:37:00.975987 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:00.975958 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 14:37:00.976034 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:00.975984 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-219.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 14:37:00.976350 ip-10-0-143-219 systemd[1]: Started Kubernetes Kubelet. Jun 09 14:37:00.977388 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.977375 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 09 14:37:00.978901 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.978883 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 14:37:00.981147 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:00.981122 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 14:37:00.983833 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.983817 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 14:37:00.983833 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.983827 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 14:37:00.983967 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:00.983886 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:00.984107 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:00.983180 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-219.ec2.internal.18b77073f48b2940 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-219.ec2.internal,UID:ip-10-0-143-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-219.ec2.internal,},FirstTimestamp:2026-06-09 14:37:00.974631232 +0000 UTC m=+0.327711039,LastTimestamp:2026-06-09 14:37:00.974631232 +0000 UTC m=+0.327711039,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-219.ec2.internal,}" Jun 09 14:37:00.985416 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.985052 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 14:37:00.985416 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.985068 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 14:37:00.986160 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.985734 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 14:37:00.986160 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.986103 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 14:37:00.986160 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.986116 2577 factory.go:55] Registering systemd factory Jun 09 14:37:00.986160 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.986126 2577 factory.go:223] Registration of the systemd container factory successfully Jun 09 14:37:00.986361 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.986201 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 09 14:37:00.986361 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.986213 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 09 14:37:00.986448 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.986364 2577 factory.go:153] Registering CRI-O factory Jun 09 14:37:00.986448 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.986379 2577 factory.go:223] Registration of the crio container factory successfully Jun 09 14:37:00.986448 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.986400 2577 factory.go:103] Registering Raw factory Jun 09 14:37:00.986448 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.986412 2577 manager.go:1196] Started watching for new ooms in manager Jun 09 14:37:00.986893 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.986876 2577 manager.go:349] Starting recovery of all containers Jun 09 14:37:00.988567 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:00.988547 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-219.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 14:37:00.988648 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:00.988565 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 14:37:00.997655 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:00.997524 2577 manager.go:354] Recovery completed Jun 09 14:37:01.002818 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.002804 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:37:01.004584 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.004559 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:37:01.004658 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.004597 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:37:01.004658 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.004608 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:37:01.005094 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.005077 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 14:37:01.005094 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.005092 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 14:37:01.005202 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.005108 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 14:37:01.005202 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.005091 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:37:01.006035 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.006018 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:37:01.006110 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.006047 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:37:01.006110 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.006057 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:37:01.006365 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.006353 2577 policy_none.go:49] "None policy: Start" Jun 09 14:37:01.006397 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.006368 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 14:37:01.006397 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.006378 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 14:37:01.007346 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.007273 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-219.ec2.internal.18b77073f6543295 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-219.ec2.internal,UID:ip-10-0-143-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-219.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-219.ec2.internal,},FirstTimestamp:2026-06-09 14:37:01.004583573 +0000 UTC m=+0.357663384,LastTimestamp:2026-06-09 14:37:01.004583573 +0000 UTC m=+0.357663384,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-219.ec2.internal,}" Jun 09 14:37:01.007420 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.007370 2577 policy_none.go:47] "Start" Jun 09 14:37:01.008995 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.008978 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dc6zh" Jun 09 14:37:01.014501 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.014443 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-219.ec2.internal.18b77073f6547a8f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-219.ec2.internal,UID:ip-10-0-143-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-219.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-219.ec2.internal,},FirstTimestamp:2026-06-09 14:37:01.004601999 +0000 UTC m=+0.357681808,LastTimestamp:2026-06-09 14:37:01.004601999 +0000 UTC m=+0.357681808,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-219.ec2.internal,}" Jun 09 14:37:01.022692 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.022675 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dc6zh" Jun 09 14:37:01.024439 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.024346 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-219.ec2.internal.18b77073f654a066 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-219.ec2.internal,UID:ip-10-0-143-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-219.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-219.ec2.internal,},FirstTimestamp:2026-06-09 14:37:01.004611686 +0000 UTC m=+0.357691494,LastTimestamp:2026-06-09 14:37:01.004611686 +0000 UTC m=+0.357691494,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-219.ec2.internal,}" Jun 09 14:37:01.043824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.040500 2577 manager.go:337] "Starting Device Plugin manager" Jun 09 14:37:01.043824 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.040532 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 14:37:01.043824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.040545 2577 server.go:87] "Starting device plugin registration server" Jun 09 14:37:01.043824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.040810 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 14:37:01.043824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.040822 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 14:37:01.043824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.040916 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 14:37:01.043824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.041002 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 14:37:01.043824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.041010 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 14:37:01.043824 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.042021 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 14:37:01.043824 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.042066 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.045634 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.045612 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 14:37:01.046752 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.046734 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 14:37:01.046799 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.046781 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 14:37:01.046835 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.046805 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 14:37:01.046899 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.046880 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 14:37:01.049480 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.049452 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:37:01.141187 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.141151 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:37:01.142404 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.142385 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:37:01.142514 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.142422 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:37:01.142514 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.142439 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:37:01.142514 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.142462 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.146943 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.146914 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal"] Jun 09 14:37:01.147010 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.146981 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:37:01.148772 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.148749 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:37:01.148819 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.148785 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:37:01.148819 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.148796 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:37:01.150038 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.150027 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:37:01.150169 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.150145 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.150245 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.150226 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:37:01.150743 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.150723 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:37:01.150847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.150754 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:37:01.150847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.150766 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:37:01.150847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.150731 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:37:01.150847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.150814 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:37:01.150847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.150830 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:37:01.151099 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.150949 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.151099 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.150967 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-219.ec2.internal\": node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.151963 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.151948 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.152045 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.151975 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:37:01.152580 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.152567 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:37:01.152654 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.152591 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:37:01.152654 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.152601 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:37:01.172793 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.172746 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.173457 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.173443 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-219.ec2.internal\" not found" node="ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.177318 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.177303 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-219.ec2.internal\" not found" node="ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.273005 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.272973 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.286975 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.286950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e6c03ff4791518cefd5e0d8ce17e297-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal\" (UID: \"5e6c03ff4791518cefd5e0d8ce17e297\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.287053 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.286981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e6c03ff4791518cefd5e0d8ce17e297-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal\" (UID: \"5e6c03ff4791518cefd5e0d8ce17e297\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.287053 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.286999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d639eee1bcbf75688fbff254b7fc992-config\") pod \"kube-apiserver-proxy-ip-10-0-143-219.ec2.internal\" (UID: \"0d639eee1bcbf75688fbff254b7fc992\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.373354 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.373321 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.387778 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.387751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e6c03ff4791518cefd5e0d8ce17e297-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal\" (UID: \"5e6c03ff4791518cefd5e0d8ce17e297\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.387852 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.387781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d639eee1bcbf75688fbff254b7fc992-config\") pod \"kube-apiserver-proxy-ip-10-0-143-219.ec2.internal\" (UID: \"0d639eee1bcbf75688fbff254b7fc992\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.387852 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.387797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e6c03ff4791518cefd5e0d8ce17e297-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal\" (UID: \"5e6c03ff4791518cefd5e0d8ce17e297\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.387852 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.387841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e6c03ff4791518cefd5e0d8ce17e297-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal\" (UID: \"5e6c03ff4791518cefd5e0d8ce17e297\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.388025 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.387860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e6c03ff4791518cefd5e0d8ce17e297-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal\" (UID: \"5e6c03ff4791518cefd5e0d8ce17e297\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.388025 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.387868 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d639eee1bcbf75688fbff254b7fc992-config\") pod \"kube-apiserver-proxy-ip-10-0-143-219.ec2.internal\" (UID: \"0d639eee1bcbf75688fbff254b7fc992\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.474255 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.474171 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.477331 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.477312 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.481356 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.481339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal" Jun 09 14:37:01.574364 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.574326 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.674999 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.674970 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.775646 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.775579 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.876286 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.876257 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.930907 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.930880 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 14:37:01.931572 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.931094 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 14:37:01.960773 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.960621 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:37:01.971199 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:01.971173 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d639eee1bcbf75688fbff254b7fc992.slice/crio-0dda218592d25167b8af766b914c92cdd66fde7c92de077852eab7a54988ba0b WatchSource:0}: Error finding container 0dda218592d25167b8af766b914c92cdd66fde7c92de077852eab7a54988ba0b: Status 404 returned error can't find the container with id 0dda218592d25167b8af766b914c92cdd66fde7c92de077852eab7a54988ba0b Jun 09 14:37:01.971775 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:01.971756 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e6c03ff4791518cefd5e0d8ce17e297.slice/crio-38c64ff91dabf2046dd620939daa7112ffe01314d1f93b2616bf62460bf22da1 WatchSource:0}: Error finding container 38c64ff91dabf2046dd620939daa7112ffe01314d1f93b2616bf62460bf22da1: Status 404 returned error can't find the container with id 38c64ff91dabf2046dd620939daa7112ffe01314d1f93b2616bf62460bf22da1 Jun 09 14:37:01.976413 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:01.976390 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:01.977585 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:01.977572 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:37:02.025151 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.025117 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 14:32:01 +0000 UTC" deadline="2027-12-15 01:54:16.239120039 +0000 UTC" Jun 09 14:37:02.025151 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.025146 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13283h17m14.213977075s" Jun 09 14:37:02.050464 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.050368 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" event={"ID":"5e6c03ff4791518cefd5e0d8ce17e297","Type":"ContainerStarted","Data":"38c64ff91dabf2046dd620939daa7112ffe01314d1f93b2616bf62460bf22da1"} Jun 09 14:37:02.051307 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.051290 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal" event={"ID":"0d639eee1bcbf75688fbff254b7fc992","Type":"ContainerStarted","Data":"0dda218592d25167b8af766b914c92cdd66fde7c92de077852eab7a54988ba0b"} Jun 09 14:37:02.064917 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.064891 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:37:02.077430 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:02.077412 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-219.ec2.internal\" not found" Jun 09 14:37:02.110796 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.110773 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:37:02.184280 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.184251 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal" Jun 09 14:37:02.192111 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.192081 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 14:37:02.193000 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.192984 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" Jun 09 14:37:02.204688 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.204671 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 14:37:02.966210 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.966164 2577 apiserver.go:52] "Watching apiserver" Jun 09 14:37:02.972022 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.971994 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 14:37:02.972582 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.972553 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-dxq5z","openshift-multus/multus-additional-cni-plugins-pxbx4","openshift-multus/multus-kjwbp","openshift-multus/network-metrics-daemon-pzrj2","openshift-network-diagnostics/network-check-target-lnq5t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j","openshift-cluster-node-tuning-operator/tuned-24znr","openshift-image-registry/node-ca-sz6h7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal","openshift-network-operator/iptables-alerter-pst7d","openshift-ovn-kubernetes/ovnkube-node-f7n9h","kube-system/global-pull-secret-syncer-x6jb7","kube-system/konnectivity-agent-jchds","kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal"] Jun 09 14:37:02.974198 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.974170 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.975232 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.975211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:02.976387 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.976321 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.976481 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.976436 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:37:02.976481 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.976458 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 14:37:02.976586 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.976514 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9bx96\"" Jun 09 14:37:02.977242 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.977222 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 14:37:02.977460 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.977441 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m4bkn\"" Jun 09 14:37:02.977555 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.977540 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 14:37:02.977727 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.977711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:02.977847 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:02.977793 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:02.977939 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.977911 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 14:37:02.978233 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.978036 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 14:37:02.978233 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.978229 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 14:37:02.978367 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.978338 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xhcfv\"" Jun 09 14:37:02.978421 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.978378 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 14:37:02.978787 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.978675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:02.978787 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:02.978755 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:02.979903 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.979882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:02.981323 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.981221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:02.981426 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.981319 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 14:37:02.982026 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.981797 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 14:37:02.982026 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.981921 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cngln\"" Jun 09 14:37:02.982026 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.981994 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 14:37:02.982423 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.982404 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:02.983099 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.983081 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 14:37:02.983181 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.983119 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 14:37:02.983250 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.983206 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 14:37:02.983250 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.983210 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jkmzb\"" Jun 09 14:37:02.983605 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.983555 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:02.983967 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.983948 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 14:37:02.984061 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.984015 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 14:37:02.984286 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.984248 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 14:37:02.985159 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.985138 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xkgzf\"" Jun 09 14:37:02.985381 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.985359 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 14:37:02.985666 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.985645 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 14:37:02.985738 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.985712 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5s4b7\"" Jun 09 14:37:02.987496 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.987476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:02.989097 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.989076 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 14:37:02.989212 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.989195 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:02.989421 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.989282 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:37:02.989421 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.989311 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 14:37:02.990056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.990040 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nh6xz\"" Jun 09 14:37:02.990715 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.990690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:02.990794 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:02.990743 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:02.991435 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.991123 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vmxds\"" Jun 09 14:37:02.991435 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.991201 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 14:37:02.991435 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.991281 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 14:37:02.991435 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.991326 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 14:37:02.991670 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.991534 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 14:37:02.991670 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.991636 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 14:37:02.991796 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.991777 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 14:37:02.996637 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.996615 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 14:37:02.997049 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-os-release\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.997149 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-hostroot\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.997149 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmtx2\" (UniqueName: \"kubernetes.io/projected/a83d0a1b-2ab5-4528-a09e-955b4183b138-kube-api-access-gmtx2\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.997149 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:02.997308 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997151 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6khc9\" (UniqueName: \"kubernetes.io/projected/3cc83194-ffab-4024-8d32-b19fc6982744-kube-api-access-6khc9\") pod \"iptables-alerter-pst7d\" (UID: \"3cc83194-ffab-4024-8d32-b19fc6982744\") " pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:02.997308 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d06cfa11-043c-4afd-9b11-bae1f0dd4de8-agent-certs\") pod \"konnectivity-agent-jchds\" (UID: \"d06cfa11-043c-4afd-9b11-bae1f0dd4de8\") " pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:02.997308 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-etc-kubernetes\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.997308 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-sysconfig\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.997308 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997251 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f91e9a1-398c-4559-970c-a1bba6ce235a-tmp-dir\") pod \"node-resolver-dxq5z\" (UID: \"8f91e9a1-398c-4559-970c-a1bba6ce235a\") " pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:02.997308 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-cnibin\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.997644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-run-multus-certs\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.997644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5db6a45-6f92-4e00-876c-bb54048f68b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:02.997644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-registration-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:02.997644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-sys-fs\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:02.997644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3cc83194-ffab-4024-8d32-b19fc6982744-host-slash\") pod \"iptables-alerter-pst7d\" (UID: \"3cc83194-ffab-4024-8d32-b19fc6982744\") " pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:02.997644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-system-cni-dir\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.997644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-conf-dir\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.997644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f91e9a1-398c-4559-970c-a1bba6ce235a-hosts-file\") pod \"node-resolver-dxq5z\" (UID: \"8f91e9a1-398c-4559-970c-a1bba6ce235a\") " pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:02.997644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mjw\" (UniqueName: \"kubernetes.io/projected/8f91e9a1-398c-4559-970c-a1bba6ce235a-kube-api-access-82mjw\") pod \"node-resolver-dxq5z\" (UID: \"8f91e9a1-398c-4559-970c-a1bba6ce235a\") " pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:02.997644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5db6a45-6f92-4e00-876c-bb54048f68b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-daemon-config\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997708 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-sysctl-conf\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-var-lib-kubelet\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt9jc\" (UniqueName: \"kubernetes.io/projected/92f7ab4e-6e36-4c50-ba47-a63d198f2702-kube-api-access-jt9jc\") pod \"node-ca-sz6h7\" (UID: \"92f7ab4e-6e36-4c50-ba47-a63d198f2702\") " pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5db6a45-6f92-4e00-876c-bb54048f68b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-sys\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.997969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-socket-dir-parent\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-kubernetes\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-sysctl-d\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dlqr\" (UniqueName: \"kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr\") pod \"network-check-target-lnq5t\" (UID: \"2b18e13b-bfe8-4523-abab-848e763d1e85\") " pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92f7ab4e-6e36-4c50-ba47-a63d198f2702-host\") pod \"node-ca-sz6h7\" (UID: \"92f7ab4e-6e36-4c50-ba47-a63d198f2702\") " pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-system-cni-dir\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:02.998265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-run\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a83d0a1b-2ab5-4528-a09e-955b4183b138-tmp\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lsn8\" (UniqueName: \"kubernetes.io/projected/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-kube-api-access-9lsn8\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be0f1949-d70d-44c6-abf9-5904c7ebc750-cni-binary-copy\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl46w\" (UniqueName: \"kubernetes.io/projected/be0f1949-d70d-44c6-abf9-5904c7ebc750-kube-api-access-zl46w\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-lib-modules\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-run-k8s-cni-cncf-io\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-cnibin\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-os-release\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-systemd\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-var-lib-kubelet\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npjvq\" (UniqueName: \"kubernetes.io/projected/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-kube-api-access-npjvq\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-var-lib-cni-multus\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-modprobe-d\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-host\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-socket-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:02.998960 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-device-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:02.999576 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3cc83194-ffab-4024-8d32-b19fc6982744-iptables-alerter-script\") pod \"iptables-alerter-pst7d\" (UID: \"3cc83194-ffab-4024-8d32-b19fc6982744\") " pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:02.999576 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998773 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d06cfa11-043c-4afd-9b11-bae1f0dd4de8-konnectivity-ca\") pod \"konnectivity-agent-jchds\" (UID: \"d06cfa11-043c-4afd-9b11-bae1f0dd4de8\") " pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:02.999576 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-cni-dir\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.999576 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-run-netns\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:02.999576 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-tuned\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:02.999576 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92f7ab4e-6e36-4c50-ba47-a63d198f2702-serviceca\") pod \"node-ca-sz6h7\" (UID: \"92f7ab4e-6e36-4c50-ba47-a63d198f2702\") " pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:02.999576 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4prj7\" (UniqueName: \"kubernetes.io/projected/c5db6a45-6f92-4e00-876c-bb54048f68b3-kube-api-access-4prj7\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:02.999576 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:02.998909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-var-lib-cni-bin\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.012652 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.012631 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:37:03.019886 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.019868 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xjnhh" Jun 09 14:37:03.031807 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.031787 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xjnhh" Jun 09 14:37:03.087658 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.087618 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 14:37:03.100087 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-run-k8s-cni-cncf-io\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.100252 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100094 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-cnibin\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.100252 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-os-release\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.100252 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100179 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-cnibin\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.100252 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-run-k8s-cni-cncf-io\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.100252 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-systemd\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.100252 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-var-lib-kubelet\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjvq\" (UniqueName: \"kubernetes.io/projected/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-kube-api-access-npjvq\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-systemd\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-os-release\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-systemd-units\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-run-openvswitch\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100334 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-var-lib-kubelet\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-var-lib-cni-multus\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-modprobe-d\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100411 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-var-lib-cni-multus\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-host\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-socket-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100474 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-host\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.100527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-device-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3cc83194-ffab-4024-8d32-b19fc6982744-iptables-alerter-script\") pod \"iptables-alerter-pst7d\" (UID: \"3cc83194-ffab-4024-8d32-b19fc6982744\") " pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100545 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-modprobe-d\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-kubelet\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-device-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-socket-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-run-ovn\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d06cfa11-043c-4afd-9b11-bae1f0dd4de8-konnectivity-ca\") pod \"konnectivity-agent-jchds\" (UID: \"d06cfa11-043c-4afd-9b11-bae1f0dd4de8\") " pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-cni-dir\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-run-netns\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-tuned\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100772 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-run-netns\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-log-socket\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-cni-bin\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100823 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-cni-dir\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92f7ab4e-6e36-4c50-ba47-a63d198f2702-serviceca\") pod \"node-ca-sz6h7\" (UID: \"92f7ab4e-6e36-4c50-ba47-a63d198f2702\") " pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4prj7\" (UniqueName: \"kubernetes.io/projected/c5db6a45-6f92-4e00-876c-bb54048f68b3-kube-api-access-4prj7\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.101104 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.100983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-cni-netd\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/606ac104-2982-46c8-8621-8042bf784934-ovnkube-config\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/606ac104-2982-46c8-8621-8042bf784934-ovn-node-metrics-cert\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101066 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/606ac104-2982-46c8-8621-8042bf784934-ovnkube-script-lib\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3cc83194-ffab-4024-8d32-b19fc6982744-iptables-alerter-script\") pod \"iptables-alerter-pst7d\" (UID: \"3cc83194-ffab-4024-8d32-b19fc6982744\") " pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-var-lib-cni-bin\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101221 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d06cfa11-043c-4afd-9b11-bae1f0dd4de8-konnectivity-ca\") pod \"konnectivity-agent-jchds\" (UID: \"d06cfa11-043c-4afd-9b11-bae1f0dd4de8\") " pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-os-release\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-hostroot\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101295 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-os-release\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101285 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92f7ab4e-6e36-4c50-ba47-a63d198f2702-serviceca\") pod \"node-ca-sz6h7\" (UID: \"92f7ab4e-6e36-4c50-ba47-a63d198f2702\") " pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtx2\" (UniqueName: \"kubernetes.io/projected/a83d0a1b-2ab5-4528-a09e-955b4183b138-kube-api-access-gmtx2\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101348 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-var-lib-cni-bin\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101350 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-hostroot\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101378 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-slash\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.101761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.101426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.102540 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.102005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mppqg\" (UniqueName: \"kubernetes.io/projected/606ac104-2982-46c8-8621-8042bf784934-kube-api-access-mppqg\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.102540 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.102370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.102540 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.102419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6khc9\" (UniqueName: \"kubernetes.io/projected/3cc83194-ffab-4024-8d32-b19fc6982744-kube-api-access-6khc9\") pod \"iptables-alerter-pst7d\" (UID: \"3cc83194-ffab-4024-8d32-b19fc6982744\") " pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:03.102540 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.102453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d06cfa11-043c-4afd-9b11-bae1f0dd4de8-agent-certs\") pod \"konnectivity-agent-jchds\" (UID: \"d06cfa11-043c-4afd-9b11-bae1f0dd4de8\") " pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:03.102540 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.102487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-etc-kubernetes\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.102540 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.102516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-sysconfig\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.102856 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.102607 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-sysconfig\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.103196 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103038 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-etc-kubernetes\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.103196 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.103370 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103274 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-etc-openvswitch\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.103370 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f91e9a1-398c-4559-970c-a1bba6ce235a-tmp-dir\") pod \"node-resolver-dxq5z\" (UID: \"8f91e9a1-398c-4559-970c-a1bba6ce235a\") " pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:03.103370 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-run-systemd\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.103523 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50a4eea7-0255-4698-b270-2683097068de-dbus\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:03.103523 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-cnibin\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.103523 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-run-multus-certs\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.103523 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5db6a45-6f92-4e00-876c-bb54048f68b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.103523 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103517 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-cnibin\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.103754 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-registration-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.103754 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-sys-fs\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.103754 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103604 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-run-multus-certs\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.103754 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3cc83194-ffab-4024-8d32-b19fc6982744-host-slash\") pod \"iptables-alerter-pst7d\" (UID: \"3cc83194-ffab-4024-8d32-b19fc6982744\") " pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:03.103754 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50a4eea7-0255-4698-b270-2683097068de-kubelet-config\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:03.103754 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103671 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-sys-fs\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.103754 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-system-cni-dir\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.103754 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-conf-dir\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f91e9a1-398c-4559-970c-a1bba6ce235a-hosts-file\") pod \"node-resolver-dxq5z\" (UID: \"8f91e9a1-398c-4559-970c-a1bba6ce235a\") " pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mjw\" (UniqueName: \"kubernetes.io/projected/8f91e9a1-398c-4559-970c-a1bba6ce235a-kube-api-access-82mjw\") pod \"node-resolver-dxq5z\" (UID: \"8f91e9a1-398c-4559-970c-a1bba6ce235a\") " pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5db6a45-6f92-4e00-876c-bb54048f68b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f91e9a1-398c-4559-970c-a1bba6ce235a-tmp-dir\") pod \"node-resolver-dxq5z\" (UID: \"8f91e9a1-398c-4559-970c-a1bba6ce235a\") " pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-daemon-config\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-system-cni-dir\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-registration-dir\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.103977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-sysctl-conf\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-var-lib-openvswitch\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-node-log\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/606ac104-2982-46c8-8621-8042bf784934-env-overrides\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104089 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-var-lib-kubelet\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt9jc\" (UniqueName: \"kubernetes.io/projected/92f7ab4e-6e36-4c50-ba47-a63d198f2702-kube-api-access-jt9jc\") pod \"node-ca-sz6h7\" (UID: \"92f7ab4e-6e36-4c50-ba47-a63d198f2702\") " pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:03.104150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5db6a45-6f92-4e00-876c-bb54048f68b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-sys\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104347 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5db6a45-6f92-4e00-876c-bb54048f68b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104446 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-sysctl-conf\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-socket-dir-parent\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f91e9a1-398c-4559-970c-a1bba6ce235a-hosts-file\") pod \"node-resolver-dxq5z\" (UID: \"8f91e9a1-398c-4559-970c-a1bba6ce235a\") " pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-kubernetes\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-sysctl-d\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-run-netns\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104608 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-tuned\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlqr\" (UniqueName: \"kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr\") pod \"network-check-target-lnq5t\" (UID: \"2b18e13b-bfe8-4523-abab-848e763d1e85\") " pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92f7ab4e-6e36-4c50-ba47-a63d198f2702-host\") pod \"node-ca-sz6h7\" (UID: \"92f7ab4e-6e36-4c50-ba47-a63d198f2702\") " pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-system-cni-dir\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-system-cni-dir\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3cc83194-ffab-4024-8d32-b19fc6982744-host-slash\") pod \"iptables-alerter-pst7d\" (UID: \"3cc83194-ffab-4024-8d32-b19fc6982744\") " pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:03.104909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.104863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-host-var-lib-kubelet\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5db6a45-6f92-4e00-876c-bb54048f68b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-daemon-config\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-run\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a83d0a1b-2ab5-4528-a09e-955b4183b138-tmp\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lsn8\" (UniqueName: \"kubernetes.io/projected/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-kube-api-access-9lsn8\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be0f1949-d70d-44c6-abf9-5904c7ebc750-cni-binary-copy\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5db6a45-6f92-4e00-876c-bb54048f68b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl46w\" (UniqueName: \"kubernetes.io/projected/be0f1949-d70d-44c6-abf9-5904c7ebc750-kube-api-access-zl46w\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-lib-modules\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-lib-modules\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.105659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5db6a45-6f92-4e00-876c-bb54048f68b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.106197 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-sys\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.106197 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.105805 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:03.106197 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.105905 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs podName:cf3a7d28-6504-46ae-b4d2-0a45e236a5ee nodeName:}" failed. No retries permitted until 2026-06-09 14:37:03.605858225 +0000 UTC m=+2.958938039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs") pod "network-metrics-daemon-pzrj2" (UID: "cf3a7d28-6504-46ae-b4d2-0a45e236a5ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:03.106197 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d06cfa11-043c-4afd-9b11-bae1f0dd4de8-agent-certs\") pod \"konnectivity-agent-jchds\" (UID: \"d06cfa11-043c-4afd-9b11-bae1f0dd4de8\") " pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:03.106197 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.105972 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-conf-dir\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.106197 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.106048 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be0f1949-d70d-44c6-abf9-5904c7ebc750-multus-socket-dir-parent\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.106197 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.106109 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-kubernetes\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.106525 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.106220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-etc-sysctl-d\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.106525 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.106262 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a83d0a1b-2ab5-4528-a09e-955b4183b138-run\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.106525 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.106292 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be0f1949-d70d-44c6-abf9-5904c7ebc750-cni-binary-copy\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.106525 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.106328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92f7ab4e-6e36-4c50-ba47-a63d198f2702-host\") pod \"node-ca-sz6h7\" (UID: \"92f7ab4e-6e36-4c50-ba47-a63d198f2702\") " pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:03.107717 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.107694 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a83d0a1b-2ab5-4528-a09e-955b4183b138-tmp\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.111639 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.111613 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:03.111739 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.111648 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:03.111739 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.111663 2577 projected.go:196] Error preparing data for projected volume kube-api-access-2dlqr for pod openshift-network-diagnostics/network-check-target-lnq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:03.111850 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.111764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4prj7\" (UniqueName: \"kubernetes.io/projected/c5db6a45-6f92-4e00-876c-bb54048f68b3-kube-api-access-4prj7\") pod \"multus-additional-cni-plugins-pxbx4\" (UID: \"c5db6a45-6f92-4e00-876c-bb54048f68b3\") " pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.111850 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.111781 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr podName:2b18e13b-bfe8-4523-abab-848e763d1e85 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:03.61176319 +0000 UTC m=+2.964842987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2dlqr" (UniqueName: "kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr") pod "network-check-target-lnq5t" (UID: "2b18e13b-bfe8-4523-abab-848e763d1e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:03.112579 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.112534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmtx2\" (UniqueName: \"kubernetes.io/projected/a83d0a1b-2ab5-4528-a09e-955b4183b138-kube-api-access-gmtx2\") pod \"tuned-24znr\" (UID: \"a83d0a1b-2ab5-4528-a09e-955b4183b138\") " pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.112692 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.112669 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6khc9\" (UniqueName: \"kubernetes.io/projected/3cc83194-ffab-4024-8d32-b19fc6982744-kube-api-access-6khc9\") pod \"iptables-alerter-pst7d\" (UID: \"3cc83194-ffab-4024-8d32-b19fc6982744\") " pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:03.113684 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.113659 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npjvq\" (UniqueName: \"kubernetes.io/projected/49a7a6e2-4aff-4c85-be90-cc555bc25dcd-kube-api-access-npjvq\") pod \"aws-ebs-csi-driver-node-pts8j\" (UID: \"49a7a6e2-4aff-4c85-be90-cc555bc25dcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.114120 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.114095 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lsn8\" (UniqueName: \"kubernetes.io/projected/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-kube-api-access-9lsn8\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:03.114246 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.114145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl46w\" (UniqueName: \"kubernetes.io/projected/be0f1949-d70d-44c6-abf9-5904c7ebc750-kube-api-access-zl46w\") pod \"multus-kjwbp\" (UID: \"be0f1949-d70d-44c6-abf9-5904c7ebc750\") " pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.114847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.114825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt9jc\" (UniqueName: \"kubernetes.io/projected/92f7ab4e-6e36-4c50-ba47-a63d198f2702-kube-api-access-jt9jc\") pod \"node-ca-sz6h7\" (UID: \"92f7ab4e-6e36-4c50-ba47-a63d198f2702\") " pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:03.115147 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.115129 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mjw\" (UniqueName: \"kubernetes.io/projected/8f91e9a1-398c-4559-970c-a1bba6ce235a-kube-api-access-82mjw\") pod \"node-resolver-dxq5z\" (UID: \"8f91e9a1-398c-4559-970c-a1bba6ce235a\") " pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:03.206608 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-run-netns\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.206783 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-systemd-units\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.206783 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-run-openvswitch\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.206783 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-kubelet\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.206783 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-run-ovn\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.206783 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-log-socket\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.206783 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-cni-bin\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.206783 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-cni-netd\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/606ac104-2982-46c8-8621-8042bf784934-ovnkube-config\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/606ac104-2982-46c8-8621-8042bf784934-ovn-node-metrics-cert\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/606ac104-2982-46c8-8621-8042bf784934-ovnkube-script-lib\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-slash\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.206982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mppqg\" (UniqueName: \"kubernetes.io/projected/606ac104-2982-46c8-8621-8042bf784934-kube-api-access-mppqg\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-etc-openvswitch\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-run-systemd\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-run-netns\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50a4eea7-0255-4698-b270-2683097068de-dbus\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50a4eea7-0255-4698-b270-2683097068de-kubelet-config\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207127 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207136 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-slash\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-var-lib-openvswitch\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207188 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-run-ovn\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-node-log\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207196 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-var-lib-openvswitch\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/606ac104-2982-46c8-8621-8042bf784934-env-overrides\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207222 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-cni-netd\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207288 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-run-systemd\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.207148 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207299 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-etc-openvswitch\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.207355 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret podName:50a4eea7-0255-4698-b270-2683097068de nodeName:}" failed. No retries permitted until 2026-06-09 14:37:03.707336729 +0000 UTC m=+3.060416531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret") pod "global-pull-secret-syncer-x6jb7" (UID: "50a4eea7-0255-4698-b270-2683097068de") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-kubelet\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207490 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-node-log\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207533 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-host-cni-bin\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-run-openvswitch\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50a4eea7-0255-4698-b270-2683097068de-dbus\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:03.207870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-systemd-units\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.208512 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/606ac104-2982-46c8-8621-8042bf784934-env-overrides\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.208512 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50a4eea7-0255-4698-b270-2683097068de-kubelet-config\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:03.208512 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/606ac104-2982-46c8-8621-8042bf784934-ovnkube-config\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.208512 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.207750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/606ac104-2982-46c8-8621-8042bf784934-log-socket\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.208644 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.208603 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/606ac104-2982-46c8-8621-8042bf784934-ovnkube-script-lib\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.210502 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.210484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/606ac104-2982-46c8-8621-8042bf784934-ovn-node-metrics-cert\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.215203 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.215180 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mppqg\" (UniqueName: \"kubernetes.io/projected/606ac104-2982-46c8-8621-8042bf784934-kube-api-access-mppqg\") pod \"ovnkube-node-f7n9h\" (UID: \"606ac104-2982-46c8-8621-8042bf784934\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.288244 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.288130 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-24znr" Jun 09 14:37:03.295896 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.295878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:03.302292 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.302275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kjwbp" Jun 09 14:37:03.307725 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.307703 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" Jun 09 14:37:03.314566 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.314552 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sz6h7" Jun 09 14:37:03.320043 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.320030 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dxq5z" Jun 09 14:37:03.326716 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.326697 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" Jun 09 14:37:03.335332 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.335315 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pst7d" Jun 09 14:37:03.341098 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.341074 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:03.610167 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.610138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:03.610338 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.610295 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:03.610445 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.610355 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs podName:cf3a7d28-6504-46ae-b4d2-0a45e236a5ee nodeName:}" failed. No retries permitted until 2026-06-09 14:37:04.610340317 +0000 UTC m=+3.963420113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs") pod "network-metrics-daemon-pzrj2" (UID: "cf3a7d28-6504-46ae-b4d2-0a45e236a5ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:03.711146 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.711111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:03.711306 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:03.711201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlqr\" (UniqueName: \"kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr\") pod \"network-check-target-lnq5t\" (UID: \"2b18e13b-bfe8-4523-abab-848e763d1e85\") " pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:03.711306 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.711283 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:03.711418 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.711315 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:03.711418 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.711334 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:03.711418 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.711340 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret podName:50a4eea7-0255-4698-b270-2683097068de nodeName:}" failed. No retries permitted until 2026-06-09 14:37:04.711325664 +0000 UTC m=+4.064405464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret") pod "global-pull-secret-syncer-x6jb7" (UID: "50a4eea7-0255-4698-b270-2683097068de") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:03.711418 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.711345 2577 projected.go:196] Error preparing data for projected volume kube-api-access-2dlqr for pod openshift-network-diagnostics/network-check-target-lnq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:03.711418 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:03.711388 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr podName:2b18e13b-bfe8-4523-abab-848e763d1e85 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:04.711371807 +0000 UTC m=+4.064451624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dlqr" (UniqueName: "kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr") pod "network-check-target-lnq5t" (UID: "2b18e13b-bfe8-4523-abab-848e763d1e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:03.820533 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:03.820502 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0f1949_d70d_44c6_abf9_5904c7ebc750.slice/crio-f90cd8487e20061796eb730df431b4b46dab0df5593c0dae94e8001b4fc53988 WatchSource:0}: Error finding container f90cd8487e20061796eb730df431b4b46dab0df5593c0dae94e8001b4fc53988: Status 404 returned error can't find the container with id f90cd8487e20061796eb730df431b4b46dab0df5593c0dae94e8001b4fc53988 Jun 09 14:37:03.821375 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:03.821351 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5db6a45_6f92_4e00_876c_bb54048f68b3.slice/crio-d985bc2de84a1083f441991aa02a4620c2edd7412018e56a3bcba0c232cfe4ab WatchSource:0}: Error finding container d985bc2de84a1083f441991aa02a4620c2edd7412018e56a3bcba0c232cfe4ab: Status 404 returned error can't find the container with id d985bc2de84a1083f441991aa02a4620c2edd7412018e56a3bcba0c232cfe4ab Jun 09 14:37:03.822454 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:03.822428 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606ac104_2982_46c8_8621_8042bf784934.slice/crio-d36365f17e853f1eed5bbd9aa2f1bdbee6b8d78e5a3bac90ac1a18660ecaae68 WatchSource:0}: Error finding container d36365f17e853f1eed5bbd9aa2f1bdbee6b8d78e5a3bac90ac1a18660ecaae68: Status 404 returned error can't find the container with id d36365f17e853f1eed5bbd9aa2f1bdbee6b8d78e5a3bac90ac1a18660ecaae68 Jun 09 14:37:03.826086 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:03.826050 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06cfa11_043c_4afd_9b11_bae1f0dd4de8.slice/crio-39c644fd639ef6c06565059bdb6e999c4886ba8f1866bc88a274a19552b38c0c WatchSource:0}: Error finding container 39c644fd639ef6c06565059bdb6e999c4886ba8f1866bc88a274a19552b38c0c: Status 404 returned error can't find the container with id 39c644fd639ef6c06565059bdb6e999c4886ba8f1866bc88a274a19552b38c0c Jun 09 14:37:03.830435 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:03.830376 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f91e9a1_398c_4559_970c_a1bba6ce235a.slice/crio-2e5abc78cc04cc18678efb3120c1c1c7d3f6b51f113300df907bee98e40919ab WatchSource:0}: Error finding container 2e5abc78cc04cc18678efb3120c1c1c7d3f6b51f113300df907bee98e40919ab: Status 404 returned error can't find the container with id 2e5abc78cc04cc18678efb3120c1c1c7d3f6b51f113300df907bee98e40919ab Jun 09 14:37:03.831072 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:03.831018 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a7a6e2_4aff_4c85_be90_cc555bc25dcd.slice/crio-db16911dd23fddaa31cf7f45cee8d8656031cbbab7d1d234bb1356ede8688c47 WatchSource:0}: Error finding container db16911dd23fddaa31cf7f45cee8d8656031cbbab7d1d234bb1356ede8688c47: Status 404 returned error can't find the container with id db16911dd23fddaa31cf7f45cee8d8656031cbbab7d1d234bb1356ede8688c47 Jun 09 14:37:03.832062 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:03.832009 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc83194_ffab_4024_8d32_b19fc6982744.slice/crio-8d112cfd5dba00d1ff07e3ec8684efa369eb787b2e330b2b368d2afafba4aae9 WatchSource:0}: Error finding container 8d112cfd5dba00d1ff07e3ec8684efa369eb787b2e330b2b368d2afafba4aae9: Status 404 returned error can't find the container with id 8d112cfd5dba00d1ff07e3ec8684efa369eb787b2e330b2b368d2afafba4aae9 Jun 09 14:37:03.832845 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:03.832661 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83d0a1b_2ab5_4528_a09e_955b4183b138.slice/crio-50b13b00c5bdefb581f2fa68c85d36891719a56e09f2dd0e8d31200e9c9ccbf9 WatchSource:0}: Error finding container 50b13b00c5bdefb581f2fa68c85d36891719a56e09f2dd0e8d31200e9c9ccbf9: Status 404 returned error can't find the container with id 50b13b00c5bdefb581f2fa68c85d36891719a56e09f2dd0e8d31200e9c9ccbf9 Jun 09 14:37:03.834143 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:03.834000 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f7ab4e_6e36_4c50_ba47_a63d198f2702.slice/crio-48178c0b055651e2576aeffcaa9ea1e93f20a256f2e51fb73549cff1ede2b035 WatchSource:0}: Error finding container 48178c0b055651e2576aeffcaa9ea1e93f20a256f2e51fb73549cff1ede2b035: Status 404 returned error can't find the container with id 48178c0b055651e2576aeffcaa9ea1e93f20a256f2e51fb73549cff1ede2b035 Jun 09 14:37:04.033557 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.033524 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:32:03 +0000 UTC" deadline="2027-12-28 03:55:16.654585091 +0000 UTC" Jun 09 14:37:04.033557 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.033553 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13597h18m12.621036021s" Jun 09 14:37:04.048001 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.047976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:04.048141 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:04.048085 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:04.058750 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.058715 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal" event={"ID":"0d639eee1bcbf75688fbff254b7fc992","Type":"ContainerStarted","Data":"b2f46a802ccfc61a41e579cda08b3081bc2609224fbc1c43be0671f4ca6a204f"} Jun 09 14:37:04.060988 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.060958 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-24znr" event={"ID":"a83d0a1b-2ab5-4528-a09e-955b4183b138","Type":"ContainerStarted","Data":"50b13b00c5bdefb581f2fa68c85d36891719a56e09f2dd0e8d31200e9c9ccbf9"} Jun 09 14:37:04.062614 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.062580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" event={"ID":"49a7a6e2-4aff-4c85-be90-cc555bc25dcd","Type":"ContainerStarted","Data":"db16911dd23fddaa31cf7f45cee8d8656031cbbab7d1d234bb1356ede8688c47"} Jun 09 14:37:04.063620 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.063596 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dxq5z" event={"ID":"8f91e9a1-398c-4559-970c-a1bba6ce235a","Type":"ContainerStarted","Data":"2e5abc78cc04cc18678efb3120c1c1c7d3f6b51f113300df907bee98e40919ab"} Jun 09 14:37:04.064699 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.064673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jchds" event={"ID":"d06cfa11-043c-4afd-9b11-bae1f0dd4de8","Type":"ContainerStarted","Data":"39c644fd639ef6c06565059bdb6e999c4886ba8f1866bc88a274a19552b38c0c"} Jun 09 14:37:04.065654 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.065631 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sz6h7" event={"ID":"92f7ab4e-6e36-4c50-ba47-a63d198f2702","Type":"ContainerStarted","Data":"48178c0b055651e2576aeffcaa9ea1e93f20a256f2e51fb73549cff1ede2b035"} Jun 09 14:37:04.067217 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.067194 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pst7d" event={"ID":"3cc83194-ffab-4024-8d32-b19fc6982744","Type":"ContainerStarted","Data":"8d112cfd5dba00d1ff07e3ec8684efa369eb787b2e330b2b368d2afafba4aae9"} Jun 09 14:37:04.068655 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.068622 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" event={"ID":"c5db6a45-6f92-4e00-876c-bb54048f68b3","Type":"ContainerStarted","Data":"d985bc2de84a1083f441991aa02a4620c2edd7412018e56a3bcba0c232cfe4ab"} Jun 09 14:37:04.069908 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.069885 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" event={"ID":"606ac104-2982-46c8-8621-8042bf784934","Type":"ContainerStarted","Data":"d36365f17e853f1eed5bbd9aa2f1bdbee6b8d78e5a3bac90ac1a18660ecaae68"} Jun 09 14:37:04.071080 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.071055 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kjwbp" event={"ID":"be0f1949-d70d-44c6-abf9-5904c7ebc750","Type":"ContainerStarted","Data":"f90cd8487e20061796eb730df431b4b46dab0df5593c0dae94e8001b4fc53988"} Jun 09 14:37:04.623143 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.622520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:04.623143 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:04.622717 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:04.623143 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:04.622780 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs podName:cf3a7d28-6504-46ae-b4d2-0a45e236a5ee nodeName:}" failed. No retries permitted until 2026-06-09 14:37:06.622762583 +0000 UTC m=+5.975842387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs") pod "network-metrics-daemon-pzrj2" (UID: "cf3a7d28-6504-46ae-b4d2-0a45e236a5ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:04.723444 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.723391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:04.723622 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:04.723529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlqr\" (UniqueName: \"kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr\") pod \"network-check-target-lnq5t\" (UID: \"2b18e13b-bfe8-4523-abab-848e763d1e85\") " pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:04.724352 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:04.723695 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:04.724352 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:04.723718 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:04.724352 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:04.723731 2577 projected.go:196] Error preparing data for projected volume kube-api-access-2dlqr for pod openshift-network-diagnostics/network-check-target-lnq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:04.724352 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:04.723789 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr podName:2b18e13b-bfe8-4523-abab-848e763d1e85 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:06.723769992 +0000 UTC m=+6.076849790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dlqr" (UniqueName: "kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr") pod "network-check-target-lnq5t" (UID: "2b18e13b-bfe8-4523-abab-848e763d1e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:04.724352 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:04.724226 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:04.724352 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:04.724276 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret podName:50a4eea7-0255-4698-b270-2683097068de nodeName:}" failed. No retries permitted until 2026-06-09 14:37:06.724261758 +0000 UTC m=+6.077341560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret") pod "global-pull-secret-syncer-x6jb7" (UID: "50a4eea7-0255-4698-b270-2683097068de") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:05.033977 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:05.033851 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:32:03 +0000 UTC" deadline="2028-02-09 05:01:12.215060292 +0000 UTC" Jun 09 14:37:05.033977 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:05.033919 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14630h24m7.181146101s" Jun 09 14:37:05.050085 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:05.050058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:05.050232 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:05.050193 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:05.050593 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:05.050573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:05.050686 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:05.050668 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:05.090060 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:05.090031 2577 generic.go:356] "Generic (PLEG): container finished" podID="5e6c03ff4791518cefd5e0d8ce17e297" containerID="a2203025fa31152116f737d884190e1c279cdae438883844efa021e646825e27" exitCode=0 Jun 09 14:37:05.090783 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:05.090540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" event={"ID":"5e6c03ff4791518cefd5e0d8ce17e297","Type":"ContainerDied","Data":"a2203025fa31152116f737d884190e1c279cdae438883844efa021e646825e27"} Jun 09 14:37:05.109492 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:05.109437 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-219.ec2.internal" podStartSLOduration=3.109417782 podStartE2EDuration="3.109417782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:04.073535421 +0000 UTC m=+3.426615236" watchObservedRunningTime="2026-06-09 14:37:05.109417782 +0000 UTC m=+4.462497596" Jun 09 14:37:06.047263 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:06.047233 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:06.047725 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:06.047370 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:06.115268 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:06.115233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" event={"ID":"5e6c03ff4791518cefd5e0d8ce17e297","Type":"ContainerStarted","Data":"4a1418e220fcfaf3aa2825028ece768657def31a5c275025c974679b227043b5"} Jun 09 14:37:06.640448 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:06.640410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:06.640631 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:06.640570 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:06.640631 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:06.640628 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs podName:cf3a7d28-6504-46ae-b4d2-0a45e236a5ee nodeName:}" failed. No retries permitted until 2026-06-09 14:37:10.640612116 +0000 UTC m=+9.993691918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs") pod "network-metrics-daemon-pzrj2" (UID: "cf3a7d28-6504-46ae-b4d2-0a45e236a5ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:06.743545 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:06.741694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlqr\" (UniqueName: \"kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr\") pod \"network-check-target-lnq5t\" (UID: \"2b18e13b-bfe8-4523-abab-848e763d1e85\") " pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:06.743545 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:06.741762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:06.743545 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:06.741895 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:06.743545 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:06.741971 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret podName:50a4eea7-0255-4698-b270-2683097068de nodeName:}" failed. No retries permitted until 2026-06-09 14:37:10.741954004 +0000 UTC m=+10.095033803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret") pod "global-pull-secret-syncer-x6jb7" (UID: "50a4eea7-0255-4698-b270-2683097068de") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:06.743545 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:06.742380 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:06.743545 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:06.742398 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:06.743545 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:06.742412 2577 projected.go:196] Error preparing data for projected volume kube-api-access-2dlqr for pod openshift-network-diagnostics/network-check-target-lnq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:06.743545 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:06.742455 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr podName:2b18e13b-bfe8-4523-abab-848e763d1e85 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:10.742438767 +0000 UTC m=+10.095518578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dlqr" (UniqueName: "kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr") pod "network-check-target-lnq5t" (UID: "2b18e13b-bfe8-4523-abab-848e763d1e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:07.047818 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:07.047736 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:07.048237 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:07.047871 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:07.048237 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:07.047955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:07.048237 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:07.048106 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:08.047906 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:08.047864 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:08.048398 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:08.048027 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:09.048211 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:09.048179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:09.048609 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:09.048316 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:09.048609 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:09.048420 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:09.048609 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:09.048311 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:10.047942 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:10.047825 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:10.048148 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:10.048004 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:10.677337 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:10.677269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:10.677775 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:10.677411 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:10.677775 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:10.677471 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs podName:cf3a7d28-6504-46ae-b4d2-0a45e236a5ee nodeName:}" failed. No retries permitted until 2026-06-09 14:37:18.677456124 +0000 UTC m=+18.030535920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs") pod "network-metrics-daemon-pzrj2" (UID: "cf3a7d28-6504-46ae-b4d2-0a45e236a5ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:10.777847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:10.777813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:10.778044 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:10.777903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlqr\" (UniqueName: \"kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr\") pod \"network-check-target-lnq5t\" (UID: \"2b18e13b-bfe8-4523-abab-848e763d1e85\") " pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:10.778044 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:10.778024 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:10.778157 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:10.778062 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:10.778157 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:10.778081 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:10.778157 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:10.778093 2577 projected.go:196] Error preparing data for projected volume kube-api-access-2dlqr for pod openshift-network-diagnostics/network-check-target-lnq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:10.778157 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:10.778100 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret podName:50a4eea7-0255-4698-b270-2683097068de nodeName:}" failed. No retries permitted until 2026-06-09 14:37:18.77807789 +0000 UTC m=+18.131157711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret") pod "global-pull-secret-syncer-x6jb7" (UID: "50a4eea7-0255-4698-b270-2683097068de") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:10.778157 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:10.778143 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr podName:2b18e13b-bfe8-4523-abab-848e763d1e85 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:18.778124945 +0000 UTC m=+18.131204763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dlqr" (UniqueName: "kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr") pod "network-check-target-lnq5t" (UID: "2b18e13b-bfe8-4523-abab-848e763d1e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:11.050016 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:11.049742 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:11.050016 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:11.049960 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:11.050251 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:11.050047 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:11.050251 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:11.050147 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:12.047728 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:12.047693 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:12.048190 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:12.047828 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:13.048432 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:13.047971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:13.048432 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:13.047971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:13.048432 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:13.048088 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:13.048432 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:13.048218 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:14.047858 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:14.047827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:14.048050 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:14.047971 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:15.047404 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:15.047372 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:15.047860 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:15.047504 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:15.047860 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:15.047552 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:15.047860 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:15.047643 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:16.047593 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:16.047550 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:16.048039 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:16.047677 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:17.047706 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:17.047663 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:17.048197 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:17.047798 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:17.048197 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:17.047833 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:17.048197 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:17.047945 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:18.047946 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:18.047900 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:18.048392 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:18.048040 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:18.738549 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:18.738514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:18.738786 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:18.738675 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:18.738786 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:18.738742 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs podName:cf3a7d28-6504-46ae-b4d2-0a45e236a5ee nodeName:}" failed. No retries permitted until 2026-06-09 14:37:34.738722059 +0000 UTC m=+34.091801856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs") pod "network-metrics-daemon-pzrj2" (UID: "cf3a7d28-6504-46ae-b4d2-0a45e236a5ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:18.839448 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:18.839413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:18.839627 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:18.839586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlqr\" (UniqueName: \"kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr\") pod \"network-check-target-lnq5t\" (UID: \"2b18e13b-bfe8-4523-abab-848e763d1e85\") " pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:18.839677 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:18.839586 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:18.839677 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:18.839657 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:18.839770 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:18.839682 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:18.839770 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:18.839693 2577 projected.go:196] Error preparing data for projected volume kube-api-access-2dlqr for pod openshift-network-diagnostics/network-check-target-lnq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:18.839770 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:18.839703 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret podName:50a4eea7-0255-4698-b270-2683097068de nodeName:}" failed. No retries permitted until 2026-06-09 14:37:34.839685499 +0000 UTC m=+34.192765298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret") pod "global-pull-secret-syncer-x6jb7" (UID: "50a4eea7-0255-4698-b270-2683097068de") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:18.839770 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:18.839746 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr podName:2b18e13b-bfe8-4523-abab-848e763d1e85 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:34.839729291 +0000 UTC m=+34.192809106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dlqr" (UniqueName: "kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr") pod "network-check-target-lnq5t" (UID: "2b18e13b-bfe8-4523-abab-848e763d1e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:19.047050 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:19.046967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:19.047220 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:19.047091 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:19.047220 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:19.047133 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:19.047322 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:19.047241 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:20.047216 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:20.047183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:20.047696 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:20.047309 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:21.048722 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:21.048690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:21.049218 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:21.048812 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:21.049218 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:21.048850 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:21.049218 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:21.048961 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:22.047941 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:22.047893 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:22.048121 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:22.048032 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:23.047457 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.047434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:23.048263 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:23.047547 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:23.048263 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.047690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:23.048263 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:23.047776 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:23.146361 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.146311 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sz6h7" event={"ID":"92f7ab4e-6e36-4c50-ba47-a63d198f2702","Type":"ContainerStarted","Data":"afea9919c357baadbce251765e106aa3e8d52f43a4f2d486cd03e1c7a565ee0c"} Jun 09 14:37:23.147851 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.147826 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5db6a45-6f92-4e00-876c-bb54048f68b3" containerID="08b1ea36d99cf1b0aa80fa36f9dcfb1c6ad75683308eae6fcd327717abe197d6" exitCode=0 Jun 09 14:37:23.148008 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.147908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" event={"ID":"c5db6a45-6f92-4e00-876c-bb54048f68b3","Type":"ContainerDied","Data":"08b1ea36d99cf1b0aa80fa36f9dcfb1c6ad75683308eae6fcd327717abe197d6"} Jun 09 14:37:23.150531 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.150448 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" event={"ID":"606ac104-2982-46c8-8621-8042bf784934","Type":"ContainerStarted","Data":"88e227bc092f36b0de6fbd2937c96d855c63391709b30109d93d330676a2f0b4"} Jun 09 14:37:23.152526 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.152499 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kjwbp" event={"ID":"be0f1949-d70d-44c6-abf9-5904c7ebc750","Type":"ContainerStarted","Data":"77ff8086e0a33de5d82d61af4aae0e6d2fcd58eb48f3b90ad966effe3f1f6a65"} Jun 09 14:37:23.154563 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.154529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-24znr" event={"ID":"a83d0a1b-2ab5-4528-a09e-955b4183b138","Type":"ContainerStarted","Data":"727a222bbc7f1e0d548363f3e91b16e264485d367e0a5e910f279caeb51f42ff"} Jun 09 14:37:23.156261 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.156240 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" event={"ID":"49a7a6e2-4aff-4c85-be90-cc555bc25dcd","Type":"ContainerStarted","Data":"c3f0d4ce1e98e3dddf5f94794eac70804cef50a6b9c576678b66cda004478e12"} Jun 09 14:37:23.158066 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.158016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dxq5z" event={"ID":"8f91e9a1-398c-4559-970c-a1bba6ce235a","Type":"ContainerStarted","Data":"a61ef8a7e45a9b68f273c161f9a135837b427220250023a30f8c0c8de9b25427"} Jun 09 14:37:23.159270 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.159252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jchds" event={"ID":"d06cfa11-043c-4afd-9b11-bae1f0dd4de8","Type":"ContainerStarted","Data":"63415019b4bb7f28821f4855f4a911a77027e4ceca3e213c338439984b363c05"} Jun 09 14:37:23.173199 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.173161 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sz6h7" podStartSLOduration=3.183987702 podStartE2EDuration="22.173146965s" totalImagesPullingTime="18.989159263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:23.173144125 +0000 UTC m=+22.526223943" watchObservedRunningTime="2026-06-09 14:37:23.173146965 +0000 UTC m=+22.526226821" Jun 09 14:37:23.173324 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.173250 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-219.ec2.internal" podStartSLOduration=21.173239125 podStartE2EDuration="21.173239125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:06.131464222 +0000 UTC m=+5.484544051" watchObservedRunningTime="2026-06-09 14:37:23.173239125 +0000 UTC m=+22.526318944" Jun 09 14:37:23.205586 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.205482 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dxq5z" podStartSLOduration=3.212967563 podStartE2EDuration="22.20546631s" totalImagesPullingTime="18.992498747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:23.205098546 +0000 UTC m=+22.558178364" watchObservedRunningTime="2026-06-09 14:37:23.20546631 +0000 UTC m=+22.558546125" Jun 09 14:37:23.250887 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.250846 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kjwbp" podStartSLOduration=3.226703771 podStartE2EDuration="22.2508299s" totalImagesPullingTime="19.024126129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:23.25059989 +0000 UTC m=+22.603679708" watchObservedRunningTime="2026-06-09 14:37:23.2508299 +0000 UTC m=+22.603909729" Jun 09 14:37:23.364201 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:23.364147 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-24znr" podStartSLOduration=3.372479241 podStartE2EDuration="22.364126248s" totalImagesPullingTime="18.991647007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:23.331567079 +0000 UTC m=+22.684646896" watchObservedRunningTime="2026-06-09 14:37:23.364126248 +0000 UTC m=+22.717206071" Jun 09 14:37:24.047310 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:24.047136 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:24.047462 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:24.047435 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:24.075990 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:24.075967 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 14:37:24.165835 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:24.165753 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" event={"ID":"49a7a6e2-4aff-4c85-be90-cc555bc25dcd","Type":"ContainerStarted","Data":"00c943061e1531c0545ccbd1f1f1516879358c2785933f8c1974f344042c2167"} Jun 09 14:37:24.169095 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:24.169069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" event={"ID":"606ac104-2982-46c8-8621-8042bf784934","Type":"ContainerStarted","Data":"1c11718b35dc783ffa8477161f2560d7ad79e75944f48aab0e731d6973fd9694"} Jun 09 14:37:24.169223 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:24.169146 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" event={"ID":"606ac104-2982-46c8-8621-8042bf784934","Type":"ContainerStarted","Data":"70e367a5fa105bf7ddee07cca7514fbd8a41d34a2ba987494858650c06a2851c"} Jun 09 14:37:24.169223 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:24.169196 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" event={"ID":"606ac104-2982-46c8-8621-8042bf784934","Type":"ContainerStarted","Data":"2b5f41d20aeb242ff694fd0be947cda6797d9d5f4f5c5d3aa1d88b31c6cd1798"} Jun 09 14:37:24.169339 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:24.169243 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" event={"ID":"606ac104-2982-46c8-8621-8042bf784934","Type":"ContainerStarted","Data":"dbccb2d0aa9c0ebde62141229609d581e26af82751270926d27e5c58de82cf8a"} Jun 09 14:37:24.169339 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:24.169292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" event={"ID":"606ac104-2982-46c8-8621-8042bf784934","Type":"ContainerStarted","Data":"80c8941e0f14eb380ddf19020019e288e8f84c4bfe4c2ccc10147e115031fac7"} Jun 09 14:37:25.047512 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:25.047479 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:25.048222 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:25.047602 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:25.048222 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:25.047485 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:25.048222 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:25.048007 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:25.050322 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:25.050243 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T14:37:24.075986081Z","UUID":"211556a9-e569-477f-85ab-a42950e9129d","Handler":null,"Name":"","Endpoint":""} Jun 09 14:37:25.051916 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:25.051899 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 14:37:25.052012 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:25.051950 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 14:37:25.172524 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:25.172489 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pst7d" event={"ID":"3cc83194-ffab-4024-8d32-b19fc6982744","Type":"ContainerStarted","Data":"849bbe73b11c565460e6aa671ecb2e2613cbca5b03d49a78469617761223a325"} Jun 09 14:37:25.191393 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:25.191347 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pst7d" podStartSLOduration=5.200392281 podStartE2EDuration="24.191333837s" totalImagesPullingTime="18.990941556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:25.191140904 +0000 UTC m=+24.544220802" watchObservedRunningTime="2026-06-09 14:37:25.191333837 +0000 UTC m=+24.544413675" Jun 09 14:37:25.191640 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:25.191613 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jchds" podStartSLOduration=9.880335956 podStartE2EDuration="24.191605033s" totalImagesPullingTime="14.311269077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:23.364293348 +0000 UTC m=+22.717373158" watchObservedRunningTime="2026-06-09 14:37:25.191605033 +0000 UTC m=+24.544684851" Jun 09 14:37:26.047474 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:26.047444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:26.047653 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:26.047558 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:26.177585 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:26.177551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" event={"ID":"49a7a6e2-4aff-4c85-be90-cc555bc25dcd","Type":"ContainerStarted","Data":"bae07ad8054b94e51522fea822be18a3a4ddd8ef60bd4b3acef68194a926c4ca"} Jun 09 14:37:26.482354 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:26.482316 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:26.483185 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:26.483163 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:26.511039 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:26.510988 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pts8j" podStartSLOduration=4.4493709599999995 podStartE2EDuration="25.510967342s" totalImagesPullingTime="21.061596382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:26.218293151 +0000 UTC m=+25.571372965" watchObservedRunningTime="2026-06-09 14:37:26.510967342 +0000 UTC m=+25.864047164" Jun 09 14:37:27.047648 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:27.047622 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:27.047739 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:27.047720 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:27.047967 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:27.047789 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:27.047967 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:27.047862 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:27.183344 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:27.183310 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" event={"ID":"606ac104-2982-46c8-8621-8042bf784934","Type":"ContainerStarted","Data":"feed831ce1beeb7a90428e3682be2d363de408fddc5b1b53eb647e15d2fc2dc4"} Jun 09 14:37:27.183539 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:27.183522 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:27.184262 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:27.184242 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jchds" Jun 09 14:37:28.046973 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:28.046949 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:28.047210 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:28.047044 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:28.187496 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:28.187458 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5db6a45-6f92-4e00-876c-bb54048f68b3" containerID="b558474f5e204f5c383afa71ee396dd8718cd4919fa625f3f7b42b20fb3ab08e" exitCode=0 Jun 09 14:37:28.187985 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:28.187540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" event={"ID":"c5db6a45-6f92-4e00-876c-bb54048f68b3","Type":"ContainerDied","Data":"b558474f5e204f5c383afa71ee396dd8718cd4919fa625f3f7b42b20fb3ab08e"} Jun 09 14:37:29.047804 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:29.047607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:29.048013 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:29.047676 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:29.048013 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:29.047899 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:29.048013 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:29.047990 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:30.047264 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:30.047227 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:30.047721 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:30.047342 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:30.194034 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:30.193994 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5db6a45-6f92-4e00-876c-bb54048f68b3" containerID="619532aafb94f4c65985afe71a69b1d53100fdb877ba79013492d1df0013fb21" exitCode=0 Jun 09 14:37:30.194259 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:30.194076 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" event={"ID":"c5db6a45-6f92-4e00-876c-bb54048f68b3","Type":"ContainerDied","Data":"619532aafb94f4c65985afe71a69b1d53100fdb877ba79013492d1df0013fb21"} Jun 09 14:37:30.200281 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:30.200247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" event={"ID":"606ac104-2982-46c8-8621-8042bf784934","Type":"ContainerStarted","Data":"9a2e65b37d9eefcc56517872dd7f3109d8adf7bae45f1431e7a36ca0dd1e8dcd"} Jun 09 14:37:30.200510 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:30.200492 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:30.200576 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:30.200557 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:30.215451 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:30.215431 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:30.259597 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:30.259556 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" podStartSLOduration=10.139288637 podStartE2EDuration="29.259540874s" totalImagesPullingTime="19.120252237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:30.258112414 +0000 UTC m=+29.611192232" watchObservedRunningTime="2026-06-09 14:37:30.259540874 +0000 UTC m=+29.612620683" Jun 09 14:37:31.047844 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.047818 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:31.048291 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.047942 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:31.048291 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:31.047940 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:31.048291 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:31.048046 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:31.206631 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.206422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" event={"ID":"c5db6a45-6f92-4e00-876c-bb54048f68b3","Type":"ContainerStarted","Data":"3317816244dabf5bdf3ac1f71096aebf76591c892c3ee0ae27caaf772454189d"} Jun 09 14:37:31.206813 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.206797 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:31.224286 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.224252 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:37:31.414655 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.414608 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lnq5t"] Jun 09 14:37:31.414837 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.414789 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:31.415040 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:31.414905 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:31.418950 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.418901 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x6jb7"] Jun 09 14:37:31.419085 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.419041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:31.419149 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:31.419134 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:31.419757 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.419731 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pzrj2"] Jun 09 14:37:31.419847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:31.419839 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:31.420097 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:31.419960 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:32.211711 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:32.211681 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5db6a45-6f92-4e00-876c-bb54048f68b3" containerID="3317816244dabf5bdf3ac1f71096aebf76591c892c3ee0ae27caaf772454189d" exitCode=0 Jun 09 14:37:32.212624 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:32.211776 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" event={"ID":"c5db6a45-6f92-4e00-876c-bb54048f68b3","Type":"ContainerDied","Data":"3317816244dabf5bdf3ac1f71096aebf76591c892c3ee0ae27caaf772454189d"} Jun 09 14:37:33.047970 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:33.047920 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:33.048163 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:33.047942 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:33.048163 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:33.047920 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:33.048163 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:33.048070 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:33.048163 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:33.048121 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:33.048325 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:33.048217 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:34.766087 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:34.766051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:34.766541 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:34.766238 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:34.766541 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:34.766318 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs podName:cf3a7d28-6504-46ae-b4d2-0a45e236a5ee nodeName:}" failed. No retries permitted until 2026-06-09 14:38:06.766298635 +0000 UTC m=+66.119378438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs") pod "network-metrics-daemon-pzrj2" (UID: "cf3a7d28-6504-46ae-b4d2-0a45e236a5ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:37:34.866870 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:34.866832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlqr\" (UniqueName: \"kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr\") pod \"network-check-target-lnq5t\" (UID: \"2b18e13b-bfe8-4523-abab-848e763d1e85\") " pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:34.867096 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:34.866901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:34.867096 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:34.867026 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:34.867096 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:34.867035 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:37:34.867096 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:34.867062 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:37:34.867096 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:34.867076 2577 projected.go:196] Error preparing data for projected volume kube-api-access-2dlqr for pod openshift-network-diagnostics/network-check-target-lnq5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:34.867289 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:34.867077 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret podName:50a4eea7-0255-4698-b270-2683097068de nodeName:}" failed. No retries permitted until 2026-06-09 14:38:06.867062852 +0000 UTC m=+66.220142652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret") pod "global-pull-secret-syncer-x6jb7" (UID: "50a4eea7-0255-4698-b270-2683097068de") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:37:34.867289 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:34.867139 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr podName:2b18e13b-bfe8-4523-abab-848e763d1e85 nodeName:}" failed. No retries permitted until 2026-06-09 14:38:06.867121834 +0000 UTC m=+66.220201637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2dlqr" (UniqueName: "kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr") pod "network-check-target-lnq5t" (UID: "2b18e13b-bfe8-4523-abab-848e763d1e85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:37:35.047859 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.047773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:35.047859 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.047810 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:35.048103 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.047777 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:35.048103 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:35.047899 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lnq5t" podUID="2b18e13b-bfe8-4523-abab-848e763d1e85" Jun 09 14:37:35.048103 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:35.048012 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:37:35.048218 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:35.048103 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6jb7" podUID="50a4eea7-0255-4698-b270-2683097068de" Jun 09 14:37:35.459987 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.459959 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-219.ec2.internal" event="NodeReady" Jun 09 14:37:35.460167 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.460111 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 14:37:35.509516 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.509478 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fj74q"] Jun 09 14:37:35.512239 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.512216 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4qclb"] Jun 09 14:37:35.512383 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.512334 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.514021 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.513993 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4qclb" Jun 09 14:37:35.514282 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.514256 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 14:37:35.514282 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.514276 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 14:37:35.514828 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.514652 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w2kzc\"" Jun 09 14:37:35.515703 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.515682 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 14:37:35.516112 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.515896 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 14:37:35.516112 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.515989 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 14:37:35.516430 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.516289 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cr592\"" Jun 09 14:37:35.521093 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.521070 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4qclb"] Jun 09 14:37:35.525821 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.525800 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fj74q"] Jun 09 14:37:35.673043 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.672949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.673043 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.672991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzzcf\" (UniqueName: \"kubernetes.io/projected/f5014851-47c3-48a7-ac00-27e87fdbc4f2-kube-api-access-fzzcf\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.673043 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.673030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5014851-47c3-48a7-ac00-27e87fdbc4f2-tmp-dir\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.673291 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.673070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/202606ae-b23b-45fe-b767-adebf07d8cfb-cert\") pod \"ingress-canary-4qclb\" (UID: \"202606ae-b23b-45fe-b767-adebf07d8cfb\") " pod="openshift-ingress-canary/ingress-canary-4qclb" Jun 09 14:37:35.673291 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.673143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8hc9\" (UniqueName: \"kubernetes.io/projected/202606ae-b23b-45fe-b767-adebf07d8cfb-kube-api-access-f8hc9\") pod \"ingress-canary-4qclb\" (UID: \"202606ae-b23b-45fe-b767-adebf07d8cfb\") " pod="openshift-ingress-canary/ingress-canary-4qclb" Jun 09 14:37:35.673291 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.673197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f5014851-47c3-48a7-ac00-27e87fdbc4f2-config-volume\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.774318 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.774277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzzcf\" (UniqueName: \"kubernetes.io/projected/f5014851-47c3-48a7-ac00-27e87fdbc4f2-kube-api-access-fzzcf\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.774763 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.774349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5014851-47c3-48a7-ac00-27e87fdbc4f2-tmp-dir\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.774763 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.774394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/202606ae-b23b-45fe-b767-adebf07d8cfb-cert\") pod \"ingress-canary-4qclb\" (UID: \"202606ae-b23b-45fe-b767-adebf07d8cfb\") " pod="openshift-ingress-canary/ingress-canary-4qclb" Jun 09 14:37:35.774763 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.774431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hc9\" (UniqueName: \"kubernetes.io/projected/202606ae-b23b-45fe-b767-adebf07d8cfb-kube-api-access-f8hc9\") pod \"ingress-canary-4qclb\" (UID: \"202606ae-b23b-45fe-b767-adebf07d8cfb\") " pod="openshift-ingress-canary/ingress-canary-4qclb" Jun 09 14:37:35.774763 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.774464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f5014851-47c3-48a7-ac00-27e87fdbc4f2-config-volume\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.774763 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.774516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.774763 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:35.774620 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:35.774763 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:35.774676 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls podName:f5014851-47c3-48a7-ac00-27e87fdbc4f2 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:36.274655436 +0000 UTC m=+35.627735238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls") pod "dns-default-fj74q" (UID: "f5014851-47c3-48a7-ac00-27e87fdbc4f2") : secret "dns-default-metrics-tls" not found Jun 09 14:37:35.775124 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.774778 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5014851-47c3-48a7-ac00-27e87fdbc4f2-tmp-dir\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.775176 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.775154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f5014851-47c3-48a7-ac00-27e87fdbc4f2-config-volume\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.779181 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.779153 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/202606ae-b23b-45fe-b767-adebf07d8cfb-cert\") pod \"ingress-canary-4qclb\" (UID: \"202606ae-b23b-45fe-b767-adebf07d8cfb\") " pod="openshift-ingress-canary/ingress-canary-4qclb" Jun 09 14:37:35.783221 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.783175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzzcf\" (UniqueName: \"kubernetes.io/projected/f5014851-47c3-48a7-ac00-27e87fdbc4f2-kube-api-access-fzzcf\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:35.783532 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.783510 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8hc9\" (UniqueName: \"kubernetes.io/projected/202606ae-b23b-45fe-b767-adebf07d8cfb-kube-api-access-f8hc9\") pod \"ingress-canary-4qclb\" (UID: \"202606ae-b23b-45fe-b767-adebf07d8cfb\") " pod="openshift-ingress-canary/ingress-canary-4qclb" Jun 09 14:37:35.832526 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:35.832490 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4qclb" Jun 09 14:37:36.279588 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:36.279551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:36.279777 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:36.279716 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:36.279849 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:36.279791 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls podName:f5014851-47c3-48a7-ac00-27e87fdbc4f2 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:37.279769246 +0000 UTC m=+36.632849042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls") pod "dns-default-fj74q" (UID: "f5014851-47c3-48a7-ac00-27e87fdbc4f2") : secret "dns-default-metrics-tls" not found Jun 09 14:37:36.811503 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:36.811441 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4qclb"] Jun 09 14:37:36.816422 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:36.816393 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202606ae_b23b_45fe_b767_adebf07d8cfb.slice/crio-9e40ab38047363361da34ee663705d37c7d40136863f0caae860995b7b8a1bc3 WatchSource:0}: Error finding container 9e40ab38047363361da34ee663705d37c7d40136863f0caae860995b7b8a1bc3: Status 404 returned error can't find the container with id 9e40ab38047363361da34ee663705d37c7d40136863f0caae860995b7b8a1bc3 Jun 09 14:37:37.047458 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.047417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:37:37.047639 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.047426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:37:37.047639 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.047435 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:37:37.050993 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.050970 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 14:37:37.051728 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.051570 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 14:37:37.051728 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.051603 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ddm5r\"" Jun 09 14:37:37.051728 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.051605 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 14:37:37.051728 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.051639 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7n68j\"" Jun 09 14:37:37.051728 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.051650 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 14:37:37.229272 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.229178 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5db6a45-6f92-4e00-876c-bb54048f68b3" containerID="2bed0404e1da114963fdda01e54eea7d5f310565ddd073136bccc35a43376bb7" exitCode=0 Jun 09 14:37:37.229442 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.229258 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" event={"ID":"c5db6a45-6f92-4e00-876c-bb54048f68b3","Type":"ContainerDied","Data":"2bed0404e1da114963fdda01e54eea7d5f310565ddd073136bccc35a43376bb7"} Jun 09 14:37:37.230876 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.230811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4qclb" event={"ID":"202606ae-b23b-45fe-b767-adebf07d8cfb","Type":"ContainerStarted","Data":"9e40ab38047363361da34ee663705d37c7d40136863f0caae860995b7b8a1bc3"} Jun 09 14:37:37.288441 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.288205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:37.288626 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:37.288375 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:37.288626 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:37.288619 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls podName:f5014851-47c3-48a7-ac00-27e87fdbc4f2 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:39.288587102 +0000 UTC m=+38.641666908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls") pod "dns-default-fj74q" (UID: "f5014851-47c3-48a7-ac00-27e87fdbc4f2") : secret "dns-default-metrics-tls" not found Jun 09 14:37:37.506072 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.505978 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:37.615543 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:37.615510 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:38.056773 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:38.056736 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:38.148673 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:38.148632 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:38.237045 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:38.237010 2577 generic.go:356] "Generic (PLEG): container finished" podID="c5db6a45-6f92-4e00-876c-bb54048f68b3" containerID="0d82d14bd3818d91717c48348bcb29fc8e00b7a12507ff9ad261b0c6ad0df311" exitCode=0 Jun 09 14:37:38.237220 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:38.237059 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" event={"ID":"c5db6a45-6f92-4e00-876c-bb54048f68b3","Type":"ContainerDied","Data":"0d82d14bd3818d91717c48348bcb29fc8e00b7a12507ff9ad261b0c6ad0df311"} Jun 09 14:37:39.241242 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:39.241210 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4qclb" event={"ID":"202606ae-b23b-45fe-b767-adebf07d8cfb","Type":"ContainerStarted","Data":"745ff6a7155f0b0e6dd87b5917939b0a9a9bf0abff16f88e2206322e442f55b3"} Jun 09 14:37:39.246312 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:39.246283 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" event={"ID":"c5db6a45-6f92-4e00-876c-bb54048f68b3","Type":"ContainerStarted","Data":"f8245d4747a3dc31d9af4d3ceeba0630423204cfbeafcd3b91c598f692407086"} Jun 09 14:37:39.263572 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:39.263528 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4qclb" podStartSLOduration=2.770915426 podStartE2EDuration="4.263512621s" totalImagesPullingTime="1.492597195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:39.262789527 +0000 UTC m=+38.615869360" watchObservedRunningTime="2026-06-09 14:37:39.263512621 +0000 UTC m=+38.616592416" Jun 09 14:37:39.284320 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:39.284270 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pxbx4" podStartSLOduration=8.98140156 podStartE2EDuration="38.284237549s" totalImagesPullingTime="29.302835989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:39.284163753 +0000 UTC m=+38.637243572" watchObservedRunningTime="2026-06-09 14:37:39.284237549 +0000 UTC m=+38.637317367" Jun 09 14:37:39.304676 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:39.304620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:39.304841 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:39.304722 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:39.304841 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:39.304776 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls podName:f5014851-47c3-48a7-ac00-27e87fdbc4f2 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:43.304759236 +0000 UTC m=+42.657839038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls") pod "dns-default-fj74q" (UID: "f5014851-47c3-48a7-ac00-27e87fdbc4f2") : secret "dns-default-metrics-tls" not found Jun 09 14:37:39.407030 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:39.406983 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:39.521575 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:39.521456 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:39.613518 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:39.613485 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:41.056067 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:41.056032 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:41.158150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:41.158093 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:43.333841 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:43.333802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:43.334219 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:43.333980 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:43.334219 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:43.334060 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls podName:f5014851-47c3-48a7-ac00-27e87fdbc4f2 nodeName:}" failed. No retries permitted until 2026-06-09 14:37:51.334043176 +0000 UTC m=+50.687122972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls") pod "dns-default-fj74q" (UID: "f5014851-47c3-48a7-ac00-27e87fdbc4f2") : secret "dns-default-metrics-tls" not found Jun 09 14:37:45.348456 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:45.348418 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:45.468524 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:45.468475 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:46.712786 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:46.712756 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:46.850632 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:46.850599 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:47.325816 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.325784 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s"] Jun 09 14:37:47.347252 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.347226 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" Jun 09 14:37:47.351668 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.351646 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s"] Jun 09 14:37:47.354234 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.354049 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 14:37:47.354234 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.354125 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 14:37:47.357199 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.357180 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 14:37:47.357436 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.357423 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 14:37:47.363653 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.363633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c06a58c-4978-4f89-b1c5-4182f439250c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s\" (UID: \"4c06a58c-4978-4f89-b1c5-4182f439250c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" Jun 09 14:37:47.363729 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.363663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p9bp\" (UniqueName: \"kubernetes.io/projected/4c06a58c-4978-4f89-b1c5-4182f439250c-kube-api-access-4p9bp\") pod \"managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s\" (UID: \"4c06a58c-4978-4f89-b1c5-4182f439250c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" Jun 09 14:37:47.364127 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.364111 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb"] Jun 09 14:37:47.366218 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.366201 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qzfvp\"" Jun 09 14:37:47.377085 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.377064 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.407424 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.407400 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 14:37:47.407676 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.407661 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 14:37:47.408192 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.408179 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 14:37:47.408969 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.408953 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 14:37:47.417546 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.417526 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb"] Jun 09 14:37:47.464734 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.464712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-ca\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.464847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.464741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/03689f3e-f249-42c0-b316-55dc3edf24f5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.464847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.464759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-hub\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.464847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.464803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c06a58c-4978-4f89-b1c5-4182f439250c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s\" (UID: \"4c06a58c-4978-4f89-b1c5-4182f439250c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" Jun 09 14:37:47.464847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.464831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p9bp\" (UniqueName: \"kubernetes.io/projected/4c06a58c-4978-4f89-b1c5-4182f439250c-kube-api-access-4p9bp\") pod \"managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s\" (UID: \"4c06a58c-4978-4f89-b1c5-4182f439250c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" Jun 09 14:37:47.465017 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.464875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.465017 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.464901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.465017 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.464920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qzqb\" (UniqueName: \"kubernetes.io/projected/03689f3e-f249-42c0-b316-55dc3edf24f5-kube-api-access-5qzqb\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.468501 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.468484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c06a58c-4978-4f89-b1c5-4182f439250c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s\" (UID: \"4c06a58c-4978-4f89-b1c5-4182f439250c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" Jun 09 14:37:47.476273 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.476248 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p9bp\" (UniqueName: \"kubernetes.io/projected/4c06a58c-4978-4f89-b1c5-4182f439250c-kube-api-access-4p9bp\") pod \"managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s\" (UID: \"4c06a58c-4978-4f89-b1c5-4182f439250c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" Jun 09 14:37:47.565608 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.565572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-ca\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.565608 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.565610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/03689f3e-f249-42c0-b316-55dc3edf24f5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.565824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.565631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-hub\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.565824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.565674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.565824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.565704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.565824 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.565720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qzqb\" (UniqueName: \"kubernetes.io/projected/03689f3e-f249-42c0-b316-55dc3edf24f5-kube-api-access-5qzqb\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.566348 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.566321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/03689f3e-f249-42c0-b316-55dc3edf24f5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.568240 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.568215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.568474 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.568452 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.568527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.568508 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-ca\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.568588 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.568573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/03689f3e-f249-42c0-b316-55dc3edf24f5-hub\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.583378 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.583326 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qzqb\" (UniqueName: \"kubernetes.io/projected/03689f3e-f249-42c0-b316-55dc3edf24f5-kube-api-access-5qzqb\") pod \"cluster-proxy-proxy-agent-59d89f5ff5-bdnmb\" (UID: \"03689f3e-f249-42c0-b316-55dc3edf24f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.672525 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.672487 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" Jun 09 14:37:47.684671 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.684647 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:37:47.829294 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.829239 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s"] Jun 09 14:37:47.852153 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:47.852126 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb"] Jun 09 14:37:47.855399 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:37:47.855375 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03689f3e_f249_42c0_b316_55dc3edf24f5.slice/crio-2d6eedc9c24172c0dffc2c67c6a40c9eaa7cb142b22e2ea89e821597db58ed14 WatchSource:0}: Error finding container 2d6eedc9c24172c0dffc2c67c6a40c9eaa7cb142b22e2ea89e821597db58ed14: Status 404 returned error can't find the container with id 2d6eedc9c24172c0dffc2c67c6a40c9eaa7cb142b22e2ea89e821597db58ed14 Jun 09 14:37:48.267447 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:48.267409 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" event={"ID":"03689f3e-f249-42c0-b316-55dc3edf24f5","Type":"ContainerStarted","Data":"2d6eedc9c24172c0dffc2c67c6a40c9eaa7cb142b22e2ea89e821597db58ed14"} Jun 09 14:37:48.268494 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:48.268470 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" event={"ID":"4c06a58c-4978-4f89-b1c5-4182f439250c","Type":"ContainerStarted","Data":"2ced62140a475b56f8b2b9821901397734b4537b7dbb916945116b4d4c482ccf"} Jun 09 14:37:49.090488 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:49.090406 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:49.228539 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:49.228502 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:51.400812 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:51.400773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:37:51.401316 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:51.400953 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:37:51.401316 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:37:51.401035 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls podName:f5014851-47c3-48a7-ac00-27e87fdbc4f2 nodeName:}" failed. No retries permitted until 2026-06-09 14:38:07.40101843 +0000 UTC m=+66.754098226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls") pod "dns-default-fj74q" (UID: "f5014851-47c3-48a7-ac00-27e87fdbc4f2") : secret "dns-default-metrics-tls" not found Jun 09 14:37:53.282659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:53.282572 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" event={"ID":"4c06a58c-4978-4f89-b1c5-4182f439250c","Type":"ContainerStarted","Data":"3a2b7ad912bf94c20bf6e4c1e3212163d76721ec300ae46b149a8e3ccb7d41e9"} Jun 09 14:37:53.299303 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:53.299251 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" podStartSLOduration=1.140567983 podStartE2EDuration="6.299233261s" totalImagesPullingTime="5.158665278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:53.298748152 +0000 UTC m=+52.651827969" watchObservedRunningTime="2026-06-09 14:37:53.299233261 +0000 UTC m=+52.652313078" Jun 09 14:37:54.286826 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:54.286794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" event={"ID":"03689f3e-f249-42c0-b316-55dc3edf24f5","Type":"ContainerStarted","Data":"7ca71a9d8da6b58ace6c6c871d4527efc73cfe0e72d7c071c17bc3cd12459a24"} Jun 09 14:37:54.287218 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:54.286836 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" event={"ID":"03689f3e-f249-42c0-b316-55dc3edf24f5","Type":"ContainerStarted","Data":"98768bfcc5191761fd543c12e5b172019ea75d1ba0d01b3febe1261f7789ab48"} Jun 09 14:37:54.287218 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:54.286851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" event={"ID":"03689f3e-f249-42c0-b316-55dc3edf24f5","Type":"ContainerStarted","Data":"65263368b5dc6bd1d12c65ecaa04765ec7e0ed4d8086e7c1ff146c426fe154f3"} Jun 09 14:37:54.306566 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:54.306519 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" podStartSLOduration=1.7631347910000001 podStartE2EDuration="7.306502305s" totalImagesPullingTime="5.543367514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:37:54.305739174 +0000 UTC m=+53.658819014" watchObservedRunningTime="2026-06-09 14:37:54.306502305 +0000 UTC m=+53.659582122" Jun 09 14:37:59.402537 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:59.402500 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:37:59.494967 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:37:59.494914 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:38:03.225052 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:03.225023 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7n9h" Jun 09 14:38:03.376308 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:03.376272 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:38:03.441381 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:03.441351 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:38:06.815885 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:06.815834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:38:06.818485 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:06.818463 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 14:38:06.826504 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:38:06.826476 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 14:38:06.826601 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:38:06.826552 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs podName:cf3a7d28-6504-46ae-b4d2-0a45e236a5ee nodeName:}" failed. No retries permitted until 2026-06-09 14:39:10.826532749 +0000 UTC m=+130.179612545 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs") pod "network-metrics-daemon-pzrj2" (UID: "cf3a7d28-6504-46ae-b4d2-0a45e236a5ee") : secret "metrics-daemon-secret" not found Jun 09 14:38:06.917304 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:06.917260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlqr\" (UniqueName: \"kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr\") pod \"network-check-target-lnq5t\" (UID: \"2b18e13b-bfe8-4523-abab-848e763d1e85\") " pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:38:06.917483 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:06.917324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:38:06.920141 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:06.920121 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 14:38:06.921059 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:06.921041 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 14:38:06.929834 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:06.929810 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50a4eea7-0255-4698-b270-2683097068de-original-pull-secret\") pod \"global-pull-secret-syncer-x6jb7\" (UID: \"50a4eea7-0255-4698-b270-2683097068de\") " pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:38:06.931217 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:06.931198 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 14:38:06.940711 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:06.940686 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dlqr\" (UniqueName: \"kubernetes.io/projected/2b18e13b-bfe8-4523-abab-848e763d1e85-kube-api-access-2dlqr\") pod \"network-check-target-lnq5t\" (UID: \"2b18e13b-bfe8-4523-abab-848e763d1e85\") " pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:38:07.057206 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:07.057158 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6jb7" Jun 09 14:38:07.070785 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:07.070759 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ddm5r\"" Jun 09 14:38:07.078919 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:07.078894 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:38:07.202577 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:07.202496 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x6jb7"] Jun 09 14:38:07.205222 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:38:07.205195 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a4eea7_0255_4698_b270_2683097068de.slice/crio-4ca1c46d7b14a2c27d2921736130ccc37fbf073798443717abbe994adaa1b669 WatchSource:0}: Error finding container 4ca1c46d7b14a2c27d2921736130ccc37fbf073798443717abbe994adaa1b669: Status 404 returned error can't find the container with id 4ca1c46d7b14a2c27d2921736130ccc37fbf073798443717abbe994adaa1b669 Jun 09 14:38:07.222234 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:07.222192 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lnq5t"] Jun 09 14:38:07.225874 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:38:07.225846 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b18e13b_bfe8_4523_abab_848e763d1e85.slice/crio-0d9990808e313a6e22cdbfc4c85f5a2d72c242915cc15daafc4b06c4c4ac0b86 WatchSource:0}: Error finding container 0d9990808e313a6e22cdbfc4c85f5a2d72c242915cc15daafc4b06c4c4ac0b86: Status 404 returned error can't find the container with id 0d9990808e313a6e22cdbfc4c85f5a2d72c242915cc15daafc4b06c4c4ac0b86 Jun 09 14:38:07.318260 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:07.318164 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x6jb7" event={"ID":"50a4eea7-0255-4698-b270-2683097068de","Type":"ContainerStarted","Data":"4ca1c46d7b14a2c27d2921736130ccc37fbf073798443717abbe994adaa1b669"} Jun 09 14:38:07.319391 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:07.319354 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lnq5t" event={"ID":"2b18e13b-bfe8-4523-abab-848e763d1e85","Type":"ContainerStarted","Data":"0d9990808e313a6e22cdbfc4c85f5a2d72c242915cc15daafc4b06c4c4ac0b86"} Jun 09 14:38:07.423079 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:07.423041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:38:07.423254 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:38:07.423199 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:38:07.423299 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:38:07.423259 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls podName:f5014851-47c3-48a7-ac00-27e87fdbc4f2 nodeName:}" failed. No retries permitted until 2026-06-09 14:38:39.423243432 +0000 UTC m=+98.776323228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls") pod "dns-default-fj74q" (UID: "f5014851-47c3-48a7-ac00-27e87fdbc4f2") : secret "dns-default-metrics-tls" not found Jun 09 14:38:08.159108 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:08.159035 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:38:08.275519 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:08.275484 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:38:08.345416 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:08.345355 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:38:12.340120 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:12.340084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x6jb7" event={"ID":"50a4eea7-0255-4698-b270-2683097068de","Type":"ContainerStarted","Data":"122e053e8f96581b761383c4d0f9e051d233ad273a00411946405006adc9c35e"} Jun 09 14:38:12.341498 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:12.341476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lnq5t" event={"ID":"2b18e13b-bfe8-4523-abab-848e763d1e85","Type":"ContainerStarted","Data":"ed5c142c9deb9b32b9cd8cb851b598229f1d36841b0cd4a12cf0c3c15bd59a3a"} Jun 09 14:38:12.341629 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:12.341609 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:38:12.372565 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:12.372510 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x6jb7" podStartSLOduration=67.026533923 podStartE2EDuration="1m11.372490884s" totalImagesPullingTime="4.345956961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:38:12.356563354 +0000 UTC m=+71.709643173" watchObservedRunningTime="2026-06-09 14:38:12.372490884 +0000 UTC m=+71.725570699" Jun 09 14:38:12.373338 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:12.373299 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lnq5t" podStartSLOduration=67.051772503 podStartE2EDuration="1m11.373288169s" totalImagesPullingTime="4.321515666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:38:12.372977321 +0000 UTC m=+71.726057138" watchObservedRunningTime="2026-06-09 14:38:12.373288169 +0000 UTC m=+71.726367987" Jun 09 14:38:13.058602 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:13.058563 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:38:13.154730 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:13.154694 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:38:39.459259 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:39.459119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:38:39.459756 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:38:39.459292 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:38:39.459756 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:38:39.459365 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls podName:f5014851-47c3-48a7-ac00-27e87fdbc4f2 nodeName:}" failed. No retries permitted until 2026-06-09 14:39:43.459345439 +0000 UTC m=+162.812425241 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls") pod "dns-default-fj74q" (UID: "f5014851-47c3-48a7-ac00-27e87fdbc4f2") : secret "dns-default-metrics-tls" not found Jun 09 14:38:43.347687 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:38:43.347658 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lnq5t" Jun 09 14:39:10.871641 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:39:10.871602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:39:10.872163 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:39:10.871767 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 14:39:10.872163 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:39:10.871844 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs podName:cf3a7d28-6504-46ae-b4d2-0a45e236a5ee nodeName:}" failed. No retries permitted until 2026-06-09 14:41:12.871825753 +0000 UTC m=+252.224905549 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs") pod "network-metrics-daemon-pzrj2" (UID: "cf3a7d28-6504-46ae-b4d2-0a45e236a5ee") : secret "metrics-daemon-secret" not found Jun 09 14:39:38.526758 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:39:38.526711 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fj74q" podUID="f5014851-47c3-48a7-ac00-27e87fdbc4f2" Jun 09 14:39:38.587866 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:39:38.587840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fj74q" Jun 09 14:39:39.568659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:39:39.568615 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:39:40.063659 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:39:40.063597 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pzrj2" podUID="cf3a7d28-6504-46ae-b4d2-0a45e236a5ee" Jun 09 14:39:43.501299 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:39:43.501252 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:39:43.501798 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:39:43.501436 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:39:43.501798 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:39:43.501534 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls podName:f5014851-47c3-48a7-ac00-27e87fdbc4f2 nodeName:}" failed. No retries permitted until 2026-06-09 14:41:45.501511473 +0000 UTC m=+284.854591283 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls") pod "dns-default-fj74q" (UID: "f5014851-47c3-48a7-ac00-27e87fdbc4f2") : secret "dns-default-metrics-tls" not found Jun 09 14:39:53.047764 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:39:53.047672 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:39:53.634100 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:39:53.634067 2577 generic.go:356] "Generic (PLEG): container finished" podID="4c06a58c-4978-4f89-b1c5-4182f439250c" containerID="3a2b7ad912bf94c20bf6e4c1e3212163d76721ec300ae46b149a8e3ccb7d41e9" exitCode=255 Jun 09 14:39:53.634286 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:39:53.634139 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" event={"ID":"4c06a58c-4978-4f89-b1c5-4182f439250c","Type":"ContainerDied","Data":"3a2b7ad912bf94c20bf6e4c1e3212163d76721ec300ae46b149a8e3ccb7d41e9"} Jun 09 14:39:53.634479 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:39:53.634466 2577 scope.go:117] "RemoveContainer" containerID="3a2b7ad912bf94c20bf6e4c1e3212163d76721ec300ae46b149a8e3ccb7d41e9" Jun 09 14:39:54.639583 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:39:54.639550 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" event={"ID":"4c06a58c-4978-4f89-b1c5-4182f439250c","Type":"ContainerStarted","Data":"8c0b2c2a11938c2b82ca7ccca70a334368b90d267dd6630698e128b44ac30dd0"} Jun 09 14:40:27.082169 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:27.082137 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:48.770760 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:48.770728 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:48.832865 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:48.832834 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:50.847991 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:50.847959 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:50.949868 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:50.949835 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:52.128709 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:52.128678 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:52.230920 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:52.230889 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:52.587524 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:52.587435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:52.649150 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:52.649122 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:52.847249 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:52.847170 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:52.947166 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:52.947136 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:53.745967 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:53.745916 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:53.814527 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:53.814495 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:54.135539 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:54.135506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:54.219521 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:54.219493 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:54.285537 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:54.285500 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:54.534585 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:54.534491 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:54.635520 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:54.635488 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:55.451375 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:55.451347 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dxq5z_8f91e9a1-398c-4559-970c-a1bba6ce235a/dns-node-resolver/0.log" Jun 09 14:40:55.514543 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:55.514516 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:56.846998 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:56.846970 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sz6h7_92f7ab4e-6e36-4c50-ba47-a63d198f2702/node-ca/0.log" Jun 09 14:40:57.244582 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:57.244557 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4qclb_202606ae-b23b-45fe-b767-adebf07d8cfb/serve-healthcheck-canary/0.log" Jun 09 14:40:58.265342 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:58.265313 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:58.407793 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:58.407766 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:58.587865 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:58.587780 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:58.699923 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:58.699886 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:58.790077 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:58.790048 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:59.182075 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:59.182043 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:40:59.378692 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:40:59.378663 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:00.577837 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:00.577807 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:00.788087 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:00.788055 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:00.972493 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:00.972459 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:01.164663 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:01.164634 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:01.364855 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:01.364826 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:02.166250 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:02.166211 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:02.269651 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:02.269607 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:02.366531 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:02.366490 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:02.774809 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:02.774780 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:02.965804 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:02.965772 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:03.166148 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:03.166098 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:03.367335 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:03.367303 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:04.367623 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:04.367589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:04.564440 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:04.564413 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:04.632911 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:04.632808 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:04.965460 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:04.965376 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:05.162352 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:05.162323 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:05.567003 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:05.566968 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:05.670845 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:05.670817 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:06.170187 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:06.170152 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:06.565353 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:06.565273 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:06.775529 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:06.775493 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:07.156399 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:07.156366 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:07.364917 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:07.364885 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:07.764161 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:07.764130 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:08.163124 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:08.163090 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:08.560111 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:08.560022 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:08.764378 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:08.764343 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:08.970703 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:08.970673 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:12.939829 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:12.939786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:41:12.942131 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:12.942110 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf3a7d28-6504-46ae-b4d2-0a45e236a5ee-metrics-certs\") pod \"network-metrics-daemon-pzrj2\" (UID: \"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee\") " pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:41:13.150660 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:13.150629 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7n68j\"" Jun 09 14:41:13.158427 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:13.158397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzrj2" Jun 09 14:41:13.285859 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:13.285822 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pzrj2"] Jun 09 14:41:13.289530 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:41:13.289495 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3a7d28_6504_46ae_b4d2_0a45e236a5ee.slice/crio-7d5ec31f0e8f01a204c7abc05d5310c3300fe43ba71876068e14394fdf8f390d WatchSource:0}: Error finding container 7d5ec31f0e8f01a204c7abc05d5310c3300fe43ba71876068e14394fdf8f390d: Status 404 returned error can't find the container with id 7d5ec31f0e8f01a204c7abc05d5310c3300fe43ba71876068e14394fdf8f390d Jun 09 14:41:13.877329 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:13.877297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pzrj2" event={"ID":"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee","Type":"ContainerStarted","Data":"7d5ec31f0e8f01a204c7abc05d5310c3300fe43ba71876068e14394fdf8f390d"} Jun 09 14:41:14.882249 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:14.882205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pzrj2" event={"ID":"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee","Type":"ContainerStarted","Data":"1dc7e4930103937e621efdcde2540fa9026a97343a9f6c83e72783b5c73c561b"} Jun 09 14:41:14.882639 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:14.882300 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pzrj2" event={"ID":"cf3a7d28-6504-46ae-b4d2-0a45e236a5ee","Type":"ContainerStarted","Data":"742033ed0895134e37cee79dfe2d1d537550dea4827b759e2a20537d5dd64b67"} Jun 09 14:41:14.896325 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:14.896257 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pzrj2" podStartSLOduration=253.085939449 podStartE2EDuration="4m13.896239775s" totalImagesPullingTime="810.300326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:14.895361173 +0000 UTC m=+254.248440991" watchObservedRunningTime="2026-06-09 14:41:14.896239775 +0000 UTC m=+254.249319603" Jun 09 14:41:16.161265 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.161226 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cgx4v"] Jun 09 14:41:16.164306 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.164288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.168968 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.168945 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 14:41:16.169912 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.169886 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 14:41:16.170068 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.169995 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 14:41:16.170392 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.170376 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 14:41:16.170912 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.170626 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ghppp\"" Jun 09 14:41:16.181621 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.181592 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cgx4v"] Jun 09 14:41:16.257296 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.257262 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:16.261289 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.261263 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc620276-2a30-4c32-8852-6c9d78f8d71c-data-volume\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.261440 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.261295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc620276-2a30-4c32-8852-6c9d78f8d71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.261440 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.261315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc620276-2a30-4c32-8852-6c9d78f8d71c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.261440 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.261338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwcsw\" (UniqueName: \"kubernetes.io/projected/dc620276-2a30-4c32-8852-6c9d78f8d71c-kube-api-access-cwcsw\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.261440 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.261425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc620276-2a30-4c32-8852-6c9d78f8d71c-crio-socket\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.330077 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.330048 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:16.362141 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.362098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc620276-2a30-4c32-8852-6c9d78f8d71c-crio-socket\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.362254 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.362180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc620276-2a30-4c32-8852-6c9d78f8d71c-data-volume\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.362254 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.362198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc620276-2a30-4c32-8852-6c9d78f8d71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.362254 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.362216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc620276-2a30-4c32-8852-6c9d78f8d71c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.362254 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.362231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc620276-2a30-4c32-8852-6c9d78f8d71c-crio-socket\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.362254 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.362239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwcsw\" (UniqueName: \"kubernetes.io/projected/dc620276-2a30-4c32-8852-6c9d78f8d71c-kube-api-access-cwcsw\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.362633 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.362614 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc620276-2a30-4c32-8852-6c9d78f8d71c-data-volume\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.362773 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.362756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc620276-2a30-4c32-8852-6c9d78f8d71c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.364632 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.364612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc620276-2a30-4c32-8852-6c9d78f8d71c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.371086 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.371060 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwcsw\" (UniqueName: \"kubernetes.io/projected/dc620276-2a30-4c32-8852-6c9d78f8d71c-kube-api-access-cwcsw\") pod \"insights-runtime-extractor-cgx4v\" (UID: \"dc620276-2a30-4c32-8852-6c9d78f8d71c\") " pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.474297 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.474192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cgx4v" Jun 09 14:41:16.610533 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.610489 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cgx4v"] Jun 09 14:41:16.614890 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:41:16.614864 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc620276_2a30_4c32_8852_6c9d78f8d71c.slice/crio-68aec07ade8e14c944450ac1f03f3d0e525b666be04b483fb9d6f0ddade20618 WatchSource:0}: Error finding container 68aec07ade8e14c944450ac1f03f3d0e525b666be04b483fb9d6f0ddade20618: Status 404 returned error can't find the container with id 68aec07ade8e14c944450ac1f03f3d0e525b666be04b483fb9d6f0ddade20618 Jun 09 14:41:16.657827 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.657802 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:16.757440 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.757356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:16.889951 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.889897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgx4v" event={"ID":"dc620276-2a30-4c32-8852-6c9d78f8d71c","Type":"ContainerStarted","Data":"2db5f56391d20c9e0644ca40732cf78b100eadb8544f5170a9edc90bc3f22d5f"} Jun 09 14:41:16.890123 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:16.889971 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgx4v" event={"ID":"dc620276-2a30-4c32-8852-6c9d78f8d71c","Type":"ContainerStarted","Data":"68aec07ade8e14c944450ac1f03f3d0e525b666be04b483fb9d6f0ddade20618"} Jun 09 14:41:17.895258 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:17.895216 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgx4v" event={"ID":"dc620276-2a30-4c32-8852-6c9d78f8d71c","Type":"ContainerStarted","Data":"31d5fb0176ff3a734ea6b94c42f8df88bf5c8a91ec4acc49fb777dfc8e8055c5"} Jun 09 14:41:18.901157 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:18.901113 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cgx4v" event={"ID":"dc620276-2a30-4c32-8852-6c9d78f8d71c","Type":"ContainerStarted","Data":"d4d7dfa318ff2abce1473b1378f4130b8775a67b496f1100146be55030b6e9e6"} Jun 09 14:41:18.920319 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:18.920265 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cgx4v" podStartSLOduration=1.049336291 podStartE2EDuration="2.920241795s" totalImagesPullingTime="1.870905504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:41:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:18.918964536 +0000 UTC m=+258.272044353" watchObservedRunningTime="2026-06-09 14:41:18.920241795 +0000 UTC m=+258.273321615" Jun 09 14:41:21.793156 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:21.793119 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:21.858958 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:21.858908 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:22.803741 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:22.803711 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:22.874003 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:22.873973 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:22.987420 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:22.987373 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx"] Jun 09 14:41:22.989847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:22.989818 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:22.990499 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:22.990484 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx" Jun 09 14:41:22.992429 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:22.992401 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 14:41:22.992551 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:22.992481 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-27rld\"" Jun 09 14:41:23.000562 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:23.000538 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx"] Jun 09 14:41:23.066783 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:23.066682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:23.115385 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:23.115343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a2a23601-7204-4b35-8a56-ccf3115a1d9f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-79kfx\" (UID: \"a2a23601-7204-4b35-8a56-ccf3115a1d9f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx" Jun 09 14:41:23.132619 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:23.132589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:23.216106 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:23.216073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a2a23601-7204-4b35-8a56-ccf3115a1d9f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-79kfx\" (UID: \"a2a23601-7204-4b35-8a56-ccf3115a1d9f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx" Jun 09 14:41:23.218587 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:23.218564 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a2a23601-7204-4b35-8a56-ccf3115a1d9f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-79kfx\" (UID: \"a2a23601-7204-4b35-8a56-ccf3115a1d9f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx" Jun 09 14:41:23.299621 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:23.299575 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx" Jun 09 14:41:23.431715 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:23.431685 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx"] Jun 09 14:41:23.435059 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:41:23.435029 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a23601_7204_4b35_8a56_ccf3115a1d9f.slice/crio-55f2b5265246cec8defcaccfedd358c07a9898dec083c55f1fbc2975ceeeb2f3 WatchSource:0}: Error finding container 55f2b5265246cec8defcaccfedd358c07a9898dec083c55f1fbc2975ceeeb2f3: Status 404 returned error can't find the container with id 55f2b5265246cec8defcaccfedd358c07a9898dec083c55f1fbc2975ceeeb2f3 Jun 09 14:41:23.919233 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:23.919184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx" event={"ID":"a2a23601-7204-4b35-8a56-ccf3115a1d9f","Type":"ContainerStarted","Data":"55f2b5265246cec8defcaccfedd358c07a9898dec083c55f1fbc2975ceeeb2f3"} Jun 09 14:41:24.927658 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:24.927615 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx" event={"ID":"a2a23601-7204-4b35-8a56-ccf3115a1d9f","Type":"ContainerStarted","Data":"e4bb20a14ab03a7fb1a7adddd9952d98e534a33c8505bd3e6ffca8485ad98c86"} Jun 09 14:41:24.928086 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:24.927810 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx" Jun 09 14:41:24.932386 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:24.932361 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx" Jun 09 14:41:24.942711 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:24.942657 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-79kfx" podStartSLOduration=2.037927614 podStartE2EDuration="2.942640576s" totalImagesPullingTime="904.712962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:24.941506517 +0000 UTC m=+264.294586334" watchObservedRunningTime="2026-06-09 14:41:24.942640576 +0000 UTC m=+264.295720404" Jun 09 14:41:26.013804 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.013759 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:26.049897 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.049863 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r"] Jun 09 14:41:26.053050 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.053032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.054979 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.054958 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 14:41:26.055567 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.055536 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 14:41:26.055700 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.055616 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 14:41:26.055700 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.055627 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 14:41:26.055817 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.055636 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 14:41:26.055856 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.055816 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-p5l64\"" Jun 09 14:41:26.063518 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.063491 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r"] Jun 09 14:41:26.083402 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.083366 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:26.137741 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.137701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f60399e-692c-4d75-b4d9-3fd20d44055c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.137956 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.137759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lq42\" (UniqueName: \"kubernetes.io/projected/9f60399e-692c-4d75-b4d9-3fd20d44055c-kube-api-access-5lq42\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.137956 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.137794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f60399e-692c-4d75-b4d9-3fd20d44055c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.137956 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.137838 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f60399e-692c-4d75-b4d9-3fd20d44055c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.238828 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.238789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f60399e-692c-4d75-b4d9-3fd20d44055c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.239041 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.238836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f60399e-692c-4d75-b4d9-3fd20d44055c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.239041 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.238868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lq42\" (UniqueName: \"kubernetes.io/projected/9f60399e-692c-4d75-b4d9-3fd20d44055c-kube-api-access-5lq42\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.239041 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.238919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f60399e-692c-4d75-b4d9-3fd20d44055c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.239627 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.239606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f60399e-692c-4d75-b4d9-3fd20d44055c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.241304 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.241279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f60399e-692c-4d75-b4d9-3fd20d44055c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.241304 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.241279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9f60399e-692c-4d75-b4d9-3fd20d44055c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.247480 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.247458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lq42\" (UniqueName: \"kubernetes.io/projected/9f60399e-692c-4d75-b4d9-3fd20d44055c-kube-api-access-5lq42\") pod \"prometheus-operator-7f7d445d84-7qr7r\" (UID: \"9f60399e-692c-4d75-b4d9-3fd20d44055c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.264415 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.264332 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:26.361935 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.361905 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" Jun 09 14:41:26.495291 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.495261 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r"] Jun 09 14:41:26.498821 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:41:26.498792 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f60399e_692c_4d75_b4d9_3fd20d44055c.slice/crio-56f5b2e895fdd2b7715772d73b859b8cff8cc71fa2a847ef6a99481019cffeb6 WatchSource:0}: Error finding container 56f5b2e895fdd2b7715772d73b859b8cff8cc71fa2a847ef6a99481019cffeb6: Status 404 returned error can't find the container with id 56f5b2e895fdd2b7715772d73b859b8cff8cc71fa2a847ef6a99481019cffeb6 Jun 09 14:41:26.935255 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:26.935215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" event={"ID":"9f60399e-692c-4d75-b4d9-3fd20d44055c","Type":"ContainerStarted","Data":"56f5b2e895fdd2b7715772d73b859b8cff8cc71fa2a847ef6a99481019cffeb6"} Jun 09 14:41:27.844156 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:27.844061 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:27.940486 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:27.940443 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" event={"ID":"9f60399e-692c-4d75-b4d9-3fd20d44055c","Type":"ContainerStarted","Data":"55ea26bf375f7b3eebac88aa7e3cacc005ba4f6ec4c5d6556f426fb1af46b813"} Jun 09 14:41:27.940664 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:27.940507 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" event={"ID":"9f60399e-692c-4d75-b4d9-3fd20d44055c","Type":"ContainerStarted","Data":"d17bbabffa2acbb9e74cead6dd09913ce53e3c69c8c11929376e1ea308c7b869"} Jun 09 14:41:27.957148 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:27.957098 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qr7r" podStartSLOduration=0.905115662 podStartE2EDuration="1.957079896s" totalImagesPullingTime="1.051964234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:27.956979212 +0000 UTC m=+267.310059034" watchObservedRunningTime="2026-06-09 14:41:27.957079896 +0000 UTC m=+267.310159713" Jun 09 14:41:29.207587 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.207549 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:29.307833 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.307800 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:29.418305 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.418272 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:29.480847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.480739 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k627f"] Jun 09 14:41:29.485252 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.485225 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.488173 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.488133 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 14:41:29.488761 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.488741 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 14:41:29.489034 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.489016 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 14:41:29.491806 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.491781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r2dxb\"" Jun 09 14:41:29.566193 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.566129 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:29.662447 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.662412 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:29.663479 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.663459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.663555 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.663490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nzqb\" (UniqueName: \"kubernetes.io/projected/a7c30116-a81d-47a1-a4a8-00df5b57c615-kube-api-access-8nzqb\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.663555 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.663517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-tls\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.663555 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.663533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7c30116-a81d-47a1-a4a8-00df5b57c615-metrics-client-ca\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.663658 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.663571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7c30116-a81d-47a1-a4a8-00df5b57c615-root\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.663658 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.663622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-wtmp\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.663658 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.663646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-textfile\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.663776 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.663660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7c30116-a81d-47a1-a4a8-00df5b57c615-sys\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.663776 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.663701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-accelerators-collector-config\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765097 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-accelerators-collector-config\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765097 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765097 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzqb\" (UniqueName: \"kubernetes.io/projected/a7c30116-a81d-47a1-a4a8-00df5b57c615-kube-api-access-8nzqb\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765314 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-tls\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765314 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7c30116-a81d-47a1-a4a8-00df5b57c615-metrics-client-ca\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765314 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7c30116-a81d-47a1-a4a8-00df5b57c615-root\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765314 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-wtmp\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765314 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-textfile\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765314 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7c30116-a81d-47a1-a4a8-00df5b57c615-sys\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765314 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765294 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7c30116-a81d-47a1-a4a8-00df5b57c615-root\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765643 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7c30116-a81d-47a1-a4a8-00df5b57c615-sys\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765643 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765450 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-wtmp\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765643 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-textfile\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765814 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-accelerators-collector-config\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.765973 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.765954 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7c30116-a81d-47a1-a4a8-00df5b57c615-metrics-client-ca\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.767589 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.767572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.767640 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.767583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7c30116-a81d-47a1-a4a8-00df5b57c615-node-exporter-tls\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.774040 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.774016 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzqb\" (UniqueName: \"kubernetes.io/projected/a7c30116-a81d-47a1-a4a8-00df5b57c615-kube-api-access-8nzqb\") pod \"node-exporter-k627f\" (UID: \"a7c30116-a81d-47a1-a4a8-00df5b57c615\") " pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.793975 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.793946 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k627f" Jun 09 14:41:29.805770 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:41:29.805735 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c30116_a81d_47a1_a4a8_00df5b57c615.slice/crio-d286add3675ad929ccd36929fb85df20d1415dd59510af0febaa02ff0c0d319e WatchSource:0}: Error finding container d286add3675ad929ccd36929fb85df20d1415dd59510af0febaa02ff0c0d319e: Status 404 returned error can't find the container with id d286add3675ad929ccd36929fb85df20d1415dd59510af0febaa02ff0c0d319e Jun 09 14:41:29.835316 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.835282 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:29.948176 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:29.948144 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k627f" event={"ID":"a7c30116-a81d-47a1-a4a8-00df5b57c615","Type":"ContainerStarted","Data":"d286add3675ad929ccd36929fb85df20d1415dd59510af0febaa02ff0c0d319e"} Jun 09 14:41:30.282416 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:30.282373 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:30.382473 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:30.382428 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:30.453579 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:30.453544 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:30.590353 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:30.590247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:30.953393 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:30.953361 2577 generic.go:356] "Generic (PLEG): container finished" podID="a7c30116-a81d-47a1-a4a8-00df5b57c615" containerID="b22113c6e23cf38f439267bff85615c271175d06eabac5d40537f540eadadf9b" exitCode=0 Jun 09 14:41:30.953726 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:30.953420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k627f" event={"ID":"a7c30116-a81d-47a1-a4a8-00df5b57c615","Type":"ContainerDied","Data":"b22113c6e23cf38f439267bff85615c271175d06eabac5d40537f540eadadf9b"} Jun 09 14:41:31.959019 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:31.958979 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k627f" event={"ID":"a7c30116-a81d-47a1-a4a8-00df5b57c615","Type":"ContainerStarted","Data":"67d14b600bb868376e2f3855e5328eb854315472daa4d21e93d68e0b34487c01"} Jun 09 14:41:31.959505 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:31.959040 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k627f" event={"ID":"a7c30116-a81d-47a1-a4a8-00df5b57c615","Type":"ContainerStarted","Data":"cb29e9483b8ec72bc9963e31f49a51b37b2565894f741a245f0e2cb596f0f0e8"} Jun 09 14:41:31.978508 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:31.978453 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k627f" podStartSLOduration=2.052368561 podStartE2EDuration="2.978435881s" totalImagesPullingTime="856.528162ms" totalInitContainerRuntime="69.539158ms" isStatefulPod=true podCreationTimestamp="2026-06-09 14:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:31.977138173 +0000 UTC m=+271.330218010" watchObservedRunningTime="2026-06-09 14:41:31.978435881 +0000 UTC m=+271.331515762" Jun 09 14:41:32.356596 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.356565 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:32.454620 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.454580 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:32.458897 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.458868 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7847dd546-t8w2p"] Jun 09 14:41:32.462290 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.462268 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.464719 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.464572 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 14:41:32.464864 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.464809 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 14:41:32.464864 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.464822 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 14:41:32.465121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.465103 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6hi9komark1hd\"" Jun 09 14:41:32.465587 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.465561 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-d79zd\"" Jun 09 14:41:32.465693 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.465675 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 14:41:32.467340 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.466732 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 14:41:32.476023 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.475996 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7847dd546-t8w2p"] Jun 09 14:41:32.528596 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.528563 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:32.589402 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.589368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.589402 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.589405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkwf5\" (UniqueName: \"kubernetes.io/projected/fa7b09df-66a4-433b-a8be-e7cdb91448e0-kube-api-access-wkwf5\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.589598 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.589435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.589598 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.589498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-grpc-tls\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.589598 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.589560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.589598 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.589584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa7b09df-66a4-433b-a8be-e7cdb91448e0-metrics-client-ca\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.589720 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.589606 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.589720 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.589631 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-tls\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.687736 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.687629 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:32.690721 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.690698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.690826 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.690731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa7b09df-66a4-433b-a8be-e7cdb91448e0-metrics-client-ca\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.690826 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.690752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.690826 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.690779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-tls\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.690993 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.690941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.691051 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.690990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwf5\" (UniqueName: \"kubernetes.io/projected/fa7b09df-66a4-433b-a8be-e7cdb91448e0-kube-api-access-wkwf5\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.691051 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.691035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.691145 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.691081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-grpc-tls\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.691538 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.691494 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa7b09df-66a4-433b-a8be-e7cdb91448e0-metrics-client-ca\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.693653 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.693628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.693781 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.693649 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.693993 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.693971 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.694252 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.694232 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.694388 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.694368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-grpc-tls\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.694754 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.694735 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fa7b09df-66a4-433b-a8be-e7cdb91448e0-secret-thanos-querier-tls\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.702126 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.702103 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkwf5\" (UniqueName: \"kubernetes.io/projected/fa7b09df-66a4-433b-a8be-e7cdb91448e0-kube-api-access-wkwf5\") pod \"thanos-querier-7847dd546-t8w2p\" (UID: \"fa7b09df-66a4-433b-a8be-e7cdb91448e0\") " pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.776597 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.776560 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:32.918133 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.918024 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7847dd546-t8w2p"] Jun 09 14:41:32.920922 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:41:32.920894 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7b09df_66a4_433b_a8be_e7cdb91448e0.slice/crio-f506536e8865956123036f4589b32afe7f5f97b4ab00cd2bde89c78050aba0e2 WatchSource:0}: Error finding container f506536e8865956123036f4589b32afe7f5f97b4ab00cd2bde89c78050aba0e2: Status 404 returned error can't find the container with id f506536e8865956123036f4589b32afe7f5f97b4ab00cd2bde89c78050aba0e2 Jun 09 14:41:32.963726 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:32.963647 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" event={"ID":"fa7b09df-66a4-433b-a8be-e7cdb91448e0","Type":"ContainerStarted","Data":"f506536e8865956123036f4589b32afe7f5f97b4ab00cd2bde89c78050aba0e2"} Jun 09 14:41:34.204986 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.204953 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:34.207304 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.207279 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2"] Jun 09 14:41:34.211127 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.211102 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:34.213088 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.213062 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 14:41:34.213232 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.213072 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rmfv4\"" Jun 09 14:41:34.219005 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.218977 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2"] Jun 09 14:41:34.407292 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.407253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aab5a8c1-2918-401d-9901-b9cfd49f687f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-cgqj2\" (UID: \"aab5a8c1-2918-401d-9901-b9cfd49f687f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:34.407474 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.407308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k586\" (UniqueName: \"kubernetes.io/projected/aab5a8c1-2918-401d-9901-b9cfd49f687f-kube-api-access-4k586\") pod \"monitoring-plugin-76b68cc874-cgqj2\" (UID: \"aab5a8c1-2918-401d-9901-b9cfd49f687f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:34.507840 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.507748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aab5a8c1-2918-401d-9901-b9cfd49f687f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-cgqj2\" (UID: \"aab5a8c1-2918-401d-9901-b9cfd49f687f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:34.507840 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.507799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k586\" (UniqueName: \"kubernetes.io/projected/aab5a8c1-2918-401d-9901-b9cfd49f687f-kube-api-access-4k586\") pod \"monitoring-plugin-76b68cc874-cgqj2\" (UID: \"aab5a8c1-2918-401d-9901-b9cfd49f687f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:34.508120 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:41:34.507943 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 14:41:34.508120 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:41:34.508028 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aab5a8c1-2918-401d-9901-b9cfd49f687f-monitoring-plugin-cert podName:aab5a8c1-2918-401d-9901-b9cfd49f687f nodeName:}" failed. No retries permitted until 2026-06-09 14:41:35.008002242 +0000 UTC m=+274.361082086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/aab5a8c1-2918-401d-9901-b9cfd49f687f-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-cgqj2" (UID: "aab5a8c1-2918-401d-9901-b9cfd49f687f") : secret "monitoring-plugin-cert" not found Jun 09 14:41:34.518013 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.517981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k586\" (UniqueName: \"kubernetes.io/projected/aab5a8c1-2918-401d-9901-b9cfd49f687f-kube-api-access-4k586\") pod \"monitoring-plugin-76b68cc874-cgqj2\" (UID: \"aab5a8c1-2918-401d-9901-b9cfd49f687f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:34.740899 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.740852 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:34.974301 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.974268 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" event={"ID":"fa7b09df-66a4-433b-a8be-e7cdb91448e0","Type":"ContainerStarted","Data":"0b72845b303c04b011114175b7424ff0e78a8d961a2ef5710ae2f72f595ab43a"} Jun 09 14:41:34.974475 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.974328 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" event={"ID":"fa7b09df-66a4-433b-a8be-e7cdb91448e0","Type":"ContainerStarted","Data":"6c321cd45d2c448919a15a8cb6b57eb9ca16f8c6d61f7473e4fcbf5a94b7bf81"} Jun 09 14:41:34.974475 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:34.974353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" event={"ID":"fa7b09df-66a4-433b-a8be-e7cdb91448e0","Type":"ContainerStarted","Data":"0bb768bb942825d572711633fa7d0b1273d2ed8747ddeaf486703261efc40275"} Jun 09 14:41:35.012773 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.012745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aab5a8c1-2918-401d-9901-b9cfd49f687f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-cgqj2\" (UID: \"aab5a8c1-2918-401d-9901-b9cfd49f687f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:35.015260 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.015195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aab5a8c1-2918-401d-9901-b9cfd49f687f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-cgqj2\" (UID: \"aab5a8c1-2918-401d-9901-b9cfd49f687f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:35.123618 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.123581 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:35.285747 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.285650 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2"] Jun 09 14:41:35.390705 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:41:35.390671 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab5a8c1_2918_401d_9901_b9cfd49f687f.slice/crio-eb8d50a1192488899e1da7c32cee8a82ce07bbf002c12227360db3aef49d0803 WatchSource:0}: Error finding container eb8d50a1192488899e1da7c32cee8a82ce07bbf002c12227360db3aef49d0803: Status 404 returned error can't find the container with id eb8d50a1192488899e1da7c32cee8a82ce07bbf002c12227360db3aef49d0803 Jun 09 14:41:35.666539 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.666500 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:35.679318 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.679281 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-vzkdh"] Jun 09 14:41:35.682959 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.682905 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-vzkdh" Jun 09 14:41:35.685093 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.685064 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-c445n\"" Jun 09 14:41:35.685249 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.685064 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 14:41:35.685249 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.685176 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 14:41:35.694748 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.694718 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-vzkdh"] Jun 09 14:41:35.814542 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.814445 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:35.821610 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.820513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n89bf\" (UniqueName: \"kubernetes.io/projected/3e37b82c-c5f3-4d20-9db9-f00ffa945146-kube-api-access-n89bf\") pod \"downloads-6657875f97-vzkdh\" (UID: \"3e37b82c-c5f3-4d20-9db9-f00ffa945146\") " pod="openshift-console/downloads-6657875f97-vzkdh" Jun 09 14:41:35.915615 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.915572 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:35.922039 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.922001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n89bf\" (UniqueName: \"kubernetes.io/projected/3e37b82c-c5f3-4d20-9db9-f00ffa945146-kube-api-access-n89bf\") pod \"downloads-6657875f97-vzkdh\" (UID: \"3e37b82c-c5f3-4d20-9db9-f00ffa945146\") " pod="openshift-console/downloads-6657875f97-vzkdh" Jun 09 14:41:35.932996 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.932965 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n89bf\" (UniqueName: \"kubernetes.io/projected/3e37b82c-c5f3-4d20-9db9-f00ffa945146-kube-api-access-n89bf\") pod \"downloads-6657875f97-vzkdh\" (UID: \"3e37b82c-c5f3-4d20-9db9-f00ffa945146\") " pod="openshift-console/downloads-6657875f97-vzkdh" Jun 09 14:41:35.981279 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.981240 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" event={"ID":"fa7b09df-66a4-433b-a8be-e7cdb91448e0","Type":"ContainerStarted","Data":"c124379324162364f7bd3ef8430c6b8157dc569832f028595301b4313ea58d8f"} Jun 09 14:41:35.981499 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.981348 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" event={"ID":"fa7b09df-66a4-433b-a8be-e7cdb91448e0","Type":"ContainerStarted","Data":"139baa2a58467e0f66715f93804b0ee6ba0601f9be722b5027b63d385f9f1711"} Jun 09 14:41:35.981499 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.981411 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" event={"ID":"fa7b09df-66a4-433b-a8be-e7cdb91448e0","Type":"ContainerStarted","Data":"48a953b3a9a842eadd3da8a045d623a6cc8283a16cd125d95cb724eccb2f0a34"} Jun 09 14:41:35.981499 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.981453 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:35.982338 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.982303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" event={"ID":"aab5a8c1-2918-401d-9901-b9cfd49f687f","Type":"ContainerStarted","Data":"eb8d50a1192488899e1da7c32cee8a82ce07bbf002c12227360db3aef49d0803"} Jun 09 14:41:35.996534 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:35.996502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-vzkdh" Jun 09 14:41:36.009372 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.009313 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" podStartSLOduration=1.671501412 podStartE2EDuration="4.009288512s" totalImagesPullingTime="2.3377871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:36.007767678 +0000 UTC m=+275.360847529" watchObservedRunningTime="2026-06-09 14:41:36.009288512 +0000 UTC m=+275.362368332" Jun 09 14:41:36.016799 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.016769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:36.166552 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.166514 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-vzkdh"] Jun 09 14:41:36.169640 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:41:36.169605 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e37b82c_c5f3_4d20_9db9_f00ffa945146.slice/crio-d2ed7ec83b29c9fb461196266563da58d05c049cf4c92eece154af128c71739e WatchSource:0}: Error finding container d2ed7ec83b29c9fb461196266563da58d05c049cf4c92eece154af128c71739e: Status 404 returned error can't find the container with id d2ed7ec83b29c9fb461196266563da58d05c049cf4c92eece154af128c71739e Jun 09 14:41:36.336368 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.336323 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:36.547768 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.547717 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:36.765963 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.765912 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:36.865460 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.865421 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:36.986470 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.986433 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-vzkdh" event={"ID":"3e37b82c-c5f3-4d20-9db9-f00ffa945146","Type":"ContainerStarted","Data":"d2ed7ec83b29c9fb461196266563da58d05c049cf4c92eece154af128c71739e"} Jun 09 14:41:36.987999 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.987972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" event={"ID":"aab5a8c1-2918-401d-9901-b9cfd49f687f","Type":"ContainerStarted","Data":"c29949c61e3fb00e2a9ff98e09f4695e3d8d2aa14ca8ef26b5935bfb9eadba2c"} Jun 09 14:41:36.988412 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.988396 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:36.993049 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:36.993022 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" Jun 09 14:41:37.004936 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:37.004870 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-cgqj2" podStartSLOduration=1.6456091609999999 podStartE2EDuration="3.004854813s" totalImagesPullingTime="1.359245652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:37.00417427 +0000 UTC m=+276.357254090" watchObservedRunningTime="2026-06-09 14:41:37.004854813 +0000 UTC m=+276.357934631" Jun 09 14:41:37.163353 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:37.163316 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:37.265382 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:37.265341 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:37.365887 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:37.365848 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:37.686308 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:37.686266 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" podUID="03689f3e-f249-42c0-b316-55dc3edf24f5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 14:41:38.180206 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:38.180170 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:41.589276 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:41:41.589229 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fj74q" podUID="f5014851-47c3-48a7-ac00-27e87fdbc4f2" Jun 09 14:41:41.995444 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:41.995414 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7847dd546-t8w2p" Jun 09 14:41:42.009812 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:42.009784 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fj74q" Jun 09 14:41:45.600600 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:45.600557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:41:45.603335 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:45.603304 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5014851-47c3-48a7-ac00-27e87fdbc4f2-metrics-tls\") pod \"dns-default-fj74q\" (UID: \"f5014851-47c3-48a7-ac00-27e87fdbc4f2\") " pod="openshift-dns/dns-default-fj74q" Jun 09 14:41:45.613171 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:45.613141 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w2kzc\"" Jun 09 14:41:45.621942 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:45.621898 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fj74q" Jun 09 14:41:45.770568 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:45.770536 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fj74q"] Jun 09 14:41:45.774052 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:41:45.774025 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5014851_47c3_48a7_ac00_27e87fdbc4f2.slice/crio-56862feb7c7c8dd0589bde6a9752ba79c0f7e4871c4715fcb16860d13e7945f6 WatchSource:0}: Error finding container 56862feb7c7c8dd0589bde6a9752ba79c0f7e4871c4715fcb16860d13e7945f6: Status 404 returned error can't find the container with id 56862feb7c7c8dd0589bde6a9752ba79c0f7e4871c4715fcb16860d13e7945f6 Jun 09 14:41:46.026309 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:46.026263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fj74q" event={"ID":"f5014851-47c3-48a7-ac00-27e87fdbc4f2","Type":"ContainerStarted","Data":"56862feb7c7c8dd0589bde6a9752ba79c0f7e4871c4715fcb16860d13e7945f6"} Jun 09 14:41:46.647998 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:46.647948 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:46.752190 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:46.752142 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:47.686703 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:47.686617 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" podUID="03689f3e-f249-42c0-b316-55dc3edf24f5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 14:41:48.037000 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:48.036888 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fj74q" event={"ID":"f5014851-47c3-48a7-ac00-27e87fdbc4f2","Type":"ContainerStarted","Data":"64c6c224c79bd7bb1cd69a7ef745b620268a5ed13a48c3da4d1ab07628ef69a1"} Jun 09 14:41:48.037000 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:48.036971 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fj74q" event={"ID":"f5014851-47c3-48a7-ac00-27e87fdbc4f2","Type":"ContainerStarted","Data":"3a7a4ba426da53721596f0a22d68690558baa882cf06c8a1e4ba5c694a3dc6e7"} Jun 09 14:41:48.037208 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:48.037003 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fj74q" Jun 09 14:41:48.054152 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:48.054089 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fj74q" podStartSLOduration=251.453691626 podStartE2EDuration="4m13.054065688s" totalImagesPullingTime="1.600374062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:48.052511999 +0000 UTC m=+287.405591817" watchObservedRunningTime="2026-06-09 14:41:48.054065688 +0000 UTC m=+287.407145508" Jun 09 14:41:51.974425 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:51.974389 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:52.076214 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:52.076181 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:52.173857 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:52.173814 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:52.237222 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:52.237134 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:55.984186 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:55.984142 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:57.074163 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.074123 2577 generic.go:356] "Generic (PLEG): container finished" podID="4c06a58c-4978-4f89-b1c5-4182f439250c" containerID="8c0b2c2a11938c2b82ca7ccca70a334368b90d267dd6630698e128b44ac30dd0" exitCode=255 Jun 09 14:41:57.074651 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.074212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" event={"ID":"4c06a58c-4978-4f89-b1c5-4182f439250c","Type":"ContainerDied","Data":"8c0b2c2a11938c2b82ca7ccca70a334368b90d267dd6630698e128b44ac30dd0"} Jun 09 14:41:57.075034 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.075009 2577 scope.go:117] "RemoveContainer" containerID="3a2b7ad912bf94c20bf6e4c1e3212163d76721ec300ae46b149a8e3ccb7d41e9" Jun 09 14:41:57.075146 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.075122 2577 scope.go:117] "RemoveContainer" containerID="8c0b2c2a11938c2b82ca7ccca70a334368b90d267dd6630698e128b44ac30dd0" Jun 09 14:41:57.075402 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:41:57.075371 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s_open-cluster-management-agent-addon(4c06a58c-4978-4f89-b1c5-4182f439250c)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" podUID="4c06a58c-4978-4f89-b1c5-4182f439250c" Jun 09 14:41:57.076294 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.076272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-vzkdh" event={"ID":"3e37b82c-c5f3-4d20-9db9-f00ffa945146","Type":"ContainerStarted","Data":"2c46a9f1e930004e28998c1165e84f536c5c547e69c6ca6ce4ca28a40f16ef32"} Jun 09 14:41:57.076482 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.076434 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-vzkdh" Jun 09 14:41:57.091212 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.091181 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-vzkdh" Jun 09 14:41:57.111262 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.111209 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-vzkdh" podStartSLOduration=1.932642566 podStartE2EDuration="22.111190579s" totalImagesPullingTime="20.178548013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:41:57.109423154 +0000 UTC m=+296.462502974" watchObservedRunningTime="2026-06-09 14:41:57.111190579 +0000 UTC m=+296.464270396" Jun 09 14:41:57.316147 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.316104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:57.673026 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.672980 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" Jun 09 14:41:57.686284 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.686226 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" podUID="03689f3e-f249-42c0-b316-55dc3edf24f5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 14:41:57.686465 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.686329 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" Jun 09 14:41:57.686949 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.686891 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"7ca71a9d8da6b58ace6c6c871d4527efc73cfe0e72d7c071c17bc3cd12459a24"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 14:41:57.687067 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:57.686982 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" podUID="03689f3e-f249-42c0-b316-55dc3edf24f5" containerName="service-proxy" containerID="cri-o://7ca71a9d8da6b58ace6c6c871d4527efc73cfe0e72d7c071c17bc3cd12459a24" gracePeriod=30 Jun 09 14:41:58.044426 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:58.044339 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fj74q" Jun 09 14:41:58.085157 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:58.085116 2577 generic.go:356] "Generic (PLEG): container finished" podID="03689f3e-f249-42c0-b316-55dc3edf24f5" containerID="7ca71a9d8da6b58ace6c6c871d4527efc73cfe0e72d7c071c17bc3cd12459a24" exitCode=2 Jun 09 14:41:58.085625 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:58.085297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" event={"ID":"03689f3e-f249-42c0-b316-55dc3edf24f5","Type":"ContainerDied","Data":"7ca71a9d8da6b58ace6c6c871d4527efc73cfe0e72d7c071c17bc3cd12459a24"} Jun 09 14:41:58.085625 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:58.085361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59d89f5ff5-bdnmb" event={"ID":"03689f3e-f249-42c0-b316-55dc3edf24f5","Type":"ContainerStarted","Data":"e641b70ff36b7932c3d93709b54bd9596ce66fbfac8ef442533445dbe3f8cf66"} Jun 09 14:41:58.088277 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:58.088203 2577 scope.go:117] "RemoveContainer" containerID="8c0b2c2a11938c2b82ca7ccca70a334368b90d267dd6630698e128b44ac30dd0" Jun 09 14:41:58.088424 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:41:58.088399 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s_open-cluster-management-agent-addon(4c06a58c-4978-4f89-b1c5-4182f439250c)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" podUID="4c06a58c-4978-4f89-b1c5-4182f439250c" Jun 09 14:41:59.384616 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:59.384581 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:41:59.448024 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:41:59.447986 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:00.517985 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:00.517941 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:00.617946 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:00.617891 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:00.688360 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:00.688321 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:01.017313 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:01.017284 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 14:42:01.782093 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:01.782053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:01.854994 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:01.854952 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:04.354352 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:04.354311 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:04.427735 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:04.427691 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:05.132535 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:05.132503 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:05.204345 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:05.204312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:05.278743 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:05.278711 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:05.337455 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:05.337434 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:06.691706 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:06.691676 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:06.790284 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:06.790245 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:06.891554 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:06.891526 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:07.267901 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:07.267863 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:07.370279 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:07.370236 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:07.471968 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:07.471916 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:07.574975 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:07.574864 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:07.674601 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:07.674569 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:07.747124 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:07.747093 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:09.340114 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:09.340071 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:09.406288 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:09.406256 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:12.047458 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:12.047425 2577 scope.go:117] "RemoveContainer" containerID="8c0b2c2a11938c2b82ca7ccca70a334368b90d267dd6630698e128b44ac30dd0" Jun 09 14:42:12.142037 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:12.141999 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78fc4c9bc8-tjd5s" event={"ID":"4c06a58c-4978-4f89-b1c5-4182f439250c","Type":"ContainerStarted","Data":"f35306e7818cfe4173f5f1980a4ba57074cea565478c52fc9e57074bd5aa5b1d"} Jun 09 14:42:14.178430 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:14.178397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:14.250698 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:14.250661 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:16.655133 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:16.655089 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:16.766573 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:16.766536 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:18.432653 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:18.432619 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:18.512807 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:18.512777 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:21.819000 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:21.818969 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:23.189625 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:23.189576 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:23.256513 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:23.256482 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:31.654899 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:31.654863 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:31.721893 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:31.721801 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:44.250949 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:44.250902 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:44.338696 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:44.338645 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:46.670148 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:46.670116 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:46.772393 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:46.772361 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:48.667291 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:48.667247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:49.343283 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:49.343238 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:57.112784 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:57.112730 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:57.224541 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:57.224497 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:57.311765 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:57.311730 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:57.855416 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:57.855371 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:42:57.956373 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:42:57.956345 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:43:01.669502 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:43:01.669473 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:43:01.763063 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:43:01.763025 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:43:07.616176 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:43:07.616144 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:43:07.721915 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:43:07.721873 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:43:29.629864 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:43:29.629826 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:43:48.679735 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:43:48.679698 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:43:48.776339 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:43:48.776306 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:03.998522 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:03.998490 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:04.099713 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:04.099673 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:15.885596 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:15.885559 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:15.986055 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:15.986014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:18.169098 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:18.169062 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:18.249784 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:18.249743 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:28.899275 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:28.899197 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:28.999833 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:28.999797 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:29.068026 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:29.067994 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:31.672282 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:31.672247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:31.774388 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:31.774356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:44:39.408338 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:44:39.408284 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:45:55.145553 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:45:55.145433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:45:55.254550 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:45:55.254518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:09.291475 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:09.291420 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:09.349726 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:09.349685 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:22.807476 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:22.807441 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:23.745522 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:23.745488 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:26.618022 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:26.617988 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:26.720268 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:26.720224 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:27.569330 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:27.569297 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:27.682312 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:27.682276 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:28.054461 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:28.054425 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:28.152717 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:28.152682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:31.507501 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:31.507456 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:31.902530 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:31.902499 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:33.212478 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:33.212446 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:33.272517 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:33.272488 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:37.991159 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:37.991128 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:38.068512 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:38.068481 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:39.102314 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:39.102281 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:40.766989 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.766953 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-xrm89"] Jun 09 14:46:40.768981 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.768966 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-xrm89" Jun 09 14:46:40.770886 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.770866 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tt74b\"" Jun 09 14:46:40.771030 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.770905 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 14:46:40.771660 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.771639 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 14:46:40.780053 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.780028 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-xrm89"] Jun 09 14:46:40.836260 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.836229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rfp4\" (UniqueName: \"kubernetes.io/projected/afce0d8c-f00f-4fcd-ac11-e91507167b97-kube-api-access-4rfp4\") pod \"cert-manager-59c77684cc-xrm89\" (UID: \"afce0d8c-f00f-4fcd-ac11-e91507167b97\") " pod="cert-manager/cert-manager-59c77684cc-xrm89" Jun 09 14:46:40.836444 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.836268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afce0d8c-f00f-4fcd-ac11-e91507167b97-bound-sa-token\") pod \"cert-manager-59c77684cc-xrm89\" (UID: \"afce0d8c-f00f-4fcd-ac11-e91507167b97\") " pod="cert-manager/cert-manager-59c77684cc-xrm89" Jun 09 14:46:40.936720 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.936684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rfp4\" (UniqueName: \"kubernetes.io/projected/afce0d8c-f00f-4fcd-ac11-e91507167b97-kube-api-access-4rfp4\") pod \"cert-manager-59c77684cc-xrm89\" (UID: \"afce0d8c-f00f-4fcd-ac11-e91507167b97\") " pod="cert-manager/cert-manager-59c77684cc-xrm89" Jun 09 14:46:40.936880 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.936731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afce0d8c-f00f-4fcd-ac11-e91507167b97-bound-sa-token\") pod \"cert-manager-59c77684cc-xrm89\" (UID: \"afce0d8c-f00f-4fcd-ac11-e91507167b97\") " pod="cert-manager/cert-manager-59c77684cc-xrm89" Jun 09 14:46:40.944842 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.944813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afce0d8c-f00f-4fcd-ac11-e91507167b97-bound-sa-token\") pod \"cert-manager-59c77684cc-xrm89\" (UID: \"afce0d8c-f00f-4fcd-ac11-e91507167b97\") " pod="cert-manager/cert-manager-59c77684cc-xrm89" Jun 09 14:46:40.945070 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:40.945050 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rfp4\" (UniqueName: \"kubernetes.io/projected/afce0d8c-f00f-4fcd-ac11-e91507167b97-kube-api-access-4rfp4\") pod \"cert-manager-59c77684cc-xrm89\" (UID: \"afce0d8c-f00f-4fcd-ac11-e91507167b97\") " pod="cert-manager/cert-manager-59c77684cc-xrm89" Jun 09 14:46:41.078295 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:41.078208 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-xrm89" Jun 09 14:46:41.209884 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:41.209854 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-xrm89"] Jun 09 14:46:41.213356 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:46:41.213331 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafce0d8c_f00f_4fcd_ac11_e91507167b97.slice/crio-76095935bee617729950af6c95c79371a18045d8964df9992d864bd49ea91102 WatchSource:0}: Error finding container 76095935bee617729950af6c95c79371a18045d8964df9992d864bd49ea91102: Status 404 returned error can't find the container with id 76095935bee617729950af6c95c79371a18045d8964df9992d864bd49ea91102 Jun 09 14:46:41.215278 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:41.215260 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:46:41.417589 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:41.417553 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:41.518457 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:41.518429 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:42.108429 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:42.108391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-xrm89" event={"ID":"afce0d8c-f00f-4fcd-ac11-e91507167b97","Type":"ContainerStarted","Data":"76095935bee617729950af6c95c79371a18045d8964df9992d864bd49ea91102"} Jun 09 14:46:44.116963 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:44.116921 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-xrm89" event={"ID":"afce0d8c-f00f-4fcd-ac11-e91507167b97","Type":"ContainerStarted","Data":"77655604f0c8fe72a98a85b7a277c2d97bb6f6e07657230b9af78b853ad6a368"} Jun 09 14:46:44.132840 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:44.132795 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-xrm89" podStartSLOduration=1.9809242569999999 podStartE2EDuration="4.132779988s" totalImagesPullingTime="2.151855731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:46:44.131160054 +0000 UTC m=+583.484239872" watchObservedRunningTime="2026-06-09 14:46:44.132779988 +0000 UTC m=+583.485859806" Jun 09 14:46:48.515515 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:48.515480 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:48.631946 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:48.631875 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:46:50.494439 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:46:50.494404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:01.848432 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:01.848395 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:02.881531 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:02.881498 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65"] Jun 09 14:47:02.883605 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:02.883584 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:02.886126 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:02.886107 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 14:47:02.886375 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:02.886359 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 14:47:02.886458 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:02.886431 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 14:47:02.886715 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:02.886699 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sptz4\"" Jun 09 14:47:02.887122 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:02.887103 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 14:47:02.902277 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:02.902251 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65"] Jun 09 14:47:03.003445 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.003402 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4612f9a3-736c-47cc-9e18-c5aa7b7de809-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.003608 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.003451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4612f9a3-736c-47cc-9e18-c5aa7b7de809-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.003608 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.003518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4612f9a3-736c-47cc-9e18-c5aa7b7de809-tmp\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.003608 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.003570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4612f9a3-736c-47cc-9e18-c5aa7b7de809-manifests\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.003608 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.003598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7gz9\" (UniqueName: \"kubernetes.io/projected/4612f9a3-736c-47cc-9e18-c5aa7b7de809-kube-api-access-b7gz9\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.104565 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.104526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4612f9a3-736c-47cc-9e18-c5aa7b7de809-tmp\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.104565 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.104567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4612f9a3-736c-47cc-9e18-c5aa7b7de809-manifests\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.104820 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.104586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7gz9\" (UniqueName: \"kubernetes.io/projected/4612f9a3-736c-47cc-9e18-c5aa7b7de809-kube-api-access-b7gz9\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.104820 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.104637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4612f9a3-736c-47cc-9e18-c5aa7b7de809-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.104820 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.104657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4612f9a3-736c-47cc-9e18-c5aa7b7de809-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.105038 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.105013 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4612f9a3-736c-47cc-9e18-c5aa7b7de809-manifests\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.106807 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.106776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4612f9a3-736c-47cc-9e18-c5aa7b7de809-tmp\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.107043 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.107025 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4612f9a3-736c-47cc-9e18-c5aa7b7de809-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.107137 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.107120 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4612f9a3-736c-47cc-9e18-c5aa7b7de809-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.116697 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.116674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7gz9\" (UniqueName: \"kubernetes.io/projected/4612f9a3-736c-47cc-9e18-c5aa7b7de809-kube-api-access-b7gz9\") pod \"opendatahub-operator-controller-manager-5c95c9747d-jgk65\" (UID: \"4612f9a3-736c-47cc-9e18-c5aa7b7de809\") " pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.193530 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.193429 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:03.264722 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.264691 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:03.329064 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.329026 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65"] Jun 09 14:47:03.332182 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:47:03.332156 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4612f9a3_736c_47cc_9e18_c5aa7b7de809.slice/crio-d3d06d33656ad010c514953f86febc708e1d990377e66e61e272fca49679cf7a WatchSource:0}: Error finding container d3d06d33656ad010c514953f86febc708e1d990377e66e61e272fca49679cf7a: Status 404 returned error can't find the container with id d3d06d33656ad010c514953f86febc708e1d990377e66e61e272fca49679cf7a Jun 09 14:47:03.333573 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.333551 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:03.404490 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.404454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:03.518093 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.518016 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:03.622112 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.622063 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:03.722534 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:03.722505 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:04.191093 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:04.191059 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" event={"ID":"4612f9a3-736c-47cc-9e18-c5aa7b7de809","Type":"ContainerStarted","Data":"d3d06d33656ad010c514953f86febc708e1d990377e66e61e272fca49679cf7a"} Jun 09 14:47:07.205867 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:07.205836 2577 generic.go:356] "Generic (PLEG): container finished" podID="4612f9a3-736c-47cc-9e18-c5aa7b7de809" containerID="2ece222261d8cf644a321c98aa28438080badf727be00d1a90775ed07c2efb46" exitCode=0 Jun 09 14:47:07.206291 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:07.205936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" event={"ID":"4612f9a3-736c-47cc-9e18-c5aa7b7de809","Type":"ContainerDied","Data":"2ece222261d8cf644a321c98aa28438080badf727be00d1a90775ed07c2efb46"} Jun 09 14:47:08.213149 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:08.213118 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" event={"ID":"4612f9a3-736c-47cc-9e18-c5aa7b7de809","Type":"ContainerStarted","Data":"20c287fb51faab21e08ea3ecd3ffa54c46b65dee29613525e4dd7d62d0a37ca2"} Jun 09 14:47:08.213535 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:08.213230 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:08.238516 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:08.238450 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" podStartSLOduration=2.185153762 podStartE2EDuration="6.238428691s" totalImagesPullingTime="3.146784966s" totalInitContainerRuntime="906.489963ms" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:08.236782905 +0000 UTC m=+607.589862726" watchObservedRunningTime="2026-06-09 14:47:08.238428691 +0000 UTC m=+607.591508512" Jun 09 14:47:19.219781 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:19.219707 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c95c9747d-jgk65" Jun 09 14:47:20.374243 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:20.374208 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:20.471473 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:20.471437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:22.328108 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:22.328072 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:22.465708 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:22.465670 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:22.717521 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:22.717494 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:22.879780 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:22.879747 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp"] Jun 09 14:47:22.882967 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:22.882950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:22.892951 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:22.892915 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 14:47:22.893054 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:22.893029 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 14:47:22.897008 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:22.896992 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 14:47:22.897071 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:22.897054 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 14:47:22.955839 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:22.955806 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp"] Jun 09 14:47:23.006993 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.006892 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:23.071394 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.071366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44e07779-698a-49f1-a383-a7c11e548640-tls-certs\") pod \"kube-auth-proxy-7cc4cf49bf-9xgxp\" (UID: \"44e07779-698a-49f1-a383-a7c11e548640\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:23.071563 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.071400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdr9x\" (UniqueName: \"kubernetes.io/projected/44e07779-698a-49f1-a383-a7c11e548640-kube-api-access-gdr9x\") pod \"kube-auth-proxy-7cc4cf49bf-9xgxp\" (UID: \"44e07779-698a-49f1-a383-a7c11e548640\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:23.071563 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.071418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44e07779-698a-49f1-a383-a7c11e548640-tmp\") pod \"kube-auth-proxy-7cc4cf49bf-9xgxp\" (UID: \"44e07779-698a-49f1-a383-a7c11e548640\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:23.172650 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.172618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44e07779-698a-49f1-a383-a7c11e548640-tls-certs\") pod \"kube-auth-proxy-7cc4cf49bf-9xgxp\" (UID: \"44e07779-698a-49f1-a383-a7c11e548640\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:23.172808 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.172656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdr9x\" (UniqueName: \"kubernetes.io/projected/44e07779-698a-49f1-a383-a7c11e548640-kube-api-access-gdr9x\") pod \"kube-auth-proxy-7cc4cf49bf-9xgxp\" (UID: \"44e07779-698a-49f1-a383-a7c11e548640\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:23.172808 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.172678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44e07779-698a-49f1-a383-a7c11e548640-tmp\") pod \"kube-auth-proxy-7cc4cf49bf-9xgxp\" (UID: \"44e07779-698a-49f1-a383-a7c11e548640\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:23.174869 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.174844 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44e07779-698a-49f1-a383-a7c11e548640-tmp\") pod \"kube-auth-proxy-7cc4cf49bf-9xgxp\" (UID: \"44e07779-698a-49f1-a383-a7c11e548640\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:23.175115 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.175092 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44e07779-698a-49f1-a383-a7c11e548640-tls-certs\") pod \"kube-auth-proxy-7cc4cf49bf-9xgxp\" (UID: \"44e07779-698a-49f1-a383-a7c11e548640\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:23.196557 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.196515 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:23.198403 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.198381 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdr9x\" (UniqueName: \"kubernetes.io/projected/44e07779-698a-49f1-a383-a7c11e548640-kube-api-access-gdr9x\") pod \"kube-auth-proxy-7cc4cf49bf-9xgxp\" (UID: \"44e07779-698a-49f1-a383-a7c11e548640\") " pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:23.413697 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.413661 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-s9ztb"] Jun 09 14:47:23.418026 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.418004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:23.420773 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.420750 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 14:47:23.420872 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.420787 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zg2fn\"" Jun 09 14:47:23.428656 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.428632 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-s9ztb"] Jun 09 14:47:23.475915 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.475882 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:23.491935 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.491913 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" Jun 09 14:47:23.575026 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.574912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-282vm\" (UniqueName: \"kubernetes.io/projected/4be20514-6f1c-4205-91ff-ed5cf95b5e44-kube-api-access-282vm\") pod \"odh-model-controller-6dc94f689f-s9ztb\" (UID: \"4be20514-6f1c-4205-91ff-ed5cf95b5e44\") " pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:23.575026 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.574988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be20514-6f1c-4205-91ff-ed5cf95b5e44-cert\") pod \"odh-model-controller-6dc94f689f-s9ztb\" (UID: \"4be20514-6f1c-4205-91ff-ed5cf95b5e44\") " pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:23.601448 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.601422 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:23.646895 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.646747 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp"] Jun 09 14:47:23.650173 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:47:23.650139 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e07779_698a_49f1_a383_a7c11e548640.slice/crio-fb4802a01ab6b2e2da8aa0745502b67e6ad274160942c819aaff9302d635ec65 WatchSource:0}: Error finding container fb4802a01ab6b2e2da8aa0745502b67e6ad274160942c819aaff9302d635ec65: Status 404 returned error can't find the container with id fb4802a01ab6b2e2da8aa0745502b67e6ad274160942c819aaff9302d635ec65 Jun 09 14:47:23.676285 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.676204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-282vm\" (UniqueName: \"kubernetes.io/projected/4be20514-6f1c-4205-91ff-ed5cf95b5e44-kube-api-access-282vm\") pod \"odh-model-controller-6dc94f689f-s9ztb\" (UID: \"4be20514-6f1c-4205-91ff-ed5cf95b5e44\") " pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:23.676285 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.676235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be20514-6f1c-4205-91ff-ed5cf95b5e44-cert\") pod \"odh-model-controller-6dc94f689f-s9ztb\" (UID: \"4be20514-6f1c-4205-91ff-ed5cf95b5e44\") " pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:23.676449 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:47:23.676353 2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 14:47:23.676449 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:47:23.676415 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be20514-6f1c-4205-91ff-ed5cf95b5e44-cert podName:4be20514-6f1c-4205-91ff-ed5cf95b5e44 nodeName:}" failed. No retries permitted until 2026-06-09 14:47:24.176399789 +0000 UTC m=+623.529479585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4be20514-6f1c-4205-91ff-ed5cf95b5e44-cert") pod "odh-model-controller-6dc94f689f-s9ztb" (UID: "4be20514-6f1c-4205-91ff-ed5cf95b5e44") : secret "odh-model-controller-webhook-cert" not found Jun 09 14:47:23.685503 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.685477 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-282vm\" (UniqueName: \"kubernetes.io/projected/4be20514-6f1c-4205-91ff-ed5cf95b5e44-kube-api-access-282vm\") pod \"odh-model-controller-6dc94f689f-s9ztb\" (UID: \"4be20514-6f1c-4205-91ff-ed5cf95b5e44\") " pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:23.700023 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.699998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:23.808989 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:23.808957 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:24.180902 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.180861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be20514-6f1c-4205-91ff-ed5cf95b5e44-cert\") pod \"odh-model-controller-6dc94f689f-s9ztb\" (UID: \"4be20514-6f1c-4205-91ff-ed5cf95b5e44\") " pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:24.183952 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.183883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be20514-6f1c-4205-91ff-ed5cf95b5e44-cert\") pod \"odh-model-controller-6dc94f689f-s9ztb\" (UID: \"4be20514-6f1c-4205-91ff-ed5cf95b5e44\") " pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:24.276105 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.276071 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" event={"ID":"44e07779-698a-49f1-a383-a7c11e548640","Type":"ContainerStarted","Data":"fb4802a01ab6b2e2da8aa0745502b67e6ad274160942c819aaff9302d635ec65"} Jun 09 14:47:24.298332 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.298296 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sdpsw"] Jun 09 14:47:24.301920 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.301894 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:24.304586 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.304530 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 14:47:24.326744 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.326706 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sdpsw"] Jun 09 14:47:24.329763 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.329730 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:24.338999 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.338913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:24.483357 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.483319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lzkh\" (UniqueName: \"kubernetes.io/projected/6351fcc6-3d92-4edc-af7c-a332ff145767-kube-api-access-4lzkh\") pod \"model-serving-api-5dd488fc48-sdpsw\" (UID: \"6351fcc6-3d92-4edc-af7c-a332ff145767\") " pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:24.483807 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.483404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6351fcc6-3d92-4edc-af7c-a332ff145767-tls-certs\") pod \"model-serving-api-5dd488fc48-sdpsw\" (UID: \"6351fcc6-3d92-4edc-af7c-a332ff145767\") " pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:24.501776 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.501697 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-s9ztb"] Jun 09 14:47:24.506033 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:47:24.505917 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be20514_6f1c_4205_91ff_ed5cf95b5e44.slice/crio-a41106b67bd519fae46d5bf9bee613b1e9343a8b09761de5b04204863180049a WatchSource:0}: Error finding container a41106b67bd519fae46d5bf9bee613b1e9343a8b09761de5b04204863180049a: Status 404 returned error can't find the container with id a41106b67bd519fae46d5bf9bee613b1e9343a8b09761de5b04204863180049a Jun 09 14:47:24.584728 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.584683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lzkh\" (UniqueName: \"kubernetes.io/projected/6351fcc6-3d92-4edc-af7c-a332ff145767-kube-api-access-4lzkh\") pod \"model-serving-api-5dd488fc48-sdpsw\" (UID: \"6351fcc6-3d92-4edc-af7c-a332ff145767\") " pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:24.584914 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.584767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6351fcc6-3d92-4edc-af7c-a332ff145767-tls-certs\") pod \"model-serving-api-5dd488fc48-sdpsw\" (UID: \"6351fcc6-3d92-4edc-af7c-a332ff145767\") " pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:24.584914 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:47:24.584901 2577 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 09 14:47:24.585090 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:47:24.584988 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6351fcc6-3d92-4edc-af7c-a332ff145767-tls-certs podName:6351fcc6-3d92-4edc-af7c-a332ff145767 nodeName:}" failed. No retries permitted until 2026-06-09 14:47:25.08496691 +0000 UTC m=+624.438046725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6351fcc6-3d92-4edc-af7c-a332ff145767-tls-certs") pod "model-serving-api-5dd488fc48-sdpsw" (UID: "6351fcc6-3d92-4edc-af7c-a332ff145767") : secret "model-serving-api-tls" not found Jun 09 14:47:24.594337 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.594310 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lzkh\" (UniqueName: \"kubernetes.io/projected/6351fcc6-3d92-4edc-af7c-a332ff145767-kube-api-access-4lzkh\") pod \"model-serving-api-5dd488fc48-sdpsw\" (UID: \"6351fcc6-3d92-4edc-af7c-a332ff145767\") " pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:24.898275 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:24.898244 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:25.089285 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:25.089243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6351fcc6-3d92-4edc-af7c-a332ff145767-tls-certs\") pod \"model-serving-api-5dd488fc48-sdpsw\" (UID: \"6351fcc6-3d92-4edc-af7c-a332ff145767\") " pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:25.092399 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:25.092371 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6351fcc6-3d92-4edc-af7c-a332ff145767-tls-certs\") pod \"model-serving-api-5dd488fc48-sdpsw\" (UID: \"6351fcc6-3d92-4edc-af7c-a332ff145767\") " pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:25.223474 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:25.214432 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:25.283118 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:25.283079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" event={"ID":"4be20514-6f1c-4205-91ff-ed5cf95b5e44","Type":"ContainerStarted","Data":"a41106b67bd519fae46d5bf9bee613b1e9343a8b09761de5b04204863180049a"} Jun 09 14:47:25.984392 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:25.984357 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sdpsw"] Jun 09 14:47:25.987758 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:47:25.987733 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6351fcc6_3d92_4edc_af7c_a332ff145767.slice/crio-fa9fbbe5f7ac70e9e3e761978018bf6dc14cc89ce8e291383d16dcc1005f0ce3 WatchSource:0}: Error finding container fa9fbbe5f7ac70e9e3e761978018bf6dc14cc89ce8e291383d16dcc1005f0ce3: Status 404 returned error can't find the container with id fa9fbbe5f7ac70e9e3e761978018bf6dc14cc89ce8e291383d16dcc1005f0ce3 Jun 09 14:47:26.291262 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:26.291215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" event={"ID":"6351fcc6-3d92-4edc-af7c-a332ff145767","Type":"ContainerStarted","Data":"fa9fbbe5f7ac70e9e3e761978018bf6dc14cc89ce8e291383d16dcc1005f0ce3"} Jun 09 14:47:29.309290 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:29.309250 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" event={"ID":"4be20514-6f1c-4205-91ff-ed5cf95b5e44","Type":"ContainerStarted","Data":"32448f8f3d41c58baf50a7305c7bc6cf9b2f53f96018c3714ce541e114ec21e0"} Jun 09 14:47:29.309764 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:29.309388 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:29.310989 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:29.310963 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" event={"ID":"6351fcc6-3d92-4edc-af7c-a332ff145767","Type":"ContainerStarted","Data":"7f3d4d22820c7cada3a222b36ce799f70373d5fefd9a0b4e3f5a61ae865c3487"} Jun 09 14:47:29.311127 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:29.311098 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:29.312583 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:29.312556 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" event={"ID":"44e07779-698a-49f1-a383-a7c11e548640","Type":"ContainerStarted","Data":"5d582478f89964afed31eaa360fe388804af1baa967903a437f5ecc8170f553a"} Jun 09 14:47:29.326895 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:29.326854 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" podStartSLOduration=2.350940406 podStartE2EDuration="6.326840955s" totalImagesPullingTime="3.975900549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:29.325696588 +0000 UTC m=+628.678776430" watchObservedRunningTime="2026-06-09 14:47:29.326840955 +0000 UTC m=+628.679920772" Jun 09 14:47:29.341293 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:29.341247 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" podStartSLOduration=2.850259559 podStartE2EDuration="5.341230826s" totalImagesPullingTime="2.490971267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:29.339914547 +0000 UTC m=+628.692994366" watchObservedRunningTime="2026-06-09 14:47:29.341230826 +0000 UTC m=+628.694310644" Jun 09 14:47:29.354774 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:29.354725 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cc4cf49bf-9xgxp" podStartSLOduration=2.533317111 podStartE2EDuration="7.354706712s" totalImagesPullingTime="4.821389601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:29.353759632 +0000 UTC m=+628.706839451" watchObservedRunningTime="2026-06-09 14:47:29.354706712 +0000 UTC m=+628.707786533" Jun 09 14:47:34.745598 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.745539 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:34.831763 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.831730 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:34.857618 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.857591 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7dssn"] Jun 09 14:47:34.861155 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.861138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:47:34.863122 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.863104 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 14:47:34.863320 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.863307 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lwz5l\"" Jun 09 14:47:34.869789 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.869764 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9"] Jun 09 14:47:34.873152 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.873134 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7dssn"] Jun 09 14:47:34.873256 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.873203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:47:34.875175 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.875155 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 14:47:34.875277 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.875165 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5hgxq\"" Jun 09 14:47:34.889673 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.889650 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9"] Jun 09 14:47:34.927642 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.927612 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:34.955272 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.955246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e1e4718-942f-40a8-8113-a8a601340670-cert\") pod \"kserve-controller-manager-69fc866d76-7dssn\" (UID: \"4e1e4718-942f-40a8-8113-a8a601340670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:47:34.955434 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.955280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmmzz\" (UniqueName: \"kubernetes.io/projected/4e1e4718-942f-40a8-8113-a8a601340670-kube-api-access-tmmzz\") pod \"kserve-controller-manager-69fc866d76-7dssn\" (UID: \"4e1e4718-942f-40a8-8113-a8a601340670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:47:34.955434 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.955302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d542940-0b49-430f-a125-9aea1dbcb482-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gl5q9\" (UID: \"3d542940-0b49-430f-a125-9aea1dbcb482\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:47:34.955434 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:34.955399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcrv4\" (UniqueName: \"kubernetes.io/projected/3d542940-0b49-430f-a125-9aea1dbcb482-kube-api-access-zcrv4\") pod \"llmisvc-controller-manager-864bfd7bc9-gl5q9\" (UID: \"3d542940-0b49-430f-a125-9aea1dbcb482\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:47:35.056631 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.056543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcrv4\" (UniqueName: \"kubernetes.io/projected/3d542940-0b49-430f-a125-9aea1dbcb482-kube-api-access-zcrv4\") pod \"llmisvc-controller-manager-864bfd7bc9-gl5q9\" (UID: \"3d542940-0b49-430f-a125-9aea1dbcb482\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:47:35.056792 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.056684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e1e4718-942f-40a8-8113-a8a601340670-cert\") pod \"kserve-controller-manager-69fc866d76-7dssn\" (UID: \"4e1e4718-942f-40a8-8113-a8a601340670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:47:35.056792 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.056735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmzz\" (UniqueName: \"kubernetes.io/projected/4e1e4718-942f-40a8-8113-a8a601340670-kube-api-access-tmmzz\") pod \"kserve-controller-manager-69fc866d76-7dssn\" (UID: \"4e1e4718-942f-40a8-8113-a8a601340670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:47:35.056792 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.056773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d542940-0b49-430f-a125-9aea1dbcb482-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gl5q9\" (UID: \"3d542940-0b49-430f-a125-9aea1dbcb482\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:47:35.056972 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:47:35.056805 2577 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 09 14:47:35.056972 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:47:35.056869 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e1e4718-942f-40a8-8113-a8a601340670-cert podName:4e1e4718-942f-40a8-8113-a8a601340670 nodeName:}" failed. No retries permitted until 2026-06-09 14:47:35.55684962 +0000 UTC m=+634.909929437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e1e4718-942f-40a8-8113-a8a601340670-cert") pod "kserve-controller-manager-69fc866d76-7dssn" (UID: "4e1e4718-942f-40a8-8113-a8a601340670") : secret "kserve-webhook-server-cert" not found Jun 09 14:47:35.057096 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:47:35.057028 2577 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 09 14:47:35.057096 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:47:35.057071 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d542940-0b49-430f-a125-9aea1dbcb482-cert podName:3d542940-0b49-430f-a125-9aea1dbcb482 nodeName:}" failed. No retries permitted until 2026-06-09 14:47:35.557060526 +0000 UTC m=+634.910140327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d542940-0b49-430f-a125-9aea1dbcb482-cert") pod "llmisvc-controller-manager-864bfd7bc9-gl5q9" (UID: "3d542940-0b49-430f-a125-9aea1dbcb482") : secret "llmisvc-webhook-server-cert" not found Jun 09 14:47:35.068065 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.068035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcrv4\" (UniqueName: \"kubernetes.io/projected/3d542940-0b49-430f-a125-9aea1dbcb482-kube-api-access-zcrv4\") pod \"llmisvc-controller-manager-864bfd7bc9-gl5q9\" (UID: \"3d542940-0b49-430f-a125-9aea1dbcb482\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:47:35.068269 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.068249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmmzz\" (UniqueName: \"kubernetes.io/projected/4e1e4718-942f-40a8-8113-a8a601340670-kube-api-access-tmmzz\") pod \"kserve-controller-manager-69fc866d76-7dssn\" (UID: \"4e1e4718-942f-40a8-8113-a8a601340670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:47:35.078472 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.078448 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:35.194422 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.194370 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:35.312404 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.312323 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:35.562558 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.562474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d542940-0b49-430f-a125-9aea1dbcb482-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gl5q9\" (UID: \"3d542940-0b49-430f-a125-9aea1dbcb482\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:47:35.562710 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.562561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e1e4718-942f-40a8-8113-a8a601340670-cert\") pod \"kserve-controller-manager-69fc866d76-7dssn\" (UID: \"4e1e4718-942f-40a8-8113-a8a601340670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:47:35.565042 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.565019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e1e4718-942f-40a8-8113-a8a601340670-cert\") pod \"kserve-controller-manager-69fc866d76-7dssn\" (UID: \"4e1e4718-942f-40a8-8113-a8a601340670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:47:35.565166 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.565085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d542940-0b49-430f-a125-9aea1dbcb482-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gl5q9\" (UID: \"3d542940-0b49-430f-a125-9aea1dbcb482\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:47:35.771967 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.771915 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:47:35.783440 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.783417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:47:35.898605 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.898573 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:35.926610 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.926576 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-7dssn"] Jun 09 14:47:35.927899 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:47:35.927865 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1e4718_942f_40a8_8113_a8a601340670.slice/crio-d3faf24cae34f9b56e32ef996b91385967c7327f05f5269c8e308b08d05743fc WatchSource:0}: Error finding container d3faf24cae34f9b56e32ef996b91385967c7327f05f5269c8e308b08d05743fc: Status 404 returned error can't find the container with id d3faf24cae34f9b56e32ef996b91385967c7327f05f5269c8e308b08d05743fc Jun 09 14:47:35.955873 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:35.955846 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9"] Jun 09 14:47:35.959803 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:47:35.959771 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3d542940_0b49_430f_a125_9aea1dbcb482.slice/crio-5582a3c75a9a7b00b45e7d5d2a80993864e085d284722ac302e45e7bc56e5595 WatchSource:0}: Error finding container 5582a3c75a9a7b00b45e7d5d2a80993864e085d284722ac302e45e7bc56e5595: Status 404 returned error can't find the container with id 5582a3c75a9a7b00b45e7d5d2a80993864e085d284722ac302e45e7bc56e5595 Jun 09 14:47:36.028207 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:36.028176 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:36.344887 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:36.344847 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" event={"ID":"3d542940-0b49-430f-a125-9aea1dbcb482","Type":"ContainerStarted","Data":"5582a3c75a9a7b00b45e7d5d2a80993864e085d284722ac302e45e7bc56e5595"} Jun 09 14:47:36.345919 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:36.345898 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" event={"ID":"4e1e4718-942f-40a8-8113-a8a601340670","Type":"ContainerStarted","Data":"d3faf24cae34f9b56e32ef996b91385967c7327f05f5269c8e308b08d05743fc"} Jun 09 14:47:37.762858 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:37.762815 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:38.035866 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:38.035762 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:38.240170 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:38.240133 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:38.402713 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:38.402680 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:39.363525 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:39.363488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" event={"ID":"4e1e4718-942f-40a8-8113-a8a601340670","Type":"ContainerStarted","Data":"efe4908643f0fcb7f4f8373c368cfc5d426eaecbcfaf92552f712a47478fe8e1"} Jun 09 14:47:39.363995 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:39.363703 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:47:39.402597 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:39.402543 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" podStartSLOduration=2.757909646 podStartE2EDuration="5.402527033s" totalImagesPullingTime="2.644617387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:39.401156739 +0000 UTC m=+638.754236587" watchObservedRunningTime="2026-06-09 14:47:39.402527033 +0000 UTC m=+638.755606851" Jun 09 14:47:39.991505 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:39.991479 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq"] Jun 09 14:47:39.996018 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:39.995999 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" Jun 09 14:47:39.999799 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:39.999783 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 14:47:39.999985 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:39.999966 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 14:47:40.000044 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.000031 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-mdmkj\"" Jun 09 14:47:40.011327 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.011303 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq"] Jun 09 14:47:40.102729 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.102700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3cf377a3-e754-44cb-803e-753e69b7b55e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-5wbqq\" (UID: \"3cf377a3-e754-44cb-803e-753e69b7b55e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" Jun 09 14:47:40.102907 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.102733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppf7p\" (UniqueName: \"kubernetes.io/projected/3cf377a3-e754-44cb-803e-753e69b7b55e-kube-api-access-ppf7p\") pod \"servicemesh-operator3-57f65f65fb-5wbqq\" (UID: \"3cf377a3-e754-44cb-803e-753e69b7b55e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" Jun 09 14:47:40.204350 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.204255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3cf377a3-e754-44cb-803e-753e69b7b55e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-5wbqq\" (UID: \"3cf377a3-e754-44cb-803e-753e69b7b55e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" Jun 09 14:47:40.204350 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.204310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppf7p\" (UniqueName: \"kubernetes.io/projected/3cf377a3-e754-44cb-803e-753e69b7b55e-kube-api-access-ppf7p\") pod \"servicemesh-operator3-57f65f65fb-5wbqq\" (UID: \"3cf377a3-e754-44cb-803e-753e69b7b55e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" Jun 09 14:47:40.207612 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.207582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3cf377a3-e754-44cb-803e-753e69b7b55e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-5wbqq\" (UID: \"3cf377a3-e754-44cb-803e-753e69b7b55e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" Jun 09 14:47:40.215014 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.214915 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppf7p\" (UniqueName: \"kubernetes.io/projected/3cf377a3-e754-44cb-803e-753e69b7b55e-kube-api-access-ppf7p\") pod \"servicemesh-operator3-57f65f65fb-5wbqq\" (UID: \"3cf377a3-e754-44cb-803e-753e69b7b55e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" Jun 09 14:47:40.305503 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.305456 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" Jun 09 14:47:40.320734 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.320709 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-s9ztb" Jun 09 14:47:40.323070 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.323052 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-sdpsw" Jun 09 14:47:40.377307 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.373785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" event={"ID":"3d542940-0b49-430f-a125-9aea1dbcb482","Type":"ContainerStarted","Data":"eadb044ca0845a936db7a366311d248ffffe404e9a0afbe9adc4ff4f939cc320"} Jun 09 14:47:40.377307 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.377112 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:47:40.414955 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.414645 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" podStartSLOduration=2.4927841920000002 podStartE2EDuration="6.414624276s" totalImagesPullingTime="3.921840084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:40.412641468 +0000 UTC m=+639.765721287" watchObservedRunningTime="2026-06-09 14:47:40.414624276 +0000 UTC m=+639.767704091" Jun 09 14:47:40.504974 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.504874 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq"] Jun 09 14:47:40.510164 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:47:40.510139 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf377a3_e754_44cb_803e_753e69b7b55e.slice/crio-3a62711bc83c44f69a3327b10ce35416e9a75ce62151d1a72efcb9dcc6637633 WatchSource:0}: Error finding container 3a62711bc83c44f69a3327b10ce35416e9a75ce62151d1a72efcb9dcc6637633: Status 404 returned error can't find the container with id 3a62711bc83c44f69a3327b10ce35416e9a75ce62151d1a72efcb9dcc6637633 Jun 09 14:47:40.612844 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.612815 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-577dcdc745-pdw5n"] Jun 09 14:47:40.617245 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.617226 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" Jun 09 14:47:40.628675 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.628652 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9knmg\"" Jun 09 14:47:40.628779 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.628683 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 14:47:40.640999 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.640974 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-577dcdc745-pdw5n"] Jun 09 14:47:40.673430 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.673403 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:40.711475 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.711436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/686cddc4-eca9-410c-a6f6-2aecfe0d082e-redirect-config\") pod \"dashboard-redirect-577dcdc745-pdw5n\" (UID: \"686cddc4-eca9-410c-a6f6-2aecfe0d082e\") " pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" Jun 09 14:47:40.711632 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.711546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t72nm\" (UniqueName: \"kubernetes.io/projected/686cddc4-eca9-410c-a6f6-2aecfe0d082e-kube-api-access-t72nm\") pod \"dashboard-redirect-577dcdc745-pdw5n\" (UID: \"686cddc4-eca9-410c-a6f6-2aecfe0d082e\") " pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" Jun 09 14:47:40.812461 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.812365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t72nm\" (UniqueName: \"kubernetes.io/projected/686cddc4-eca9-410c-a6f6-2aecfe0d082e-kube-api-access-t72nm\") pod \"dashboard-redirect-577dcdc745-pdw5n\" (UID: \"686cddc4-eca9-410c-a6f6-2aecfe0d082e\") " pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" Jun 09 14:47:40.812461 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.812457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/686cddc4-eca9-410c-a6f6-2aecfe0d082e-redirect-config\") pod \"dashboard-redirect-577dcdc745-pdw5n\" (UID: \"686cddc4-eca9-410c-a6f6-2aecfe0d082e\") " pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" Jun 09 14:47:40.813177 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.813153 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/686cddc4-eca9-410c-a6f6-2aecfe0d082e-redirect-config\") pod \"dashboard-redirect-577dcdc745-pdw5n\" (UID: \"686cddc4-eca9-410c-a6f6-2aecfe0d082e\") " pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" Jun 09 14:47:40.838054 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.838027 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t72nm\" (UniqueName: \"kubernetes.io/projected/686cddc4-eca9-410c-a6f6-2aecfe0d082e-kube-api-access-t72nm\") pod \"dashboard-redirect-577dcdc745-pdw5n\" (UID: \"686cddc4-eca9-410c-a6f6-2aecfe0d082e\") " pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" Jun 09 14:47:40.927316 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:40.927282 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" Jun 09 14:47:41.071206 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:41.071132 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-577dcdc745-pdw5n"] Jun 09 14:47:41.074252 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:47:41.074228 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686cddc4_eca9_410c_a6f6_2aecfe0d082e.slice/crio-48371794bf94368120ac9968632269e513e0ca253938515f7633909abfbab7db WatchSource:0}: Error finding container 48371794bf94368120ac9968632269e513e0ca253938515f7633909abfbab7db: Status 404 returned error can't find the container with id 48371794bf94368120ac9968632269e513e0ca253938515f7633909abfbab7db Jun 09 14:47:41.379121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:41.379091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" event={"ID":"686cddc4-eca9-410c-a6f6-2aecfe0d082e","Type":"ContainerStarted","Data":"48371794bf94368120ac9968632269e513e0ca253938515f7633909abfbab7db"} Jun 09 14:47:41.380593 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:41.380567 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" event={"ID":"3cf377a3-e754-44cb-803e-753e69b7b55e","Type":"ContainerStarted","Data":"3a62711bc83c44f69a3327b10ce35416e9a75ce62151d1a72efcb9dcc6637633"} Jun 09 14:47:44.400137 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:44.400109 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" event={"ID":"3cf377a3-e754-44cb-803e-753e69b7b55e","Type":"ContainerStarted","Data":"aff3c2ee5fa55719437deb27eca3de1be3373be85b336f10fef376b42737dbfe"} Jun 09 14:47:44.400521 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:44.400278 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" Jun 09 14:47:44.401589 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:44.401565 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" event={"ID":"686cddc4-eca9-410c-a6f6-2aecfe0d082e","Type":"ContainerStarted","Data":"05b21503d40c25bce7ab87e802473472cee2c4074d0b1d031e10f98edbbd8325"} Jun 09 14:47:44.450841 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:44.450778 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" podStartSLOduration=1.658865689 podStartE2EDuration="5.45075682s" totalImagesPullingTime="3.791891131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:44.448876831 +0000 UTC m=+643.801956651" watchObservedRunningTime="2026-06-09 14:47:44.45075682 +0000 UTC m=+643.803836639" Jun 09 14:47:44.474689 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:44.474641 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-577dcdc745-pdw5n" podStartSLOduration=1.250577791 podStartE2EDuration="4.474626923s" totalImagesPullingTime="3.224049132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:44.473281676 +0000 UTC m=+643.826361495" watchObservedRunningTime="2026-06-09 14:47:44.474626923 +0000 UTC m=+643.827706740" Jun 09 14:47:48.529087 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:48.529053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:48.624648 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:48.624614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:48.726262 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:48.726231 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:52.401617 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.401582 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d"] Jun 09 14:47:52.404717 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.404700 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.408172 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.408148 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 14:47:52.408448 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.408423 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 14:47:52.408448 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.408438 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 14:47:52.408605 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.408425 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 14:47:52.408605 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.408460 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xq7fh\"" Jun 09 14:47:52.410572 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.410546 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:52.421040 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.421021 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d"] Jun 09 14:47:52.497330 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.497301 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:52.512571 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.512541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.512718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.512586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.512718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.512609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd9hn\" (UniqueName: \"kubernetes.io/projected/2fbd69f1-c921-4168-bfb4-73c19f38da92-kube-api-access-bd9hn\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.512718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.512627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.512718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.512673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.512718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.512712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fbd69f1-c921-4168-bfb4-73c19f38da92-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.513000 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.512737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2fbd69f1-c921-4168-bfb4-73c19f38da92-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.613726 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.613684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.613906 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.613780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.613906 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.613829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd9hn\" (UniqueName: \"kubernetes.io/projected/2fbd69f1-c921-4168-bfb4-73c19f38da92-kube-api-access-bd9hn\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.614028 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.613964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.614028 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.614009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.614132 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.614047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fbd69f1-c921-4168-bfb4-73c19f38da92-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.614132 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.614082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2fbd69f1-c921-4168-bfb4-73c19f38da92-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.614746 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.614685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.616207 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.616185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.616366 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.616344 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2fbd69f1-c921-4168-bfb4-73c19f38da92-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.616640 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.616608 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fbd69f1-c921-4168-bfb4-73c19f38da92-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.616741 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.616665 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.622318 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.622279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fbd69f1-c921-4168-bfb4-73c19f38da92-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.622428 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.622356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd9hn\" (UniqueName: \"kubernetes.io/projected/2fbd69f1-c921-4168-bfb4-73c19f38da92-kube-api-access-bd9hn\") pod \"istiod-openshift-gateway-75c67f8887-qmf7d\" (UID: \"2fbd69f1-c921-4168-bfb4-73c19f38da92\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.714605 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.714512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:52.860889 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:52.858133 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d"] Jun 09 14:47:53.017124 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:53.017042 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:53.441728 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:53.441692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" event={"ID":"2fbd69f1-c921-4168-bfb4-73c19f38da92","Type":"ContainerStarted","Data":"27c98a30dc9b0b1c7e64caa8cccdd5c0a304fa60a00bb5afb5b173d9cf0cec50"} Jun 09 14:47:55.409807 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:55.409766 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5wbqq" Jun 09 14:47:55.563514 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:55.563476 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:47:55.563620 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:55.563546 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:47:56.218554 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:56.218524 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:56.329615 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:56.329575 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:56.460024 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:56.459987 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" event={"ID":"2fbd69f1-c921-4168-bfb4-73c19f38da92","Type":"ContainerStarted","Data":"18d83c412077fb982910a65c3860552722eb84ba64516a5d4b6571b131337286"} Jun 09 14:47:56.460440 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:56.460126 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:56.461829 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:56.461796 2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-qmf7d container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 14:47:56.461977 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:56.461854 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" podUID="2fbd69f1-c921-4168-bfb4-73c19f38da92" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 14:47:56.491083 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:56.490963 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" podStartSLOduration=1.7917275689999999 podStartE2EDuration="4.490940987s" totalImagesPullingTime="2.699213418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:47:56.488250715 +0000 UTC m=+655.841330546" watchObservedRunningTime="2026-06-09 14:47:56.490940987 +0000 UTC m=+655.844020803" Jun 09 14:47:56.552561 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:56.552528 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:56.933800 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:56.933767 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:57.358790 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:57.358761 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:47:57.466430 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:57.466405 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qmf7d" Jun 09 14:47:57.863013 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:47:57.862985 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:05.924852 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:05.924816 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:05.978196 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:05.978165 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:10.379719 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:10.379689 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-7dssn" Jun 09 14:48:10.647483 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:10.647387 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:10.747055 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:10.747019 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:11.382740 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:11.382711 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gl5q9" Jun 09 14:48:17.013946 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:17.013899 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:17.113107 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:17.113071 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:17.212782 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:17.212748 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:19.582491 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:19.582458 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:19.635066 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:19.635039 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:24.334771 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:24.334738 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:24.430996 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:24.430967 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:24.548296 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:24.548257 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:49.434268 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:49.434186 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:51.421783 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:51.421741 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:52.022450 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:52.022407 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:52.489110 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:52.489081 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:56.835570 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:56.835532 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:59.034635 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:59.034603 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:59.176918 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:59.176884 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:48:59.848179 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:48:59.848147 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:00.692611 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:00.692576 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:02.025720 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.025686 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g"] Jun 09 14:49:02.029136 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.029114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g" Jun 09 14:49:02.031201 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.031165 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 14:49:02.031380 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.031366 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 14:49:02.031999 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.031981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bghdp\"" Jun 09 14:49:02.032080 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.032012 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 14:49:02.044762 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.044742 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g"] Jun 09 14:49:02.111467 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.111436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5pq4\" (UniqueName: \"kubernetes.io/projected/3e7c2425-ea57-4290-91c3-8927001e746d-kube-api-access-j5pq4\") pod \"dns-operator-controller-manager-864dd78c4c-zqv4g\" (UID: \"3e7c2425-ea57-4290-91c3-8927001e746d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g" Jun 09 14:49:02.212652 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.212619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5pq4\" (UniqueName: \"kubernetes.io/projected/3e7c2425-ea57-4290-91c3-8927001e746d-kube-api-access-j5pq4\") pod \"dns-operator-controller-manager-864dd78c4c-zqv4g\" (UID: \"3e7c2425-ea57-4290-91c3-8927001e746d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g" Jun 09 14:49:02.225398 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.225375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5pq4\" (UniqueName: \"kubernetes.io/projected/3e7c2425-ea57-4290-91c3-8927001e746d-kube-api-access-j5pq4\") pod \"dns-operator-controller-manager-864dd78c4c-zqv4g\" (UID: \"3e7c2425-ea57-4290-91c3-8927001e746d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g" Jun 09 14:49:02.339763 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.339672 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g" Jun 09 14:49:02.488286 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.488254 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g"] Jun 09 14:49:02.491418 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:49:02.491391 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7c2425_ea57_4290_91c3_8927001e746d.slice/crio-17479653e20ff84b35bd259aecc0bec60c5d1b676064f1b90cb4ccd27249daed WatchSource:0}: Error finding container 17479653e20ff84b35bd259aecc0bec60c5d1b676064f1b90cb4ccd27249daed: Status 404 returned error can't find the container with id 17479653e20ff84b35bd259aecc0bec60c5d1b676064f1b90cb4ccd27249daed Jun 09 14:49:02.762257 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.762224 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g" event={"ID":"3e7c2425-ea57-4290-91c3-8927001e746d","Type":"ContainerStarted","Data":"17479653e20ff84b35bd259aecc0bec60c5d1b676064f1b90cb4ccd27249daed"} Jun 09 14:49:02.851779 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:02.851746 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:03.324218 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:03.324185 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:04.772891 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:04.772853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g" event={"ID":"3e7c2425-ea57-4290-91c3-8927001e746d","Type":"ContainerStarted","Data":"7cfc4c5b3f45ec680e44bb2b545d56fb570f7366c1951f65f188eaf877ab69a9"} Jun 09 14:49:04.773285 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:04.772949 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g" Jun 09 14:49:04.791352 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:04.791302 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g" podStartSLOduration=0.682009278 podStartE2EDuration="2.791283652s" totalImagesPullingTime="2.109274374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:49:04.790667969 +0000 UTC m=+724.143747788" watchObservedRunningTime="2026-06-09 14:49:04.791283652 +0000 UTC m=+724.144363473" Jun 09 14:49:06.573503 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:06.573471 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:08.435354 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:08.435320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:08.536036 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:08.536001 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:08.854001 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:08.853971 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:09.039569 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:09.039536 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:12.261648 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:12.261611 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:12.359511 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:12.359477 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:15.653128 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:15.653092 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:15.717851 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:15.717822 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:15.780423 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:15.780395 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zqv4g" Jun 09 14:49:18.122938 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:18.122889 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:18.456285 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:18.456200 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:19.590736 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:19.590701 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:19.689271 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:19.689243 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:27.451210 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:27.451175 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:27.551423 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:27.551391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:28.132100 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.132057 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:28.246874 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.246834 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:28.423279 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.423197 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244"] Jun 09 14:49:28.426667 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.426650 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" Jun 09 14:49:28.429429 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.429410 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6zqds\"" Jun 09 14:49:28.442068 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.442040 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244"] Jun 09 14:49:28.513334 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.513295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzjmc\" (UniqueName: \"kubernetes.io/projected/acfe5957-200a-43e2-815a-c1c2d8e62390-kube-api-access-wzjmc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sv244\" (UID: \"acfe5957-200a-43e2-815a-c1c2d8e62390\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" Jun 09 14:49:28.513718 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.513373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acfe5957-200a-43e2-815a-c1c2d8e62390-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sv244\" (UID: \"acfe5957-200a-43e2-815a-c1c2d8e62390\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" Jun 09 14:49:28.543857 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.543823 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244"] Jun 09 14:49:28.544116 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:49:28.544098 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-wzjmc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" podUID="acfe5957-200a-43e2-815a-c1c2d8e62390" Jun 09 14:49:28.578830 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.578799 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4"] Jun 09 14:49:28.582180 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.582160 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:28.596437 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.596415 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4"] Jun 09 14:49:28.614168 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.614143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzjmc\" (UniqueName: \"kubernetes.io/projected/acfe5957-200a-43e2-815a-c1c2d8e62390-kube-api-access-wzjmc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sv244\" (UID: \"acfe5957-200a-43e2-815a-c1c2d8e62390\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" Jun 09 14:49:28.614330 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.614186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r428n\" (UniqueName: \"kubernetes.io/projected/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-kube-api-access-r428n\") pod \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" (UID: \"1c35fd95-03fb-4bc3-a87d-aaac197ddce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:28.614330 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.614207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" (UID: \"1c35fd95-03fb-4bc3-a87d-aaac197ddce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:28.614456 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.614323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acfe5957-200a-43e2-815a-c1c2d8e62390-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sv244\" (UID: \"acfe5957-200a-43e2-815a-c1c2d8e62390\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" Jun 09 14:49:28.614709 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.614688 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acfe5957-200a-43e2-815a-c1c2d8e62390-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sv244\" (UID: \"acfe5957-200a-43e2-815a-c1c2d8e62390\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" Jun 09 14:49:28.630909 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.630884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzjmc\" (UniqueName: \"kubernetes.io/projected/acfe5957-200a-43e2-815a-c1c2d8e62390-kube-api-access-wzjmc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sv244\" (UID: \"acfe5957-200a-43e2-815a-c1c2d8e62390\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" Jun 09 14:49:28.715109 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.715025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r428n\" (UniqueName: \"kubernetes.io/projected/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-kube-api-access-r428n\") pod \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" (UID: \"1c35fd95-03fb-4bc3-a87d-aaac197ddce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:28.715109 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.715062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" (UID: \"1c35fd95-03fb-4bc3-a87d-aaac197ddce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:28.715454 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.715437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" (UID: \"1c35fd95-03fb-4bc3-a87d-aaac197ddce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:28.723464 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.723445 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r428n\" (UniqueName: \"kubernetes.io/projected/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-kube-api-access-r428n\") pod \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" (UID: \"1c35fd95-03fb-4bc3-a87d-aaac197ddce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:28.885384 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.885354 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" Jun 09 14:49:28.892345 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.892224 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:28.892490 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.892426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" Jun 09 14:49:28.916234 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.916202 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acfe5957-200a-43e2-815a-c1c2d8e62390-extensions-socket-volume\") pod \"acfe5957-200a-43e2-815a-c1c2d8e62390\" (UID: \"acfe5957-200a-43e2-815a-c1c2d8e62390\") " Jun 09 14:49:28.916401 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.916288 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzjmc\" (UniqueName: \"kubernetes.io/projected/acfe5957-200a-43e2-815a-c1c2d8e62390-kube-api-access-wzjmc\") pod \"acfe5957-200a-43e2-815a-c1c2d8e62390\" (UID: \"acfe5957-200a-43e2-815a-c1c2d8e62390\") " Jun 09 14:49:28.916503 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.916475 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfe5957-200a-43e2-815a-c1c2d8e62390-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "acfe5957-200a-43e2-815a-c1c2d8e62390" (UID: "acfe5957-200a-43e2-815a-c1c2d8e62390"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:49:28.916954 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.916915 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acfe5957-200a-43e2-815a-c1c2d8e62390-extensions-socket-volume\") on node \"ip-10-0-143-219.ec2.internal\" DevicePath \"\"" Jun 09 14:49:28.918652 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:28.918627 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfe5957-200a-43e2-815a-c1c2d8e62390-kube-api-access-wzjmc" (OuterVolumeSpecName: "kube-api-access-wzjmc") pod "acfe5957-200a-43e2-815a-c1c2d8e62390" (UID: "acfe5957-200a-43e2-815a-c1c2d8e62390"). InnerVolumeSpecName "kube-api-access-wzjmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:49:29.008522 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.008465 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4"] Jun 09 14:49:29.010399 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.010373 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4"] Jun 09 14:49:29.018242 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.018217 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzjmc\" (UniqueName: \"kubernetes.io/projected/acfe5957-200a-43e2-815a-c1c2d8e62390-kube-api-access-wzjmc\") on node \"ip-10-0-143-219.ec2.internal\" DevicePath \"\"" Jun 09 14:49:29.019103 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:49:29.019068 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c35fd95_03fb_4bc3_a87d_aaac197ddce3.slice/crio-7e9bf87acbad09aaa7bd0661cb66e1bddebd1263fa1907e6e195fb78dafae5d2 WatchSource:0}: Error finding container 7e9bf87acbad09aaa7bd0661cb66e1bddebd1263fa1907e6e195fb78dafae5d2: Status 404 returned error can't find the container with id 7e9bf87acbad09aaa7bd0661cb66e1bddebd1263fa1907e6e195fb78dafae5d2 Jun 09 14:49:29.029214 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.026671 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244"] Jun 09 14:49:29.033741 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.033712 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244"] Jun 09 14:49:29.035739 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.035713 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4"] Jun 09 14:49:29.040259 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.040240 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:29.054233 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.054208 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acfe5957-200a-43e2-815a-c1c2d8e62390" path="/var/lib/kubelet/pods/acfe5957-200a-43e2-815a-c1c2d8e62390/volumes" Jun 09 14:49:29.057532 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.057508 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4"] Jun 09 14:49:29.119388 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.119356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcx9n\" (UniqueName: \"kubernetes.io/projected/33d539c3-02db-49dd-81e4-f44694b18105-kube-api-access-hcx9n\") pod \"kuadrant-operator-controller-manager-55467d9f7-6mgn4\" (UID: \"33d539c3-02db-49dd-81e4-f44694b18105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:29.119545 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.119401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33d539c3-02db-49dd-81e4-f44694b18105-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6mgn4\" (UID: \"33d539c3-02db-49dd-81e4-f44694b18105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:29.220287 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.220250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcx9n\" (UniqueName: \"kubernetes.io/projected/33d539c3-02db-49dd-81e4-f44694b18105-kube-api-access-hcx9n\") pod \"kuadrant-operator-controller-manager-55467d9f7-6mgn4\" (UID: \"33d539c3-02db-49dd-81e4-f44694b18105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:29.220287 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.220291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33d539c3-02db-49dd-81e4-f44694b18105-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6mgn4\" (UID: \"33d539c3-02db-49dd-81e4-f44694b18105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:29.220659 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.220640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33d539c3-02db-49dd-81e4-f44694b18105-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6mgn4\" (UID: \"33d539c3-02db-49dd-81e4-f44694b18105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:29.229699 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.229668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcx9n\" (UniqueName: \"kubernetes.io/projected/33d539c3-02db-49dd-81e4-f44694b18105-kube-api-access-hcx9n\") pod \"kuadrant-operator-controller-manager-55467d9f7-6mgn4\" (UID: \"33d539c3-02db-49dd-81e4-f44694b18105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:29.352554 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.352486 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:29.524760 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.524721 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4"] Jun 09 14:49:29.528898 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:49:29.528867 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d539c3_02db_49dd_81e4_f44694b18105.slice/crio-74be29e853c06013009d268c11b8ba24ee2a8ab9cccd7d7c5f32da5dbb25733c WatchSource:0}: Error finding container 74be29e853c06013009d268c11b8ba24ee2a8ab9cccd7d7c5f32da5dbb25733c: Status 404 returned error can't find the container with id 74be29e853c06013009d268c11b8ba24ee2a8ab9cccd7d7c5f32da5dbb25733c Jun 09 14:49:29.894574 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.894539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sv244" Jun 09 14:49:29.894765 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:29.894531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" event={"ID":"33d539c3-02db-49dd-81e4-f44694b18105","Type":"ContainerStarted","Data":"74be29e853c06013009d268c11b8ba24ee2a8ab9cccd7d7c5f32da5dbb25733c"} Jun 09 14:49:31.628420 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:31.628368 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:31.730369 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:31.730333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:33.854017 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:33.853989 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:33.919603 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:33.919544 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" podUID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" containerName="manager" containerID="cri-o://479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649" gracePeriod=2 Jun 09 14:49:33.921083 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:33.921059 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" event={"ID":"33d539c3-02db-49dd-81e4-f44694b18105","Type":"ContainerStarted","Data":"a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35"} Jun 09 14:49:33.921260 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:33.921190 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:33.921679 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:49:33.921653 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" is forbidden: User \"system:node:ip-10-0-143-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-219.ec2.internal' and this object" podUID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:33.942903 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:33.942859 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" podStartSLOduration=1.045888401 podStartE2EDuration="4.942842698s" totalImagesPullingTime="3.896954297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:49:33.940650272 +0000 UTC m=+753.293730090" watchObservedRunningTime="2026-06-09 14:49:33.942842698 +0000 UTC m=+753.295922516" Jun 09 14:49:33.943290 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:49:33.943264 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" is forbidden: User \"system:node:ip-10-0-143-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-219.ec2.internal' and this object" podUID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:33.950062 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:33.950040 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:34.162446 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.162422 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:34.164303 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:49:34.164280 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" is forbidden: User \"system:node:ip-10-0-143-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-219.ec2.internal' and this object" podUID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:34.265360 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.265321 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-extensions-socket-volume\") pod \"1c35fd95-03fb-4bc3-a87d-aaac197ddce3\" (UID: \"1c35fd95-03fb-4bc3-a87d-aaac197ddce3\") " Jun 09 14:49:34.265360 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.265365 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r428n\" (UniqueName: \"kubernetes.io/projected/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-kube-api-access-r428n\") pod \"1c35fd95-03fb-4bc3-a87d-aaac197ddce3\" (UID: \"1c35fd95-03fb-4bc3-a87d-aaac197ddce3\") " Jun 09 14:49:34.265679 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.265653 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1c35fd95-03fb-4bc3-a87d-aaac197ddce3" (UID: "1c35fd95-03fb-4bc3-a87d-aaac197ddce3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:49:34.267616 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.267586 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-kube-api-access-r428n" (OuterVolumeSpecName: "kube-api-access-r428n") pod "1c35fd95-03fb-4bc3-a87d-aaac197ddce3" (UID: "1c35fd95-03fb-4bc3-a87d-aaac197ddce3"). InnerVolumeSpecName "kube-api-access-r428n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:49:34.366713 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.366673 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-extensions-socket-volume\") on node \"ip-10-0-143-219.ec2.internal\" DevicePath \"\"" Jun 09 14:49:34.366713 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.366705 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r428n\" (UniqueName: \"kubernetes.io/projected/1c35fd95-03fb-4bc3-a87d-aaac197ddce3-kube-api-access-r428n\") on node \"ip-10-0-143-219.ec2.internal\" DevicePath \"\"" Jun 09 14:49:34.927027 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.926994 2577 generic.go:356] "Generic (PLEG): container finished" podID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" containerID="479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649" exitCode=2 Jun 09 14:49:34.927502 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.927050 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:34.927502 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.927098 2577 scope.go:117] "RemoveContainer" containerID="479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649" Jun 09 14:49:34.929272 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:49:34.929243 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" is forbidden: User \"system:node:ip-10-0-143-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-219.ec2.internal' and this object" podUID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:34.936051 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.936030 2577 scope.go:117] "RemoveContainer" containerID="479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649" Jun 09 14:49:34.936331 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:49:34.936314 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649\": container with ID starting with 479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649 not found: ID does not exist" containerID="479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649" Jun 09 14:49:34.936395 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:34.936337 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649"} err="failed to get container status \"479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649\": rpc error: code = NotFound desc = could not find container \"479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649\": container with ID starting with 479fe3e064ae7915f9276990c4e35193b51f8722e1600b0eb2e403d11a376649 not found: ID does not exist" Jun 09 14:49:34.937627 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:49:34.937604 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4hnf4\" is forbidden: User \"system:node:ip-10-0-143-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-219.ec2.internal' and this object" podUID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4hnf4" Jun 09 14:49:35.053923 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:35.053891 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" path="/var/lib/kubelet/pods/1c35fd95-03fb-4bc3-a87d-aaac197ddce3/volumes" Jun 09 14:49:35.666637 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:35.666604 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:35.768070 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:35.768041 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:38.417473 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:38.417440 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:38.517252 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:38.517221 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:49:44.930056 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:44.930024 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:45.276010 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.275973 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx"] Jun 09 14:49:45.276448 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.276431 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" containerName="manager" Jun 09 14:49:45.276493 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.276453 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" containerName="manager" Jun 09 14:49:45.276573 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.276562 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c35fd95-03fb-4bc3-a87d-aaac197ddce3" containerName="manager" Jun 09 14:49:45.282715 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.282694 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" Jun 09 14:49:45.294409 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.294383 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx"] Jun 09 14:49:45.364121 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.364088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59xf2\" (UniqueName: \"kubernetes.io/projected/eccecd61-fcd2-4f00-968b-3a5475ef14c3-kube-api-access-59xf2\") pod \"kuadrant-operator-controller-manager-86878c769f-g4hsx\" (UID: \"eccecd61-fcd2-4f00-968b-3a5475ef14c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" Jun 09 14:49:45.364313 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.364140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eccecd61-fcd2-4f00-968b-3a5475ef14c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g4hsx\" (UID: \"eccecd61-fcd2-4f00-968b-3a5475ef14c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" Jun 09 14:49:45.465031 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.464921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59xf2\" (UniqueName: \"kubernetes.io/projected/eccecd61-fcd2-4f00-968b-3a5475ef14c3-kube-api-access-59xf2\") pod \"kuadrant-operator-controller-manager-86878c769f-g4hsx\" (UID: \"eccecd61-fcd2-4f00-968b-3a5475ef14c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" Jun 09 14:49:45.465031 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.465003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eccecd61-fcd2-4f00-968b-3a5475ef14c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g4hsx\" (UID: \"eccecd61-fcd2-4f00-968b-3a5475ef14c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" Jun 09 14:49:45.465331 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.465315 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eccecd61-fcd2-4f00-968b-3a5475ef14c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-g4hsx\" (UID: \"eccecd61-fcd2-4f00-968b-3a5475ef14c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" Jun 09 14:49:45.475462 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.475437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59xf2\" (UniqueName: \"kubernetes.io/projected/eccecd61-fcd2-4f00-968b-3a5475ef14c3-kube-api-access-59xf2\") pod \"kuadrant-operator-controller-manager-86878c769f-g4hsx\" (UID: \"eccecd61-fcd2-4f00-968b-3a5475ef14c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" Jun 09 14:49:45.592917 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.592878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" Jun 09 14:49:45.735221 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.735195 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx"] Jun 09 14:49:45.737893 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:49:45.737870 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeccecd61_fcd2_4f00_968b_3a5475ef14c3.slice/crio-68198a54efda39017f4afac6022a9bf0f1ab699307a558f062c6894248e4e6be WatchSource:0}: Error finding container 68198a54efda39017f4afac6022a9bf0f1ab699307a558f062c6894248e4e6be: Status 404 returned error can't find the container with id 68198a54efda39017f4afac6022a9bf0f1ab699307a558f062c6894248e4e6be Jun 09 14:49:45.986977 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.986875 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" event={"ID":"eccecd61-fcd2-4f00-968b-3a5475ef14c3","Type":"ContainerStarted","Data":"725a9499a2043ebaba61b24f9aa2a6ef27f6e7beb1bb26b65b6259066ad53c36"} Jun 09 14:49:45.986977 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.986951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" event={"ID":"eccecd61-fcd2-4f00-968b-3a5475ef14c3","Type":"ContainerStarted","Data":"68198a54efda39017f4afac6022a9bf0f1ab699307a558f062c6894248e4e6be"} Jun 09 14:49:45.987367 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:45.986992 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" Jun 09 14:49:46.007072 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:46.007023 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" podStartSLOduration=1.007005165 podStartE2EDuration="1.007005165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:49:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:49:46.004738315 +0000 UTC m=+765.357818133" watchObservedRunningTime="2026-06-09 14:49:46.007005165 +0000 UTC m=+765.360084984" Jun 09 14:49:56.995420 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:56.995391 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-g4hsx" Jun 09 14:49:57.044432 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:57.044393 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4"] Jun 09 14:49:57.044665 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:57.044642 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" podUID="33d539c3-02db-49dd-81e4-f44694b18105" containerName="manager" containerID="cri-o://a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35" gracePeriod=10 Jun 09 14:49:57.300025 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:57.300002 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:57.470120 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:57.470083 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33d539c3-02db-49dd-81e4-f44694b18105-extensions-socket-volume\") pod \"33d539c3-02db-49dd-81e4-f44694b18105\" (UID: \"33d539c3-02db-49dd-81e4-f44694b18105\") " Jun 09 14:49:57.470299 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:57.470187 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcx9n\" (UniqueName: \"kubernetes.io/projected/33d539c3-02db-49dd-81e4-f44694b18105-kube-api-access-hcx9n\") pod \"33d539c3-02db-49dd-81e4-f44694b18105\" (UID: \"33d539c3-02db-49dd-81e4-f44694b18105\") " Jun 09 14:49:57.470578 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:57.470552 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33d539c3-02db-49dd-81e4-f44694b18105-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "33d539c3-02db-49dd-81e4-f44694b18105" (UID: "33d539c3-02db-49dd-81e4-f44694b18105"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:49:57.472389 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:57.472366 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33d539c3-02db-49dd-81e4-f44694b18105-kube-api-access-hcx9n" (OuterVolumeSpecName: "kube-api-access-hcx9n") pod "33d539c3-02db-49dd-81e4-f44694b18105" (UID: "33d539c3-02db-49dd-81e4-f44694b18105"). InnerVolumeSpecName "kube-api-access-hcx9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:49:57.571153 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:57.571065 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33d539c3-02db-49dd-81e4-f44694b18105-extensions-socket-volume\") on node \"ip-10-0-143-219.ec2.internal\" DevicePath \"\"" Jun 09 14:49:57.571153 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:57.571095 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcx9n\" (UniqueName: \"kubernetes.io/projected/33d539c3-02db-49dd-81e4-f44694b18105-kube-api-access-hcx9n\") on node \"ip-10-0-143-219.ec2.internal\" DevicePath \"\"" Jun 09 14:49:58.047796 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:58.047764 2577 generic.go:356] "Generic (PLEG): container finished" podID="33d539c3-02db-49dd-81e4-f44694b18105" containerID="a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35" exitCode=0 Jun 09 14:49:58.048290 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:58.047802 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" Jun 09 14:49:58.048290 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:58.047843 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" event={"ID":"33d539c3-02db-49dd-81e4-f44694b18105","Type":"ContainerDied","Data":"a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35"} Jun 09 14:49:58.048290 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:58.047901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4" event={"ID":"33d539c3-02db-49dd-81e4-f44694b18105","Type":"ContainerDied","Data":"74be29e853c06013009d268c11b8ba24ee2a8ab9cccd7d7c5f32da5dbb25733c"} Jun 09 14:49:58.048290 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:58.047959 2577 scope.go:117] "RemoveContainer" containerID="a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35" Jun 09 14:49:58.057361 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:58.057345 2577 scope.go:117] "RemoveContainer" containerID="a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35" Jun 09 14:49:58.057607 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:49:58.057589 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35\": container with ID starting with a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35 not found: ID does not exist" containerID="a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35" Jun 09 14:49:58.057666 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:58.057618 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35"} err="failed to get container status \"a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35\": rpc error: code = NotFound desc = could not find container \"a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35\": container with ID starting with a4954baf2a5874be8ab0855496f1d457c5b863e8fae5c569956072a32a52db35 not found: ID does not exist" Jun 09 14:49:58.072154 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:58.072132 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4"] Jun 09 14:49:58.076579 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:58.076557 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6mgn4"] Jun 09 14:49:59.053007 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:49:59.052969 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33d539c3-02db-49dd-81e4-f44694b18105" path="/var/lib/kubelet/pods/33d539c3-02db-49dd-81e4-f44694b18105/volumes" Jun 09 14:50:01.332419 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:01.332389 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:01.391178 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:01.391141 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:05.041965 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:05.041915 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:13.896869 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:13.896826 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:14.016771 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.016742 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:14.075502 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.075469 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:14.314988 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.314906 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:50:14.315301 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.315289 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33d539c3-02db-49dd-81e4-f44694b18105" containerName="manager" Jun 09 14:50:14.315342 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.315302 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="33d539c3-02db-49dd-81e4-f44694b18105" containerName="manager" Jun 09 14:50:14.315383 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.315374 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="33d539c3-02db-49dd-81e4-f44694b18105" containerName="manager" Jun 09 14:50:14.319413 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.319389 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" Jun 09 14:50:14.321283 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.321261 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kxnd5\"" Jun 09 14:50:14.321385 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.321263 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 14:50:14.328487 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.328465 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:50:14.357745 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.357708 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:50:14.415334 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.415294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09b83f21-3d43-4c03-ad6c-b5ee5783b2cd-config-file\") pod \"limitador-limitador-54d6d988d5-lsq6b\" (UID: \"09b83f21-3d43-4c03-ad6c-b5ee5783b2cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" Jun 09 14:50:14.415334 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.415334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvwpp\" (UniqueName: \"kubernetes.io/projected/09b83f21-3d43-4c03-ad6c-b5ee5783b2cd-kube-api-access-jvwpp\") pod \"limitador-limitador-54d6d988d5-lsq6b\" (UID: \"09b83f21-3d43-4c03-ad6c-b5ee5783b2cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" Jun 09 14:50:14.516120 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.516088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09b83f21-3d43-4c03-ad6c-b5ee5783b2cd-config-file\") pod \"limitador-limitador-54d6d988d5-lsq6b\" (UID: \"09b83f21-3d43-4c03-ad6c-b5ee5783b2cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" Jun 09 14:50:14.516120 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.516124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvwpp\" (UniqueName: \"kubernetes.io/projected/09b83f21-3d43-4c03-ad6c-b5ee5783b2cd-kube-api-access-jvwpp\") pod \"limitador-limitador-54d6d988d5-lsq6b\" (UID: \"09b83f21-3d43-4c03-ad6c-b5ee5783b2cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" Jun 09 14:50:14.516717 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.516683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/09b83f21-3d43-4c03-ad6c-b5ee5783b2cd-config-file\") pod \"limitador-limitador-54d6d988d5-lsq6b\" (UID: \"09b83f21-3d43-4c03-ad6c-b5ee5783b2cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" Jun 09 14:50:14.523696 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.523668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvwpp\" (UniqueName: \"kubernetes.io/projected/09b83f21-3d43-4c03-ad6c-b5ee5783b2cd-kube-api-access-jvwpp\") pod \"limitador-limitador-54d6d988d5-lsq6b\" (UID: \"09b83f21-3d43-4c03-ad6c-b5ee5783b2cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" Jun 09 14:50:14.629913 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.629881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" Jun 09 14:50:14.780858 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.780800 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:50:14.783486 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:50:14.783459 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b83f21_3d43_4c03_ad6c_b5ee5783b2cd.slice/crio-579356fa55e12dcd0bd4613a7091c14ef17331e87aa6a15df723057f15060fde WatchSource:0}: Error finding container 579356fa55e12dcd0bd4613a7091c14ef17331e87aa6a15df723057f15060fde: Status 404 returned error can't find the container with id 579356fa55e12dcd0bd4613a7091c14ef17331e87aa6a15df723057f15060fde Jun 09 14:50:14.885594 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.885507 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:14.940881 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:14.940851 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:15.131170 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:15.131131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" event={"ID":"09b83f21-3d43-4c03-ad6c-b5ee5783b2cd","Type":"ContainerStarted","Data":"579356fa55e12dcd0bd4613a7091c14ef17331e87aa6a15df723057f15060fde"} Jun 09 14:50:18.147734 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:18.147701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" event={"ID":"09b83f21-3d43-4c03-ad6c-b5ee5783b2cd","Type":"ContainerStarted","Data":"f953cc07db1515447c813762bb5379cb67c592dfd1d7c3e939f6d3d9cd3c1cf3"} Jun 09 14:50:18.148156 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:18.147794 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" Jun 09 14:50:18.166191 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:18.166139 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" podStartSLOduration=1.779625561 podStartE2EDuration="4.166120238s" totalImagesPullingTime="2.386494677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:50:18.165394338 +0000 UTC m=+797.518474150" watchObservedRunningTime="2026-06-09 14:50:18.166120238 +0000 UTC m=+797.519200059" Jun 09 14:50:29.153664 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:29.153586 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsq6b" Jun 09 14:50:31.894568 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:31.894532 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:46.117864 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:46.117828 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:46.218693 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:46.218656 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:50:46.382111 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:50:46.382030 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:12.757071 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:12.757031 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:12.859832 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:12.859798 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:43.371991 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:43.371951 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:43.727918 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:43.727828 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:45.854422 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:45.854390 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:49.076554 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:49.076465 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:49.255766 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:49.255731 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:49.386259 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:49.386220 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:49.492025 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:49.491990 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:52.673236 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:52.673198 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:51:52.777487 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:51:52.777452 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:52:23.636411 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:23.636378 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:52:24.283236 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.283201 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:52:24.362146 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.362108 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qrq9w"] Jun 09 14:52:24.365442 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.365422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:52:24.369534 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.369498 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 14:52:24.369663 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.369629 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-scf6z\"" Jun 09 14:52:24.373637 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.373612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k89s8\" (UniqueName: \"kubernetes.io/projected/5a5e9e52-e78f-4859-b7a6-39763276af81-kube-api-access-k89s8\") pod \"payload-processing-7c6c859784-qrq9w\" (UID: \"5a5e9e52-e78f-4859-b7a6-39763276af81\") " pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:52:24.384080 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.384058 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qrq9w"] Jun 09 14:52:24.474425 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.474393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k89s8\" (UniqueName: \"kubernetes.io/projected/5a5e9e52-e78f-4859-b7a6-39763276af81-kube-api-access-k89s8\") pod \"payload-processing-7c6c859784-qrq9w\" (UID: \"5a5e9e52-e78f-4859-b7a6-39763276af81\") " pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:52:24.482691 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.482664 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k89s8\" (UniqueName: \"kubernetes.io/projected/5a5e9e52-e78f-4859-b7a6-39763276af81-kube-api-access-k89s8\") pod \"payload-processing-7c6c859784-qrq9w\" (UID: \"5a5e9e52-e78f-4859-b7a6-39763276af81\") " pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:52:24.676346 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.676311 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:52:24.684445 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.684406 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:52:24.813756 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.813717 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qrq9w"] Jun 09 14:52:24.817734 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:52:24.817700 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5e9e52_e78f_4859_b7a6_39763276af81.slice/crio-5ebe977caea8bfda9eaa3d47b65e6195fb138ded1551b671c25c1fc3c6aade2c WatchSource:0}: Error finding container 5ebe977caea8bfda9eaa3d47b65e6195fb138ded1551b671c25c1fc3c6aade2c: Status 404 returned error can't find the container with id 5ebe977caea8bfda9eaa3d47b65e6195fb138ded1551b671c25c1fc3c6aade2c Jun 09 14:52:24.819656 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:24.819638 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:52:25.764815 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:25.764770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerStarted","Data":"5ebe977caea8bfda9eaa3d47b65e6195fb138ded1551b671c25c1fc3c6aade2c"} Jun 09 14:52:27.777805 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:27.777762 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerStarted","Data":"b1e920690ef94fce62ad76260b8580a3267da6a540b0ff15a3e2098c427db6c6"} Jun 09 14:52:27.778200 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:27.777894 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:52:27.799217 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:27.799166 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podStartSLOduration=1.54175211 podStartE2EDuration="3.799140907s" totalImagesPullingTime="2.257388797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:52:27.797611474 +0000 UTC m=+927.150691291" watchObservedRunningTime="2026-06-09 14:52:27.799140907 +0000 UTC m=+927.152220724" Jun 09 14:52:38.784779 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:52:38.784747 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:53:15.340387 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:53:15.340352 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:53:15.439524 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:53:15.439491 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:53:25.488341 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:53:25.488252 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:53:25.863971 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:53:25.863938 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:53:43.359495 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:53:43.359461 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:53:51.929741 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:53:51.929701 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:53:52.472004 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:53:52.471960 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:54:06.504778 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:06.504740 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:54:07.067787 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:07.067751 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:54:10.687543 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:10.687509 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:54:12.656890 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.656852 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f"] Jun 09 14:54:12.665304 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.665261 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.668207 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.668096 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 14:54:12.668450 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.668409 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gdgs5\"" Jun 09 14:54:12.668580 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.668464 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 14:54:12.668655 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.668633 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 14:54:12.669969 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.669920 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f"] Jun 09 14:54:12.696992 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.696964 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:54:12.724756 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.724730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d0743e4-8f87-4013-b72d-a05c705ccbc7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.724873 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.724770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.724873 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.724797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.724966 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.724867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.724966 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.724905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.724966 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.724943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqv8c\" (UniqueName: \"kubernetes.io/projected/1d0743e4-8f87-4013-b72d-a05c705ccbc7-kube-api-access-sqv8c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.825555 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.825521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.825713 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.825568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.825713 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.825603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.825713 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.825640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.825713 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.825670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqv8c\" (UniqueName: \"kubernetes.io/projected/1d0743e4-8f87-4013-b72d-a05c705ccbc7-kube-api-access-sqv8c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.825892 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.825724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d0743e4-8f87-4013-b72d-a05c705ccbc7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.826180 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.826145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.826302 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.826156 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.826302 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.826195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.827876 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.827853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d0743e4-8f87-4013-b72d-a05c705ccbc7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.828240 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.828223 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d0743e4-8f87-4013-b72d-a05c705ccbc7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.833859 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.833834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqv8c\" (UniqueName: \"kubernetes.io/projected/1d0743e4-8f87-4013-b72d-a05c705ccbc7-kube-api-access-sqv8c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f\" (UID: \"1d0743e4-8f87-4013-b72d-a05c705ccbc7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:12.978347 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:12.978245 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" Jun 09 14:54:13.136915 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:13.136882 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f"] Jun 09 14:54:13.141033 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:54:13.140999 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d0743e4_8f87_4013_b72d_a05c705ccbc7.slice/crio-391846adb8ce02e20375c3d897f92a0391e296c509bfd4472c314f2ac04778cd WatchSource:0}: Error finding container 391846adb8ce02e20375c3d897f92a0391e296c509bfd4472c314f2ac04778cd: Status 404 returned error can't find the container with id 391846adb8ce02e20375c3d897f92a0391e296c509bfd4472c314f2ac04778cd Jun 09 14:54:13.274861 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:13.274776 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:54:13.286639 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:13.286606 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" event={"ID":"1d0743e4-8f87-4013-b72d-a05c705ccbc7","Type":"ContainerStarted","Data":"391846adb8ce02e20375c3d897f92a0391e296c509bfd4472c314f2ac04778cd"} Jun 09 14:54:18.316700 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:18.316669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f" event={"ID":"1d0743e4-8f87-4013-b72d-a05c705ccbc7","Type":"ContainerStarted","Data":"50a40f042a633b39aa9478a22b20b56303292d16c5650eee5cded51696502813"} Jun 09 14:54:22.968464 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:22.968422 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:54:23.670996 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:23.670966 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:54:27.362695 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:27.362665 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a5e9e52-e78f-4859-b7a6-39763276af81" containerID="b1e920690ef94fce62ad76260b8580a3267da6a540b0ff15a3e2098c427db6c6" exitCode=1 Jun 09 14:54:27.363111 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:27.362725 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerDied","Data":"b1e920690ef94fce62ad76260b8580a3267da6a540b0ff15a3e2098c427db6c6"} Jun 09 14:54:27.363111 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:27.363056 2577 scope.go:117] "RemoveContainer" containerID="b1e920690ef94fce62ad76260b8580a3267da6a540b0ff15a3e2098c427db6c6" Jun 09 14:54:28.369642 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:28.369609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerStarted","Data":"489b4de9c8188a2a9bcd5d4c8ab9ee86ef2dd51f41ea5bed952dbe818e1bf4c5"} Jun 09 14:54:28.370051 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:28.369854 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:54:39.377023 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:39.376987 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:54:48.556185 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.556152 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f"] Jun 09 14:54:48.573571 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.573544 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f"] Jun 09 14:54:48.573711 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.573647 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.578039 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.577996 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 09 14:54:48.600480 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.600440 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:54:48.647064 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.647036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.647235 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.647089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.647235 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.647200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.647353 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.647250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1f463cf-bbf0-48a3-9b8c-5306ec170530-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.647353 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.647294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.647353 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.647321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb5lj\" (UniqueName: \"kubernetes.io/projected/e1f463cf-bbf0-48a3-9b8c-5306ec170530-kube-api-access-hb5lj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.747892 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.747855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1f463cf-bbf0-48a3-9b8c-5306ec170530-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.748086 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.747901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.748086 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.747920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb5lj\" (UniqueName: \"kubernetes.io/projected/e1f463cf-bbf0-48a3-9b8c-5306ec170530-kube-api-access-hb5lj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.748086 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.747965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.748256 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.748156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.748316 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.748255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.748390 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.748366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.748478 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.748459 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.748569 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.748528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.750285 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.750261 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1f463cf-bbf0-48a3-9b8c-5306ec170530-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.750747 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.750726 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1f463cf-bbf0-48a3-9b8c-5306ec170530-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.755531 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.755496 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb5lj\" (UniqueName: \"kubernetes.io/projected/e1f463cf-bbf0-48a3-9b8c-5306ec170530-kube-api-access-hb5lj\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-thn9f\" (UID: \"e1f463cf-bbf0-48a3-9b8c-5306ec170530\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:48.884432 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:48.884405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:49.032269 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:49.032243 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f"] Jun 09 14:54:49.034891 ip-10-0-143-219 kubenswrapper[2577]: W0609 14:54:49.034850 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f463cf_bbf0_48a3_9b8c_5306ec170530.slice/crio-f9fcfc266c370a4e4638e596864fe8e0065dd5a2d99b5edd9ff1c21e8238cdb0 WatchSource:0}: Error finding container f9fcfc266c370a4e4638e596864fe8e0065dd5a2d99b5edd9ff1c21e8238cdb0: Status 404 returned error can't find the container with id f9fcfc266c370a4e4638e596864fe8e0065dd5a2d99b5edd9ff1c21e8238cdb0 Jun 09 14:54:49.372910 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:49.372875 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:54:49.488336 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:49.488295 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" event={"ID":"e1f463cf-bbf0-48a3-9b8c-5306ec170530","Type":"ContainerStarted","Data":"bb73ab58f500cf34f78d9e93330cce072489dd17eea9c096ab1b6c0c5cbccd46"} Jun 09 14:54:49.488500 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:49.488350 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" event={"ID":"e1f463cf-bbf0-48a3-9b8c-5306ec170530","Type":"ContainerStarted","Data":"f9fcfc266c370a4e4638e596864fe8e0065dd5a2d99b5edd9ff1c21e8238cdb0"} Jun 09 14:54:50.494371 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:50.494340 2577 generic.go:356] "Generic (PLEG): container finished" podID="e1f463cf-bbf0-48a3-9b8c-5306ec170530" containerID="bb73ab58f500cf34f78d9e93330cce072489dd17eea9c096ab1b6c0c5cbccd46" exitCode=0 Jun 09 14:54:50.494847 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:50.494395 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" event={"ID":"e1f463cf-bbf0-48a3-9b8c-5306ec170530","Type":"ContainerDied","Data":"bb73ab58f500cf34f78d9e93330cce072489dd17eea9c096ab1b6c0c5cbccd46"} Jun 09 14:54:52.506891 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:52.506850 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" event={"ID":"e1f463cf-bbf0-48a3-9b8c-5306ec170530","Type":"ContainerStarted","Data":"a6e094c8db386f823eb9c6c6fc4877425c38cbabc4a452a90f8f2579549fe61d"} Jun 09 14:54:52.523334 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:52.523277 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" podStartSLOduration=2.162186708 podStartE2EDuration="4.523257803s" totalImagesPullingTime="1.109288387s" totalInitContainerRuntime="1.251782708s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:52.522987453 +0000 UTC m=+1071.876067272" watchObservedRunningTime="2026-06-09 14:54:52.523257803 +0000 UTC m=+1071.876337622" Jun 09 14:54:58.884991 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:58.884922 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:58.885494 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:58.885013 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:58.897583 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:58.897557 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:54:59.551023 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:54:59.550990 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-thn9f" Jun 09 14:55:10.282044 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:55:10.282006 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:55:10.381903 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:55:10.381876 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:55:17.309369 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:55:17.309333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:55:40.877447 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:55:40.877414 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:55:51.181337 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:55:51.181294 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:55:51.291767 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:55:51.291721 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:55:52.319598 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:55:52.319567 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:55:52.415206 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:55:52.415171 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:56:27.971789 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:27.971752 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a5e9e52-e78f-4859-b7a6-39763276af81" containerID="489b4de9c8188a2a9bcd5d4c8ab9ee86ef2dd51f41ea5bed952dbe818e1bf4c5" exitCode=1 Jun 09 14:56:27.972310 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:27.971824 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerDied","Data":"489b4de9c8188a2a9bcd5d4c8ab9ee86ef2dd51f41ea5bed952dbe818e1bf4c5"} Jun 09 14:56:27.972310 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:27.971884 2577 scope.go:117] "RemoveContainer" containerID="b1e920690ef94fce62ad76260b8580a3267da6a540b0ff15a3e2098c427db6c6" Jun 09 14:56:27.972310 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:27.972194 2577 scope.go:117] "RemoveContainer" containerID="489b4de9c8188a2a9bcd5d4c8ab9ee86ef2dd51f41ea5bed952dbe818e1bf4c5" Jun 09 14:56:27.972470 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:56:27.972446 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 14:56:29.375203 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:29.375169 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:56:29.375590 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:29.375488 2577 scope.go:117] "RemoveContainer" containerID="489b4de9c8188a2a9bcd5d4c8ab9ee86ef2dd51f41ea5bed952dbe818e1bf4c5" Jun 09 14:56:29.375702 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:56:29.375682 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 14:56:31.798203 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:31.798172 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:56:33.767023 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:33.766986 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:56:37.869986 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:37.869951 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:56:44.048142 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:44.048109 2577 scope.go:117] "RemoveContainer" containerID="489b4de9c8188a2a9bcd5d4c8ab9ee86ef2dd51f41ea5bed952dbe818e1bf4c5" Jun 09 14:56:44.473974 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:44.473916 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:56:44.677332 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:44.677288 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:56:45.059371 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:45.059329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerStarted","Data":"ee9a7543717011063525c8e946d52582c243316ac9d167d7f637d8878a8846ae"} Jun 09 14:56:45.059769 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:45.059473 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:56:52.970785 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:52.970745 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:56:56.065729 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:56:56.065701 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:57:03.865128 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:57:03.865092 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:57:12.365648 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:57:12.365606 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:57:22.765525 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:57:22.765485 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:57:30.829073 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:57:30.829035 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:57:32.153727 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:57:32.153693 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:57:57.689164 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:57:57.689130 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:58:02.063775 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:02.063737 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:58:07.371377 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:07.371332 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:58:10.157030 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:10.156990 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:58:15.416635 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:15.416596 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:58:15.512413 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:15.512372 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:58:23.978536 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:23.978498 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:58:30.087542 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:30.087485 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:58:30.163439 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:30.163411 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:58:38.983358 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:38.983321 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:58:44.644772 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:44.644741 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a5e9e52-e78f-4859-b7a6-39763276af81" containerID="ee9a7543717011063525c8e946d52582c243316ac9d167d7f637d8878a8846ae" exitCode=1 Jun 09 14:58:44.645202 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:44.644809 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerDied","Data":"ee9a7543717011063525c8e946d52582c243316ac9d167d7f637d8878a8846ae"} Jun 09 14:58:44.645202 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:44.644869 2577 scope.go:117] "RemoveContainer" containerID="489b4de9c8188a2a9bcd5d4c8ab9ee86ef2dd51f41ea5bed952dbe818e1bf4c5" Jun 09 14:58:44.645202 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:44.645162 2577 scope.go:117] "RemoveContainer" containerID="ee9a7543717011063525c8e946d52582c243316ac9d167d7f637d8878a8846ae" Jun 09 14:58:44.645375 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:58:44.645356 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 14:58:44.676550 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:44.676522 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:58:45.652837 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:45.652812 2577 scope.go:117] "RemoveContainer" containerID="ee9a7543717011063525c8e946d52582c243316ac9d167d7f637d8878a8846ae" Jun 09 14:58:45.653241 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:58:45.653022 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 14:58:46.065312 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:46.065232 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:58:46.657367 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:46.657341 2577 scope.go:117] "RemoveContainer" containerID="ee9a7543717011063525c8e946d52582c243316ac9d167d7f637d8878a8846ae" Jun 09 14:58:46.657779 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:58:46.657521 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 14:58:55.168907 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:55.168870 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:58:58.047764 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:58:58.047733 2577 scope.go:117] "RemoveContainer" containerID="ee9a7543717011063525c8e946d52582c243316ac9d167d7f637d8878a8846ae" Jun 09 14:58:58.048164 ip-10-0-143-219 kubenswrapper[2577]: E0609 14:58:58.047988 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 14:59:02.239598 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:02.239562 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:02.328843 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:02.328800 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:11.049460 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:11.049430 2577 scope.go:117] "RemoveContainer" containerID="ee9a7543717011063525c8e946d52582c243316ac9d167d7f637d8878a8846ae" Jun 09 14:59:11.781325 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:11.781293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerStarted","Data":"1245e8ce4dd9724e6f58b8f8d9f28f7f0056ef610a2098ed1be1b3345da9de81"} Jun 09 14:59:11.781538 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:11.781516 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:59:22.787831 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:22.787752 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 14:59:26.274200 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:26.274166 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:31.862048 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:31.862011 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:31.963479 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:31.963444 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:32.062298 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:32.062253 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:32.234762 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:32.234679 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:32.325144 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:32.325105 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:33.259148 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:33.259118 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:59:48.921682 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:48.921630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:49.025257 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:49.025230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:49.205027 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:49.204917 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:50.508498 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:50.508462 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 14:59:55.193555 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:55.193518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 14:59:55.265693 ip-10-0-143-219 kubenswrapper[2577]: I0609 14:59:55.265658 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:03.374469 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:03.374426 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:03.471462 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:03.471434 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:03.565475 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:03.565439 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:03.670511 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:03.670431 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:04.663823 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:04.663786 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:00:20.159798 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:20.159759 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:00:20.230724 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:20.230690 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:20.359880 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:20.359848 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:20.492238 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:20.492155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:23.176450 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:23.176414 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:00:26.428230 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:26.428194 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:26.522102 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:26.522051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:48.264618 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:48.264585 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:48.353657 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:48.353623 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:53.754368 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:53.754282 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:53.855658 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:53.855614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:53.955552 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:53.955518 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:54.182740 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:54.182711 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:59.812759 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:59.812727 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:00:59.887053 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:00:59.887016 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:01:00.668143 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:00.668109 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:01:04.163572 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:04.163531 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:01:11.356182 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:11.356150 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a5e9e52-e78f-4859-b7a6-39763276af81" containerID="1245e8ce4dd9724e6f58b8f8d9f28f7f0056ef610a2098ed1be1b3345da9de81" exitCode=1 Jun 09 15:01:11.356605 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:11.356223 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerDied","Data":"1245e8ce4dd9724e6f58b8f8d9f28f7f0056ef610a2098ed1be1b3345da9de81"} Jun 09 15:01:11.356605 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:11.356284 2577 scope.go:117] "RemoveContainer" containerID="ee9a7543717011063525c8e946d52582c243316ac9d167d7f637d8878a8846ae" Jun 09 15:01:11.356605 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:11.356595 2577 scope.go:117] "RemoveContainer" containerID="1245e8ce4dd9724e6f58b8f8d9f28f7f0056ef610a2098ed1be1b3345da9de81" Jun 09 15:01:11.356831 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:01:11.356811 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:01:12.786435 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:12.786398 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 15:01:12.786856 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:12.786729 2577 scope.go:117] "RemoveContainer" containerID="1245e8ce4dd9724e6f58b8f8d9f28f7f0056ef610a2098ed1be1b3345da9de81" Jun 09 15:01:12.786984 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:01:12.786963 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:01:24.676832 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:24.676791 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 15:01:24.677387 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:24.677334 2577 scope.go:117] "RemoveContainer" containerID="1245e8ce4dd9724e6f58b8f8d9f28f7f0056ef610a2098ed1be1b3345da9de81" Jun 09 15:01:24.677574 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:01:24.677551 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:01:26.187823 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:26.187786 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:01:34.265655 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:34.265612 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:01:39.048002 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:39.047970 2577 scope.go:117] "RemoveContainer" containerID="1245e8ce4dd9724e6f58b8f8d9f28f7f0056ef610a2098ed1be1b3345da9de81" Jun 09 15:01:39.048389 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:01:39.048174 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:01:51.266593 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:51.266558 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:01:54.048128 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:54.048092 2577 scope.go:117] "RemoveContainer" containerID="1245e8ce4dd9724e6f58b8f8d9f28f7f0056ef610a2098ed1be1b3345da9de81" Jun 09 15:01:54.576835 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:54.576798 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerStarted","Data":"b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe"} Jun 09 15:01:54.577120 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:54.577100 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 15:01:59.561064 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:01:59.561032 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:02:05.584452 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:02:05.584422 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 15:02:16.765137 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:02:16.765105 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:02:24.761330 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:02:24.761255 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:02:57.862352 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:02:57.862315 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:03:06.768730 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:06.768693 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:03:09.356754 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:09.356714 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:03:15.553783 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:15.553743 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:03:23.263520 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:23.263485 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:03:31.760378 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:31.760339 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:03:48.970031 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:48.969950 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:03:54.163269 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:54.163240 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a5e9e52-e78f-4859-b7a6-39763276af81" containerID="b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe" exitCode=1 Jun 09 15:03:54.163627 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:54.163285 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerDied","Data":"b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe"} Jun 09 15:03:54.163627 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:54.163331 2577 scope.go:117] "RemoveContainer" containerID="1245e8ce4dd9724e6f58b8f8d9f28f7f0056ef610a2098ed1be1b3345da9de81" Jun 09 15:03:54.163742 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:54.163659 2577 scope.go:117] "RemoveContainer" containerID="b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe" Jun 09 15:03:54.163891 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:03:54.163870 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:03:55.582261 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:55.582220 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 15:03:55.582649 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:55.582570 2577 scope.go:117] "RemoveContainer" containerID="b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe" Jun 09 15:03:55.582755 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:03:55.582736 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:03:57.466436 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:03:57.466400 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:04:04.676875 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:04.676837 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 15:04:04.677324 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:04.677235 2577 scope.go:117] "RemoveContainer" containerID="b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe" Jun 09 15:04:04.677438 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:04:04.677420 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:04:15.047511 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:15.047483 2577 scope.go:117] "RemoveContainer" containerID="b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe" Jun 09 15:04:15.047895 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:04:15.047671 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:04:17.336757 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:17.336689 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:04:18.495266 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:18.495236 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:04:28.047995 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:28.047968 2577 scope.go:117] "RemoveContainer" containerID="b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe" Jun 09 15:04:28.048390 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:04:28.048158 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:04:35.762882 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:35.762850 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:04:38.062886 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:38.062849 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsq6b"] Jun 09 15:04:43.047760 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:43.047731 2577 scope.go:117] "RemoveContainer" containerID="b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe" Jun 09 15:04:43.048151 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:04:43.047947 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:04:57.048318 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:57.048285 2577 scope.go:117] "RemoveContainer" containerID="b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe" Jun 09 15:04:57.048816 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:04:57.048561 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:04:58.872985 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:58.872958 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-577dcdc745-pdw5n_686cddc4-eca9-410c-a6f6-2aecfe0d082e/nginx/0.log" Jun 09 15:04:58.982742 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:58.982677 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-7dssn_4e1e4718-942f-40a8-8113-a8a601340670/manager/0.log" Jun 09 15:04:59.098941 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:59.098899 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-gl5q9_3d542940-0b49-430f-a125-9aea1dbcb482/manager/0.log" Jun 09 15:04:59.589286 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:59.589255 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sdpsw_6351fcc6-3d92-4edc-af7c-a332ff145767/server/0.log" Jun 09 15:04:59.707316 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:59.707286 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-s9ztb_4be20514-6f1c-4205-91ff-ed5cf95b5e44/manager/0.log" Jun 09 15:04:59.944005 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:59.943978 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c95c9747d-jgk65_4612f9a3-736c-47cc-9e18-c5aa7b7de809/copy-manifests/0.log" Jun 09 15:04:59.956716 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:04:59.956687 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c95c9747d-jgk65_4612f9a3-736c-47cc-9e18-c5aa7b7de809/manager/0.log" Jun 09 15:05:01.738013 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:01.737986 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zqv4g_3e7c2425-ea57-4290-91c3-8927001e746d/manager/0.log" Jun 09 15:05:02.101213 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:02.101130 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-g4hsx_eccecd61-fcd2-4f00-968b-3a5475ef14c3/manager/0.log" Jun 09 15:05:02.219514 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:02.219475 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lsq6b_09b83f21-3d43-4c03-ad6c-b5ee5783b2cd/limitador/0.log" Jun 09 15:05:02.816735 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:02.816709 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qmf7d_2fbd69f1-c921-4168-bfb4-73c19f38da92/discovery/0.log" Jun 09 15:05:02.940442 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:02.940401 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cc4cf49bf-9xgxp_44e07779-698a-49f1-a383-a7c11e548640/kube-auth-proxy/0.log" Jun 09 15:05:03.431334 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:03.431287 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qrq9w_5a5e9e52-e78f-4859-b7a6-39763276af81/payload-processing/4.log" Jun 09 15:05:04.322151 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:04.322118 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clfw2f_1d0743e4-8f87-4013-b72d-a05c705ccbc7/storage-initializer/0.log" Jun 09 15:05:04.580746 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:04.580676 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-thn9f_e1f463cf-bbf0-48a3-9b8c-5306ec170530/storage-initializer/0.log" Jun 09 15:05:04.587410 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:04.587383 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-thn9f_e1f463cf-bbf0-48a3-9b8c-5306ec170530/main/0.log" Jun 09 15:05:09.275356 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:09.275325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:05:09.377091 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:09.377054 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:05:11.053475 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:11.053446 2577 scope.go:117] "RemoveContainer" containerID="b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe" Jun 09 15:05:11.053849 ip-10-0-143-219 kubenswrapper[2577]: E0609 15:05:11.053610 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qrq9w_openshift-ingress(5a5e9e52-e78f-4859-b7a6-39763276af81)\"" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" podUID="5a5e9e52-e78f-4859-b7a6-39763276af81" Jun 09 15:05:12.467577 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:12.467549 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x6jb7_50a4eea7-0255-4698-b270-2683097068de/global-pull-secret-syncer/0.log" Jun 09 15:05:12.549949 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:12.549907 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" Jun 09 15:05:12.675841 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:12.675807 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-219.ec2.internal_0d639eee1bcbf75688fbff254b7fc992/haproxy/0.log" Jun 09 15:05:16.270578 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:16.270547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-5wbqq_3cf377a3-e754-44cb-803e-753e69b7b55e/sail-operator/0.log" Jun 09 15:05:18.111344 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:18.111318 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zqv4g_3e7c2425-ea57-4290-91c3-8927001e746d/manager/0.log" Jun 09 15:05:18.254239 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:18.254203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-g4hsx_eccecd61-fcd2-4f00-968b-3a5475ef14c3/manager/0.log" Jun 09 15:05:18.280581 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:18.280557 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lsq6b_09b83f21-3d43-4c03-ad6c-b5ee5783b2cd/limitador/0.log" Jun 09 15:05:20.555513 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:20.555482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-cgqj2_aab5a8c1-2918-401d-9901-b9cfd49f687f/monitoring-plugin/0.log" Jun 09 15:05:20.754075 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:20.754046 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k627f_a7c30116-a81d-47a1-a4a8-00df5b57c615/node-exporter/0.log" Jun 09 15:05:20.778416 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:20.778392 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k627f_a7c30116-a81d-47a1-a4a8-00df5b57c615/kube-rbac-proxy/0.log" Jun 09 15:05:20.801590 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:20.801572 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k627f_a7c30116-a81d-47a1-a4a8-00df5b57c615/init-textfile/0.log" Jun 09 15:05:21.109450 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:21.109423 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7qr7r_9f60399e-692c-4d75-b4d9-3fd20d44055c/prometheus-operator/0.log" Jun 09 15:05:21.133575 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:21.133535 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7qr7r_9f60399e-692c-4d75-b4d9-3fd20d44055c/kube-rbac-proxy/0.log" Jun 09 15:05:21.166770 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:21.166742 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-79kfx_a2a23601-7204-4b35-8a56-ccf3115a1d9f/prometheus-operator-admission-webhook/0.log" Jun 09 15:05:21.275555 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:21.275517 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847dd546-t8w2p_fa7b09df-66a4-433b-a8be-e7cdb91448e0/thanos-query/0.log" Jun 09 15:05:21.299160 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:21.299138 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847dd546-t8w2p_fa7b09df-66a4-433b-a8be-e7cdb91448e0/kube-rbac-proxy-web/0.log" Jun 09 15:05:21.324763 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:21.324739 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847dd546-t8w2p_fa7b09df-66a4-433b-a8be-e7cdb91448e0/kube-rbac-proxy/0.log" Jun 09 15:05:21.350855 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:21.350831 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847dd546-t8w2p_fa7b09df-66a4-433b-a8be-e7cdb91448e0/prom-label-proxy/0.log" Jun 09 15:05:21.376383 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:21.376315 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847dd546-t8w2p_fa7b09df-66a4-433b-a8be-e7cdb91448e0/kube-rbac-proxy-rules/0.log" Jun 09 15:05:21.403100 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:21.403073 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847dd546-t8w2p_fa7b09df-66a4-433b-a8be-e7cdb91448e0/kube-rbac-proxy-metrics/0.log" Jun 09 15:05:23.739242 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.739209 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8"] Jun 09 15:05:23.742413 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.742390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.744299 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.744280 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2cjhm\"/\"openshift-service-ca.crt\"" Jun 09 15:05:23.744684 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.744670 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2cjhm\"/\"default-dockercfg-nb799\"" Jun 09 15:05:23.744747 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.744671 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2cjhm\"/\"kube-root-ca.crt\"" Jun 09 15:05:23.749413 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.749094 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8"] Jun 09 15:05:23.890382 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.890351 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-sys\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.890382 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.890385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-lib-modules\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.890690 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.890515 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cf8b\" (UniqueName: \"kubernetes.io/projected/8e7fb48d-2d7b-427d-890f-b0b875821ddc-kube-api-access-5cf8b\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.890690 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.890558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-podres\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.890690 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.890645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-proc\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.900991 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.900969 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-vzkdh_3e37b82c-c5f3-4d20-9db9-f00ffa945146/download-server/0.log" Jun 09 15:05:23.991395 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.991301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cf8b\" (UniqueName: \"kubernetes.io/projected/8e7fb48d-2d7b-427d-890f-b0b875821ddc-kube-api-access-5cf8b\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.991395 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.991341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-podres\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.991395 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.991363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-proc\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.991395 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.991390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-sys\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.991712 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.991414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-lib-modules\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.991712 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.991454 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-proc\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.991712 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.991489 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-podres\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.991712 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.991510 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-sys\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.991712 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.991540 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e7fb48d-2d7b-427d-890f-b0b875821ddc-lib-modules\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:23.998232 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:23.998199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cf8b\" (UniqueName: \"kubernetes.io/projected/8e7fb48d-2d7b-427d-890f-b0b875821ddc-kube-api-access-5cf8b\") pod \"perf-node-gather-daemonset-9njd8\" (UID: \"8e7fb48d-2d7b-427d-890f-b0b875821ddc\") " pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:24.053644 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:24.053616 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:24.182042 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:24.182015 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8"] Jun 09 15:05:24.183940 ip-10-0-143-219 kubenswrapper[2577]: W0609 15:05:24.183896 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8e7fb48d_2d7b_427d_890f_b0b875821ddc.slice/crio-7fa50192d37cb96e27bf5534ad48f68ac0ecac2adbd7cfeacab3ca66d230d303 WatchSource:0}: Error finding container 7fa50192d37cb96e27bf5534ad48f68ac0ecac2adbd7cfeacab3ca66d230d303: Status 404 returned error can't find the container with id 7fa50192d37cb96e27bf5534ad48f68ac0ecac2adbd7cfeacab3ca66d230d303 Jun 09 15:05:24.604331 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:24.604296 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" event={"ID":"8e7fb48d-2d7b-427d-890f-b0b875821ddc","Type":"ContainerStarted","Data":"ca7f3b1a8ee1fedb8da35a5eb167ff24a29af8573f176669656efca870ee25f6"} Jun 09 15:05:24.604519 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:24.604349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" event={"ID":"8e7fb48d-2d7b-427d-890f-b0b875821ddc","Type":"ContainerStarted","Data":"7fa50192d37cb96e27bf5534ad48f68ac0ecac2adbd7cfeacab3ca66d230d303"} Jun 09 15:05:24.604519 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:24.604371 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:24.619812 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:24.619766 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" podStartSLOduration=1.61975048 podStartE2EDuration="1.61975048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:24.618891143 +0000 UTC m=+1703.971970965" watchObservedRunningTime="2026-06-09 15:05:24.61975048 +0000 UTC m=+1703.972830298" Jun 09 15:05:25.054764 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:25.054690 2577 scope.go:117] "RemoveContainer" containerID="b2d8ba4b6d3b7a495088d03fb4a323a87dd9c9310339a045948494ffb8225dbe" Jun 09 15:05:25.611495 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:25.611458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" event={"ID":"5a5e9e52-e78f-4859-b7a6-39763276af81","Type":"ContainerStarted","Data":"d4e99b51d0ad62e0851239030df4f421ff151989bed3a679f3482c1a445389da"} Jun 09 15:05:25.611743 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:25.611729 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 15:05:25.852770 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:25.852741 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fj74q_f5014851-47c3-48a7-ac00-27e87fdbc4f2/dns/0.log" Jun 09 15:05:25.896604 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:25.896529 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fj74q_f5014851-47c3-48a7-ac00-27e87fdbc4f2/kube-rbac-proxy/0.log" Jun 09 15:05:25.944375 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:25.944345 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dxq5z_8f91e9a1-398c-4559-970c-a1bba6ce235a/dns-node-resolver/0.log" Jun 09 15:05:26.641800 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:26.641770 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sz6h7_92f7ab4e-6e36-4c50-ba47-a63d198f2702/node-ca/0.log" Jun 09 15:05:27.665217 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:27.665187 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qmf7d_2fbd69f1-c921-4168-bfb4-73c19f38da92/discovery/0.log" Jun 09 15:05:27.694383 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:27.694359 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cc4cf49bf-9xgxp_44e07779-698a-49f1-a383-a7c11e548640/kube-auth-proxy/0.log" Jun 09 15:05:27.842520 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:27.842489 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qrq9w_5a5e9e52-e78f-4859-b7a6-39763276af81/payload-processing/5.log" Jun 09 15:05:27.844673 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:27.844653 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qrq9w_5a5e9e52-e78f-4859-b7a6-39763276af81/payload-processing/4.log" Jun 09 15:05:28.551672 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:28.551643 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4qclb_202606ae-b23b-45fe-b767-adebf07d8cfb/serve-healthcheck-canary/0.log" Jun 09 15:05:29.288659 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:29.288631 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cgx4v_dc620276-2a30-4c32-8852-6c9d78f8d71c/kube-rbac-proxy/0.log" Jun 09 15:05:29.317878 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:29.317853 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cgx4v_dc620276-2a30-4c32-8852-6c9d78f8d71c/exporter/0.log" Jun 09 15:05:29.344603 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:29.344578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cgx4v_dc620276-2a30-4c32-8852-6c9d78f8d71c/extractor/0.log" Jun 09 15:05:30.621093 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:30.621067 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2cjhm/perf-node-gather-daemonset-9njd8" Jun 09 15:05:31.661852 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:31.661826 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-577dcdc745-pdw5n_686cddc4-eca9-410c-a6f6-2aecfe0d082e/nginx/0.log" Jun 09 15:05:31.692756 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:31.692727 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-7dssn_4e1e4718-942f-40a8-8113-a8a601340670/manager/0.log" Jun 09 15:05:31.747086 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:31.747058 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-gl5q9_3d542940-0b49-430f-a125-9aea1dbcb482/manager/0.log" Jun 09 15:05:31.873902 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:31.873874 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sdpsw_6351fcc6-3d92-4edc-af7c-a332ff145767/server/0.log" Jun 09 15:05:31.926115 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:31.926039 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-s9ztb_4be20514-6f1c-4205-91ff-ed5cf95b5e44/manager/0.log" Jun 09 15:05:32.048421 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:32.048388 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c95c9747d-jgk65_4612f9a3-736c-47cc-9e18-c5aa7b7de809/manager/0.log" Jun 09 15:05:32.069161 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:32.069135 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c95c9747d-jgk65_4612f9a3-736c-47cc-9e18-c5aa7b7de809/copy-manifests/0.log" Jun 09 15:05:36.618742 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:36.618712 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qrq9w" Jun 09 15:05:37.631944 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:37.631900 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qmf7d_2fbd69f1-c921-4168-bfb4-73c19f38da92/discovery/0.log" Jun 09 15:05:37.643844 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:37.643820 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cc4cf49bf-9xgxp_44e07779-698a-49f1-a383-a7c11e548640/kube-auth-proxy/0.log" Jun 09 15:05:37.730540 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:37.730513 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qrq9w_5a5e9e52-e78f-4859-b7a6-39763276af81/payload-processing/5.log" Jun 09 15:05:37.732758 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:37.732738 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qrq9w_5a5e9e52-e78f-4859-b7a6-39763276af81/payload-processing/4.log" Jun 09 15:05:38.882835 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:38.882803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qmf7d_2fbd69f1-c921-4168-bfb4-73c19f38da92/discovery/0.log" Jun 09 15:05:38.899729 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:38.899706 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cc4cf49bf-9xgxp_44e07779-698a-49f1-a383-a7c11e548640/kube-auth-proxy/0.log" Jun 09 15:05:38.993842 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:38.993810 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qrq9w_5a5e9e52-e78f-4859-b7a6-39763276af81/payload-processing/5.log" Jun 09 15:05:38.995820 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:38.995792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qrq9w_5a5e9e52-e78f-4859-b7a6-39763276af81/payload-processing/4.log" Jun 09 15:05:40.726909 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:40.726874 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qmf7d_2fbd69f1-c921-4168-bfb4-73c19f38da92/discovery/0.log" Jun 09 15:05:40.739200 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:40.739181 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cc4cf49bf-9xgxp_44e07779-698a-49f1-a383-a7c11e548640/kube-auth-proxy/0.log" Jun 09 15:05:40.831016 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:40.830981 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qrq9w_5a5e9e52-e78f-4859-b7a6-39763276af81/payload-processing/5.log" Jun 09 15:05:40.832145 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:40.832125 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jchds_d06cfa11-043c-4afd-9b11-bae1f0dd4de8/konnectivity-agent/0.log" limit=1024 Jun 09 15:05:40.833502 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:40.833489 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qrq9w_5a5e9e52-e78f-4859-b7a6-39763276af81/payload-processing/4.log" Jun 09 15:05:41.329798 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:41.329768 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxbx4_c5db6a45-6f92-4e00-876c-bb54048f68b3/kube-multus-additional-cni-plugins/0.log" Jun 09 15:05:41.382025 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:41.381999 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxbx4_c5db6a45-6f92-4e00-876c-bb54048f68b3/egress-router-binary-copy/0.log" Jun 09 15:05:41.427498 ip-10-0-143-219 kubenswrapper[2577]: I0609 15:05:41.427470 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxbx4_c5db6a45-6f92-4e00-876c-bb54048f68b3/cni-plugins/0.log"