Jun 11 23:29:39.924370 ip-10-0-143-183 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 23:29:39.924379 ip-10-0-143-183 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 23:29:39.924387 ip-10-0-143-183 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 23:29:39.924600 ip-10-0-143-183 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 23:29:50.065117 ip-10-0-143-183 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 23:29:50.065136 ip-10-0-143-183 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 81015afec55e4c53be52170a0f2b92d2 -- Jun 11 23:32:16.167717 ip-10-0-143-183 systemd[1]: Starting Kubernetes Kubelet... Jun 11 23:32:16.534143 ip-10-0-143-183 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:32:16.534143 ip-10-0-143-183 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 23:32:16.534143 ip-10-0-143-183 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:32:16.534143 ip-10-0-143-183 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 23:32:16.534143 ip-10-0-143-183 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:32:16.536651 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.536553 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 23:32:16.541718 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541699 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:16.541718 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541718 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541722 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541725 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541731 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541735 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541738 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541741 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541744 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541747 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541749 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541752 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541754 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541756 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541761 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541764 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541767 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541771 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541774 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541781 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:16.541792 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541784 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541786 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541789 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541791 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541794 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541797 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541800 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541802 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541805 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541808 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541810 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541813 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541815 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541818 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541821 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541823 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541825 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541828 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541830 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541833 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:16.542242 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541836 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541838 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541841 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541843 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541845 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541848 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541850 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541852 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541855 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541858 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541860 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541863 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541865 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541868 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541872 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541874 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541877 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541879 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541881 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541884 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:16.542749 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541887 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541889 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541892 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541894 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541897 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541901 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541905 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541909 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541913 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541917 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541920 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541925 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541930 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541933 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541935 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541938 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541940 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541944 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541947 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541950 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:16.543233 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541952 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541955 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541958 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541961 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541963 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541967 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541971 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541974 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541977 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541979 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541982 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541984 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541987 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541989 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541991 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541994 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541996 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.541999 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542001 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:16.543745 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542763 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542771 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542774 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542777 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542780 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542784 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542788 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542790 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542794 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542796 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542800 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542802 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542805 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542807 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542810 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542812 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542815 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542817 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542820 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542823 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:16.544193 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542825 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542828 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542830 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542833 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542835 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542838 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542840 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542843 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542845 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542848 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542850 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542852 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542855 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542858 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542860 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542865 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542868 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542871 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542874 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:16.544703 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542877 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542879 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542882 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542886 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542889 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542891 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542893 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542896 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542898 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542901 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542903 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542905 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542908 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542910 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542913 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542915 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542917 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542920 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542922 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542925 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:16.545161 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542927 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542930 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542932 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542934 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542941 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542943 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542947 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542951 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542954 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542956 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542958 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542961 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542964 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542967 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542971 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542974 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542977 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542979 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542982 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542984 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:16.545671 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542987 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542989 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542992 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542994 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542997 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.542999 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543002 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543004 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543007 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543011 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543015 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543017 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543020 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543023 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543026 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543028 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543033 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543035 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543038 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:16.546177 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543040 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543455 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543461 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543465 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543467 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543470 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543473 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543476 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543478 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543483 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543487 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543490 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543493 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543496 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543498 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543501 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543504 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543507 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543510 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543513 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:16.546667 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543515 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543518 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543521 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543523 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543526 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543529 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543532 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543534 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543537 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543541 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543544 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543546 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543549 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543551 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543554 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543556 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543559 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543561 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543565 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543567 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:16.547162 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543570 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543574 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543577 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543580 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543583 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543585 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543588 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543590 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543593 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543595 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543598 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543600 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543603 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543605 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543607 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543610 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543612 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543616 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543618 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:16.547779 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543621 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543624 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543628 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543631 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543633 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543636 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543639 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543641 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543644 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543647 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543651 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543653 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543657 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543659 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543662 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543664 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543667 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543670 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543672 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:16.548351 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543675 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543677 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543680 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543682 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543685 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543687 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543689 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543693 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543695 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543697 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543700 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543704 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543706 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543708 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543711 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543714 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543717 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543720 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543722 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543724 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:16.548860 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543727 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.543729 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543801 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543808 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543814 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543818 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543823 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543826 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543831 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543835 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543838 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543841 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543844 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543847 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543850 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543853 2558 flags.go:64] FLAG: --cgroup-root="" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543856 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543859 2558 flags.go:64] FLAG: --client-ca-file="" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543861 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543864 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543867 2558 flags.go:64] FLAG: --cluster-domain="" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543870 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543873 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543877 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 23:32:16.549377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543880 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543884 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543887 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543891 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543894 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543897 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543900 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543903 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543906 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543909 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543913 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543915 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543918 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543921 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543923 2558 flags.go:64] FLAG: --enable-server="true" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543928 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543932 2558 flags.go:64] FLAG: --event-burst="100" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543935 2558 flags.go:64] FLAG: --event-qps="50" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543938 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543940 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543943 2558 flags.go:64] FLAG: --eviction-hard="" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543947 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543950 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543953 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543956 2558 flags.go:64] FLAG: --eviction-soft="" Jun 11 23:32:16.549959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543958 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543961 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543963 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543966 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543969 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543971 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543975 2558 flags.go:64] FLAG: --feature-gates="" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543979 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543982 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543985 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543988 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543991 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543994 2558 flags.go:64] FLAG: --help="false" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.543997 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-143-183.ec2.internal" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544000 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544003 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544005 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544009 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544012 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544015 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544018 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544020 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544023 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 23:32:16.550580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544026 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544029 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544032 2558 flags.go:64] FLAG: --kube-reserved="" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544035 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544037 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544040 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544043 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544045 2558 flags.go:64] FLAG: --lock-file="" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544048 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544051 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544054 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544059 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544062 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544064 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544067 2558 flags.go:64] FLAG: --logging-format="text" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544071 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544075 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544077 2558 flags.go:64] FLAG: --manifest-url="" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544080 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544084 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544087 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544091 2558 flags.go:64] FLAG: --max-pods="110" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544094 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544097 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544100 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 23:32:16.551186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544103 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544105 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544108 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544111 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544118 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544121 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544124 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544127 2558 flags.go:64] FLAG: --pod-cidr="" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544130 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544136 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544139 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544143 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544146 2558 flags.go:64] FLAG: --port="10250" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544148 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544151 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04a5b69e15cce34ef" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544154 2558 flags.go:64] FLAG: --qos-reserved="" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544157 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544160 2558 flags.go:64] FLAG: --register-node="true" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544163 2558 flags.go:64] FLAG: --register-with-taints="" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544167 2558 flags.go:64] FLAG: --registry-burst="10" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544169 2558 flags.go:64] FLAG: --registry-qps="5" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544172 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544176 2558 flags.go:64] FLAG: --reserved-memory="" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544179 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544182 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 23:32:16.551852 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544185 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544189 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544191 2558 flags.go:64] FLAG: --runonce="false" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544194 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544197 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544200 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544203 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544206 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544209 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544212 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544215 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544217 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544220 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544223 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544225 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544228 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544231 2558 flags.go:64] FLAG: --system-cgroups="" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544234 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544239 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544241 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544244 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544247 2558 flags.go:64] FLAG: --tls-min-version="" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544249 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544252 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544255 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 23:32:16.552517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544257 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544260 2558 flags.go:64] FLAG: --v="2" Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544264 2558 flags.go:64] FLAG: --version="false" Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544268 2558 flags.go:64] FLAG: --vmodule="" Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544272 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.544276 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544389 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544393 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544396 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544399 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544402 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544404 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544407 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544409 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544412 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544429 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544432 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544434 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544437 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544439 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544442 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:16.553120 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544444 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544447 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544450 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544453 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544456 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544458 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544461 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544464 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544466 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544468 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544471 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544473 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544476 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544478 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544480 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544483 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544488 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544491 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544494 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544496 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:16.553695 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544499 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544501 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544504 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544507 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544509 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544512 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544514 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544517 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544519 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544522 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544524 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544527 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544529 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544532 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544534 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544537 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544540 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544542 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544545 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544547 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:16.554184 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544549 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544552 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544555 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544557 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544559 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544562 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544564 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544567 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544572 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544575 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544578 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544581 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544583 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544585 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544588 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544590 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544593 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544596 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544599 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544601 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:16.554704 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544603 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544606 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544609 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544613 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544616 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544618 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544620 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544623 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544626 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544629 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544631 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544634 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544636 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544639 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544641 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544644 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544646 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544648 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544651 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:16.555185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544653 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544657 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544659 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544663 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.544667 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.545263 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.552579 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.552595 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.553378 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.553384 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553456 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553461 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553464 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553468 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:16.555760 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553471 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553473 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553476 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553479 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553481 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553484 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553487 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553489 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553491 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553494 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553497 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553499 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553502 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553504 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553506 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553509 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553512 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553514 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553517 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553519 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:16.556105 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553521 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553524 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553526 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553529 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553531 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553535 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553538 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553541 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553544 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553546 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553549 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553551 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553554 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553556 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553560 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553564 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553567 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553569 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553571 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:16.556624 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553574 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553578 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553581 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553584 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553587 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553590 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553592 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553595 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553598 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553600 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553603 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553606 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553608 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553611 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553613 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553615 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553618 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553620 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553623 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553627 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:16.557080 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553629 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553632 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553634 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553637 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553639 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553642 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553645 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553647 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553649 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553652 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553654 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553657 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553659 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553661 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553664 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553666 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553669 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553671 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553675 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:16.557681 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553678 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553680 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553683 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553686 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553688 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553691 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553693 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553696 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553698 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553701 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553704 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553707 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553710 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553713 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553715 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553718 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:16.558132 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553720 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.553725 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553844 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553849 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553851 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553854 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553857 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553859 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553863 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553865 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553869 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553872 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553874 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553877 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553879 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:16.558525 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553882 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553885 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553887 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553890 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553892 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553894 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553897 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553899 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553901 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553904 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553907 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553909 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553912 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553914 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553917 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553922 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553925 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553928 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553931 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553933 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:16.558900 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553936 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553938 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553940 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553943 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553945 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553948 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553950 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553952 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553955 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553957 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553959 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553962 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553964 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553966 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553969 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553973 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553977 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553979 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553982 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553984 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:16.559463 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553987 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553989 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553992 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553994 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553997 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.553999 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554003 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554006 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554010 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554013 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554015 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554018 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554021 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554023 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554026 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554029 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554032 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554034 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554037 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554039 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:16.559949 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554041 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554044 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554047 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554050 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554052 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554055 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554057 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554059 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554062 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554065 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554067 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554070 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554072 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554075 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554077 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554080 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554082 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554085 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554087 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554089 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:16.560444 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554092 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554095 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554097 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554100 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554102 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:16.554104 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.554109 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.554228 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.559082 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.560588 2558 server.go:1019] "Starting client certificate rotation" Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.560701 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:32:16.560961 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.560734 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:32:16.563075 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.563050 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:32:16.572019 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.571992 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:32:16.584432 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.584396 2558 log.go:25] "Validated CRI v1 runtime API" Jun 11 23:32:16.587413 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.587386 2558 log.go:25] "Validated CRI v1 image API" Jun 11 23:32:16.588186 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.588174 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 23:32:16.590916 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.590897 2558 fs.go:135] Filesystem UUIDs: map[1063135a-2bfc-45b9-8cc3-b500bd9e266a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a5fc093e-1cf1-44d2-a295-610964b95433:/dev/nvme0n1p3] Jun 11 23:32:16.590959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.590916 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 23:32:16.596049 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.595937 2558 manager.go:216] Machine: {Timestamp:2026-06-11 23:32:16.594629964 +0000 UTC m=+0.317165818 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100315 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d36f40d0b9e07e97fd0059114a003 SystemUUID:ec2d36f4-0d0b-9e07-e97f-d0059114a003 BootID:81015afe-c55e-4c53-be52-170a0f2b92d2 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c7:9c:f2:55:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c7:9c:f2:55:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:a9:8f:6f:b1:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 23:32:16.596049 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.596048 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 23:32:16.596293 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.596165 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 23:32:16.599084 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.599059 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 23:32:16.599228 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.599086 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-183.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 23:32:16.599911 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.599900 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 23:32:16.599950 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.599913 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 23:32:16.599950 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.599920 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:32:16.600479 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.600467 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:32:16.600542 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.600492 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:32:16.601680 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.601669 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 23:32:16.604381 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.604370 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:32:16.604511 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.604501 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 23:32:16.604544 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.604533 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 11 23:32:16.604572 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.604548 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 23:32:16.604572 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.604568 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 23:32:16.604621 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.604582 2558 kubelet.go:398] "Adding apiserver pod source" Jun 11 23:32:16.604621 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.604596 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 23:32:16.605049 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.605036 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:32:16.605114 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.605060 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:32:16.607279 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.607264 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 23:32:16.612589 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.612573 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 23:32:16.612666 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.612611 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 23:32:16.612806 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.612793 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 23:32:16.612874 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.612814 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 23:32:16.612874 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.612822 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 23:32:16.612874 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.612843 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 23:32:16.612874 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.612857 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 23:32:16.612874 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.612866 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 23:32:16.613363 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.613353 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 23:32:16.613409 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.613365 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 23:32:16.613409 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.613376 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 23:32:16.613409 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.613385 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 23:32:16.613409 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.613404 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 23:32:16.613565 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.613436 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 23:32:16.614244 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.614233 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 23:32:16.614299 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.614247 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 23:32:16.616648 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.616622 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-183.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 23:32:16.616748 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.616669 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 23:32:16.616748 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.616691 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 23:32:16.618402 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.618389 2558 server.go:1268] "Started kubelet" Jun 11 23:32:16.618503 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.618479 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 23:32:16.621968 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.621896 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 23:32:16.622049 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.622002 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 23:32:16.622891 ip-10-0-143-183 systemd[1]: Started Kubernetes Kubelet. Jun 11 23:32:16.624510 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.624491 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 23:32:16.625794 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.625779 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 11 23:32:16.629531 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.629512 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 23:32:16.629823 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.629810 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 23:32:16.629875 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.629826 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 23:32:16.629983 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.629898 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:16.629983 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.629094 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-183.ec2.internal.18b82ad298b25d1a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-183.ec2.internal,UID:ip-10-0-143-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-183.ec2.internal,},FirstTimestamp:2026-06-11 23:32:16.618355994 +0000 UTC m=+0.340891848,LastTimestamp:2026-06-11 23:32:16.618355994 +0000 UTC m=+0.340891848,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-183.ec2.internal,}" Jun 11 23:32:16.630738 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.630721 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 23:32:16.630833 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.630744 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 23:32:16.630833 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.630720 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 23:32:16.630929 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.630864 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 11 23:32:16.630929 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.630873 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 11 23:32:16.634126 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.634110 2558 factory.go:153] Registering CRI-O factory Jun 11 23:32:16.634209 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.634131 2558 factory.go:223] Registration of the crio container factory successfully Jun 11 23:32:16.634209 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.634186 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 23:32:16.634209 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.634195 2558 factory.go:55] Registering systemd factory Jun 11 23:32:16.634209 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.634203 2558 factory.go:223] Registration of the systemd container factory successfully Jun 11 23:32:16.634322 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.634230 2558 factory.go:103] Registering Raw factory Jun 11 23:32:16.634322 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.634240 2558 manager.go:1196] Started watching for new ooms in manager Jun 11 23:32:16.635947 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.635929 2558 manager.go:349] Starting recovery of all containers Jun 11 23:32:16.639304 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.639277 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 23:32:16.639389 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.639344 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 23:32:16.646194 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.646178 2558 manager.go:354] Recovery completed Jun 11 23:32:16.651137 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.651123 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:16.653097 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.653075 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:16.653179 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.653120 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:16.653179 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.653133 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:16.653714 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.653700 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 23:32:16.653714 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.653712 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 23:32:16.653828 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.653726 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:32:16.653828 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.653764 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:16.654541 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.654528 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:16.654592 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.654556 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:16.654592 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.654566 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:16.654977 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.654951 2558 policy_none.go:49] "None policy: Start" Jun 11 23:32:16.654977 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.654975 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 23:32:16.655143 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.654991 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 23:32:16.655619 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.655599 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nvbnc" Jun 11 23:32:16.656031 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.655910 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-183.ec2.internal.18b82ad29ac48195 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-183.ec2.internal,UID:ip-10-0-143-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-183.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-183.ec2.internal,},FirstTimestamp:2026-06-11 23:32:16.653099413 +0000 UTC m=+0.375635271,LastTimestamp:2026-06-11 23:32:16.653099413 +0000 UTC m=+0.375635271,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-183.ec2.internal,}" Jun 11 23:32:16.657328 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.657312 2558 policy_none.go:47] "Start" Jun 11 23:32:16.663748 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.663729 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nvbnc" Jun 11 23:32:16.666183 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.666096 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-183.ec2.internal.18b82ad29ac4ec63 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-183.ec2.internal,UID:ip-10-0-143-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-183.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-183.ec2.internal,},FirstTimestamp:2026-06-11 23:32:16.653126755 +0000 UTC m=+0.375662608,LastTimestamp:2026-06-11 23:32:16.653126755 +0000 UTC m=+0.375662608,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-183.ec2.internal,}" Jun 11 23:32:16.692479 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.692436 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 23:32:16.694059 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.693874 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 23:32:16.694059 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.693919 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 23:32:16.694059 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.693948 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 23:32:16.694059 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.693992 2558 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 11 23:32:16.694267 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.694122 2558 manager.go:337] "Starting Device Plugin manager" Jun 11 23:32:16.694267 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.694161 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 23:32:16.694267 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.694173 2558 server.go:87] "Starting device plugin registration server" Jun 11 23:32:16.694504 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.694489 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 23:32:16.694577 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.694505 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 23:32:16.694771 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.694738 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 23:32:16.694850 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.694826 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 23:32:16.694850 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.694836 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 23:32:16.695624 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.695596 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 23:32:16.695730 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.695653 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:16.697648 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.697631 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:16.794980 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.794880 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal"] Jun 11 23:32:16.794980 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.794896 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:16.795150 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.795013 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:16.796074 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.796055 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:16.796151 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.796087 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:16.796151 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.796097 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:16.796151 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.796119 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-183.ec2.internal" Jun 11 23:32:16.796675 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.796654 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:16.796784 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.796686 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:16.796784 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.796696 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:16.797912 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.797897 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:16.798022 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.798008 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" Jun 11 23:32:16.798065 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.798040 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:16.798648 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.798631 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:16.798722 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.798664 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:16.798722 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.798676 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:16.798827 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.798750 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:16.798827 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.798782 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:16.798827 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.798795 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:16.799934 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.799921 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal" Jun 11 23:32:16.799976 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.799954 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:16.800663 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.800649 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:16.800730 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.800668 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:16.800730 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.800677 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:16.807703 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.807688 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-183.ec2.internal" Jun 11 23:32:16.807785 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.807709 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-183.ec2.internal\": node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:16.822212 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.822187 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-183.ec2.internal\" not found" node="ip-10-0-143-183.ec2.internal" Jun 11 23:32:16.826618 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.826598 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-183.ec2.internal\" not found" node="ip-10-0-143-183.ec2.internal" Jun 11 23:32:16.876504 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.876477 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:16.932224 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.932193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c5239f57b02f406b49d6cca729c0e25-config\") pod \"kube-apiserver-proxy-ip-10-0-143-183.ec2.internal\" (UID: \"1c5239f57b02f406b49d6cca729c0e25\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal" Jun 11 23:32:16.932322 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.932226 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3415ecf8c783ed50447e4624baa8e89e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal\" (UID: \"3415ecf8c783ed50447e4624baa8e89e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" Jun 11 23:32:16.932322 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:16.932253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3415ecf8c783ed50447e4624baa8e89e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal\" (UID: \"3415ecf8c783ed50447e4624baa8e89e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" Jun 11 23:32:16.976713 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:16.976674 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:17.032768 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.032736 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3415ecf8c783ed50447e4624baa8e89e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal\" (UID: \"3415ecf8c783ed50447e4624baa8e89e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" Jun 11 23:32:17.032841 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.032773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3415ecf8c783ed50447e4624baa8e89e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal\" (UID: \"3415ecf8c783ed50447e4624baa8e89e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" Jun 11 23:32:17.032841 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.032788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c5239f57b02f406b49d6cca729c0e25-config\") pod \"kube-apiserver-proxy-ip-10-0-143-183.ec2.internal\" (UID: \"1c5239f57b02f406b49d6cca729c0e25\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal" Jun 11 23:32:17.032841 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.032829 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c5239f57b02f406b49d6cca729c0e25-config\") pod \"kube-apiserver-proxy-ip-10-0-143-183.ec2.internal\" (UID: \"1c5239f57b02f406b49d6cca729c0e25\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal" Jun 11 23:32:17.032933 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.032853 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3415ecf8c783ed50447e4624baa8e89e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal\" (UID: \"3415ecf8c783ed50447e4624baa8e89e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" Jun 11 23:32:17.032933 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.032853 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3415ecf8c783ed50447e4624baa8e89e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal\" (UID: \"3415ecf8c783ed50447e4624baa8e89e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" Jun 11 23:32:17.077110 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:17.077044 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:17.124413 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.124383 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" Jun 11 23:32:17.130084 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.130065 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal" Jun 11 23:32:17.177616 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:17.177580 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:17.278118 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:17.278092 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:17.378658 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:17.378629 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:17.479246 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:17.479208 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:17.491405 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.491377 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:17.560152 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.560124 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 23:32:17.560864 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.560302 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:32:17.560864 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.560328 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:32:17.579367 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:17.579332 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:17.622589 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:17.622547 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3415ecf8c783ed50447e4624baa8e89e.slice/crio-8c98dbcbf91c9f8c03f47307dbda55d541e55b3d38f892f8f53fe5a1efb68076 WatchSource:0}: Error finding container 8c98dbcbf91c9f8c03f47307dbda55d541e55b3d38f892f8f53fe5a1efb68076: Status 404 returned error can't find the container with id 8c98dbcbf91c9f8c03f47307dbda55d541e55b3d38f892f8f53fe5a1efb68076 Jun 11 23:32:17.622957 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:17.622936 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5239f57b02f406b49d6cca729c0e25.slice/crio-d8ad330c83d442b392125f4462ff4d70887d2bd90efa592abc4017957abf1b20 WatchSource:0}: Error finding container d8ad330c83d442b392125f4462ff4d70887d2bd90efa592abc4017957abf1b20: Status 404 returned error can't find the container with id d8ad330c83d442b392125f4462ff4d70887d2bd90efa592abc4017957abf1b20 Jun 11 23:32:17.628888 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.628868 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:32:17.667796 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.667748 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 23:27:16 +0000 UTC" deadline="2028-01-23 00:01:03.773722241 +0000 UTC" Jun 11 23:32:17.667796 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.667786 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14160h28m46.10594012s" Jun 11 23:32:17.679949 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:17.679919 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:17.699042 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.698993 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" event={"ID":"3415ecf8c783ed50447e4624baa8e89e","Type":"ContainerStarted","Data":"8c98dbcbf91c9f8c03f47307dbda55d541e55b3d38f892f8f53fe5a1efb68076"} Jun 11 23:32:17.700084 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.700057 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal" event={"ID":"1c5239f57b02f406b49d6cca729c0e25","Type":"ContainerStarted","Data":"d8ad330c83d442b392125f4462ff4d70887d2bd90efa592abc4017957abf1b20"} Jun 11 23:32:17.780681 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:17.780638 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:17.782381 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.782367 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:17.812814 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.812785 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:17.814754 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.814734 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:17.814828 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.814769 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:17.814828 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.814779 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:17.881069 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:17.880985 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-183.ec2.internal\" not found" Jun 11 23:32:17.966181 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:17.966146 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:18.030475 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.030408 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal" Jun 11 23:32:18.041518 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.041487 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:32:18.042530 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.042513 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" Jun 11 23:32:18.054121 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.054090 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:32:18.446159 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.446122 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:18.605996 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.605963 2558 apiserver.go:52] "Watching apiserver" Jun 11 23:32:18.612432 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.612396 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 23:32:18.613451 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.613408 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f","openshift-cluster-node-tuning-operator/tuned-22xhp","openshift-image-registry/node-ca-tz4hv","openshift-multus/multus-56prl","openshift-network-diagnostics/network-check-target-qm4gq","openshift-network-operator/iptables-alerter-fmwpt","kube-system/konnectivity-agent-crjvj","openshift-dns/node-resolver-8p2hj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal","openshift-multus/multus-additional-cni-plugins-p7kht","openshift-multus/network-metrics-daemon-7zxrn","openshift-ovn-kubernetes/ovnkube-node-rtrh4","kube-system/global-pull-secret-syncer-qngnd","kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal"] Jun 11 23:32:18.615278 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.614965 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:18.616103 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.616075 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-56prl" Jun 11 23:32:18.617466 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.617448 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 23:32:18.617567 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.617500 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jfhgg\"" Jun 11 23:32:18.617690 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.617676 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 23:32:18.617871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.617855 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.618588 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.618568 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 23:32:18.618843 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.618830 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 23:32:18.619025 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.619013 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-54kq9\"" Jun 11 23:32:18.619189 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.619163 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 23:32:18.619474 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.619453 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 23:32:18.620077 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.620056 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:32:18.620262 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.620246 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 23:32:18.620396 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.620383 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bzjwd\"" Jun 11 23:32:18.621081 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.621063 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:18.621165 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.621129 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:18.622467 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.622341 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:18.622467 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.622410 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:18.623677 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.623652 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.625271 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.625044 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.626208 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.626096 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 23:32:18.626208 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.626109 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:32:18.626366 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.626234 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 23:32:18.626442 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.626381 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.626640 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.626617 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jftt2\"" Jun 11 23:32:18.634055 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.634032 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 23:32:18.634380 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.634358 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4zrbg\"" Jun 11 23:32:18.634661 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.634645 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 23:32:18.634950 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.634932 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 23:32:18.635208 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.635179 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 23:32:18.635306 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.635294 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.636348 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.636327 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 23:32:18.636549 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.636518 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 23:32:18.636823 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.636807 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:18.636896 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.636861 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:18.637154 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.637132 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 23:32:18.637342 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.637327 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z5rkv\"" Jun 11 23:32:18.637688 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.637664 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 23:32:18.637803 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.637715 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 23:32:18.637803 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.637669 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6hksr\"" Jun 11 23:32:18.638061 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.638043 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.639672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.639651 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.640769 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n4c7\" (UniqueName: \"kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7\") pod \"network-check-target-qm4gq\" (UID: \"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3\") " pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.640802 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-system-cni-dir\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.640825 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-socket-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.640846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-run\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.640895 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c8cbaaf-e2cd-4364-9a9a-ac388dca0991-agent-certs\") pod \"konnectivity-agent-crjvj\" (UID: \"9c8cbaaf-e2cd-4364-9a9a-ac388dca0991\") " pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.640918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c8cbaaf-e2cd-4364-9a9a-ac388dca0991-konnectivity-ca\") pod \"konnectivity-agent-crjvj\" (UID: \"9c8cbaaf-e2cd-4364-9a9a-ac388dca0991\") " pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.640936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-systemd\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.640958 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9028892-956f-45c6-a197-16d553d9eb9e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.640977 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-os-release\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.640994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd6mk\" (UniqueName: \"kubernetes.io/projected/6220ce74-b1b0-48b3-ae6a-dbc39011dbe3-kube-api-access-xd6mk\") pod \"node-ca-tz4hv\" (UID: \"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3\") " pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16fe4fdf-cb86-47f1-8aec-62a5867eeeb3-iptables-alerter-script\") pod \"iptables-alerter-fmwpt\" (UID: \"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3\") " pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-lib-modules\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-var-lib-kubelet\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641116 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9028892-956f-45c6-a197-16d553d9eb9e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641142 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6220ce74-b1b0-48b3-ae6a-dbc39011dbe3-serviceca\") pod \"node-ca-tz4hv\" (UID: \"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3\") " pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641168 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-run-netns\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641308 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-var-lib-kubelet\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rsn\" (UniqueName: \"kubernetes.io/projected/5a4e365c-386c-4127-b26a-27ea56281bc4-kube-api-access-c9rsn\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641357 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-os-release\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641378 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-cni-binary-copy\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-hostroot\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-run-multus-certs\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-device-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641508 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-sysctl-conf\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641529 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-host\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-cnibin\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641571 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-sys\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641587 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-socket-dir-parent\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641600 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-etc-selinux\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641620 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9028892-956f-45c6-a197-16d553d9eb9e-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641642 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.642330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641681 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-var-lib-cni-multus\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641717 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r99q4\" (UniqueName: \"kubernetes.io/projected/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-kube-api-access-r99q4\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgjqq\" (UniqueName: \"kubernetes.io/projected/16fe4fdf-cb86-47f1-8aec-62a5867eeeb3-kube-api-access-dgjqq\") pod \"iptables-alerter-fmwpt\" (UID: \"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3\") " pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-tmp\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641819 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-etc-kubernetes\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641841 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-dbus\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-kubernetes\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641886 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpdrp\" (UniqueName: \"kubernetes.io/projected/a9028892-956f-45c6-a197-16d553d9eb9e-kube-api-access-wpdrp\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-sysconfig\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641932 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6220ce74-b1b0-48b3-ae6a-dbc39011dbe3-host\") pod \"node-ca-tz4hv\" (UID: \"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3\") " pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641954 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdqfj\" (UniqueName: \"kubernetes.io/projected/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-kube-api-access-wdqfj\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.641976 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-cni-dir\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642020 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-conf-dir\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642045 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-modprobe-d\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-cnibin\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642112 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:18.643073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642140 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642161 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-sys-fs\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642179 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-tuned\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-system-cni-dir\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-var-lib-cni-bin\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-daemon-config\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16fe4fdf-cb86-47f1-8aec-62a5867eeeb3-host-slash\") pod \"iptables-alerter-fmwpt\" (UID: \"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3\") " pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642294 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-registration-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642315 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-sysctl-d\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642329 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-run-k8s-cni-cncf-io\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.642354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-kubelet-config\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.644236 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.644281 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.644304 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.644241 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.644442 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.644606 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7x5bt\"" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.644753 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9vfbt\"" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.644763 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.644792 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 23:32:18.645120 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.644980 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 23:32:18.650718 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.650697 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:32:18.674268 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.674242 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bf9wk" Jun 11 23:32:18.680873 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.680842 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bf9wk" Jun 11 23:32:18.731705 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.731674 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 23:32:18.743260 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743217 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad8ec8a6-ec32-431f-96aa-a595b6e6d53f-tmp-dir\") pod \"node-resolver-8p2hj\" (UID: \"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f\") " pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:18.743260 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743264 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-cnibin\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743349 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743386 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-sys-fs\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743390 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-cnibin\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.743411 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-run-netns\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743464 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-tuned\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743486 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-sys-fs\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.743500 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret podName:f1aa934a-1027-41b7-bfbf-9eeb2bfddce1 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:19.243476216 +0000 UTC m=+2.966012056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret") pod "global-pull-secret-syncer-qngnd" (UID: "f1aa934a-1027-41b7-bfbf-9eeb2bfddce1") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743496 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-system-cni-dir\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.743539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-var-lib-cni-bin\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-daemon-config\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743565 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-system-cni-dir\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743575 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16fe4fdf-cb86-47f1-8aec-62a5867eeeb3-host-slash\") pod \"iptables-alerter-fmwpt\" (UID: \"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3\") " pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743597 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16fe4fdf-cb86-47f1-8aec-62a5867eeeb3-host-slash\") pod \"iptables-alerter-fmwpt\" (UID: \"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3\") " pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743611 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-registration-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743617 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-var-lib-cni-bin\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-sysctl-d\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-run-k8s-cni-cncf-io\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-kubelet-config\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743689 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx544\" (UniqueName: \"kubernetes.io/projected/ad8ec8a6-ec32-431f-96aa-a595b6e6d53f-kube-api-access-rx544\") pod \"node-resolver-8p2hj\" (UID: \"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f\") " pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4c7\" (UniqueName: \"kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7\") pod \"network-check-target-qm4gq\" (UID: \"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3\") " pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743736 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743841 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-sysctl-d\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-system-cni-dir\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743908 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-socket-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743931 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-run-k8s-cni-cncf-io\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.744067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743946 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-run\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743976 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-registration-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.743978 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-log-socket\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744002 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-cni-netd\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744017 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c8cbaaf-e2cd-4364-9a9a-ac388dca0991-agent-certs\") pod \"konnectivity-agent-crjvj\" (UID: \"9c8cbaaf-e2cd-4364-9a9a-ac388dca0991\") " pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744022 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-kubelet-config\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c8cbaaf-e2cd-4364-9a9a-ac388dca0991-konnectivity-ca\") pod \"konnectivity-agent-crjvj\" (UID: \"9c8cbaaf-e2cd-4364-9a9a-ac388dca0991\") " pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744015 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-socket-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744051 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-daemon-config\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744071 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-systemd\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744104 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-run\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744105 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9028892-956f-45c6-a197-16d553d9eb9e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744122 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-system-cni-dir\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744134 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-cni-bin\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744158 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-systemd\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/266b6897-265f-4c0e-aa76-50d81144c6a7-ovnkube-config\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-os-release\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.744871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744212 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd6mk\" (UniqueName: \"kubernetes.io/projected/6220ce74-b1b0-48b3-ae6a-dbc39011dbe3-kube-api-access-xd6mk\") pod \"node-ca-tz4hv\" (UID: \"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3\") " pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744236 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-systemd-units\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744290 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16fe4fdf-cb86-47f1-8aec-62a5867eeeb3-iptables-alerter-script\") pod \"iptables-alerter-fmwpt\" (UID: \"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3\") " pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744314 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-lib-modules\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744339 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-var-lib-kubelet\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9028892-956f-45c6-a197-16d553d9eb9e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744455 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/266b6897-265f-4c0e-aa76-50d81144c6a7-ovn-node-metrics-cert\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744542 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-os-release\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744575 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs2pn\" (UniqueName: \"kubernetes.io/projected/266b6897-265f-4c0e-aa76-50d81144c6a7-kube-api-access-fs2pn\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744606 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6220ce74-b1b0-48b3-ae6a-dbc39011dbe3-serviceca\") pod \"node-ca-tz4hv\" (UID: \"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3\") " pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744633 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-run-netns\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744681 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a9028892-956f-45c6-a197-16d553d9eb9e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744738 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c8cbaaf-e2cd-4364-9a9a-ac388dca0991-konnectivity-ca\") pod \"konnectivity-agent-crjvj\" (UID: \"9c8cbaaf-e2cd-4364-9a9a-ac388dca0991\") " pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744768 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-var-lib-kubelet\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744848 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rsn\" (UniqueName: \"kubernetes.io/projected/5a4e365c-386c-4127-b26a-27ea56281bc4-kube-api-access-c9rsn\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/266b6897-265f-4c0e-aa76-50d81144c6a7-ovnkube-script-lib\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.745673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744880 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-lib-modules\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744943 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-os-release\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744970 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-cni-binary-copy\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.744998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-hostroot\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-run-multus-certs\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-device-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-sysctl-conf\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-host\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-cnibin\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-sys\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745186 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-run-ovn\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-socket-dir-parent\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-etc-selinux\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745266 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9028892-956f-45c6-a197-16d553d9eb9e-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745272 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-var-lib-kubelet\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745315 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6220ce74-b1b0-48b3-ae6a-dbc39011dbe3-serviceca\") pod \"node-ca-tz4hv\" (UID: \"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3\") " pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.746508 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745366 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-var-lib-kubelet\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745368 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-run-netns\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745406 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-var-lib-openvswitch\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-var-lib-cni-multus\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745486 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r99q4\" (UniqueName: \"kubernetes.io/projected/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-kube-api-access-r99q4\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745504 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgjqq\" (UniqueName: \"kubernetes.io/projected/16fe4fdf-cb86-47f1-8aec-62a5867eeeb3-kube-api-access-dgjqq\") pod \"iptables-alerter-fmwpt\" (UID: \"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3\") " pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-tmp\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-etc-kubernetes\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745565 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-dbus\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745571 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-host\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745592 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-kubernetes\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745612 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpdrp\" (UniqueName: \"kubernetes.io/projected/a9028892-956f-45c6-a197-16d553d9eb9e-kube-api-access-wpdrp\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745618 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-sys\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-slash\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745634 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-socket-dir-parent\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.747115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745217 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a9028892-956f-45c6-a197-16d553d9eb9e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-run-systemd\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745695 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-node-log\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/266b6897-265f-4c0e-aa76-50d81144c6a7-env-overrides\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745763 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad8ec8a6-ec32-431f-96aa-a595b6e6d53f-hosts-file\") pod \"node-resolver-8p2hj\" (UID: \"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f\") " pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745792 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-sysconfig\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6220ce74-b1b0-48b3-ae6a-dbc39011dbe3-host\") pod \"node-ca-tz4hv\" (UID: \"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3\") " pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745843 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p268\" (UniqueName: \"kubernetes.io/projected/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-kube-api-access-7p268\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745871 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-run-openvswitch\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745892 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-var-lib-cni-multus\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745899 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdqfj\" (UniqueName: \"kubernetes.io/projected/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-kube-api-access-wdqfj\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745988 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-os-release\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746018 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-cni-dir\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-conf-dir\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746054 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-sysctl-conf\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746065 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-modprobe-d\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745572 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-cnibin\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.747694 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746090 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-kubelet\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746113 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-etc-openvswitch\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746135 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9028892-956f-45c6-a197-16d553d9eb9e-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746188 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-cni-binary-copy\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746197 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-etc-selinux\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746225 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-host-run-multus-certs\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746243 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6220ce74-b1b0-48b3-ae6a-dbc39011dbe3-host\") pod \"node-ca-tz4hv\" (UID: \"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3\") " pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746282 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-etc-kubernetes\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746297 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-cni-dir\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.745844 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9028892-956f-45c6-a197-16d553d9eb9e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746358 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a4e365c-386c-4127-b26a-27ea56281bc4-device-dir\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746372 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-sysconfig\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746402 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-dbus\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-hostroot\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-kubernetes\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746453 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-multus-conf-dir\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746529 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-modprobe-d\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746799 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16fe4fdf-cb86-47f1-8aec-62a5867eeeb3-iptables-alerter-script\") pod \"iptables-alerter-fmwpt\" (UID: \"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3\") " pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.748173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.746833 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-etc-tuned\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.748707 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.747113 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c8cbaaf-e2cd-4364-9a9a-ac388dca0991-agent-certs\") pod \"konnectivity-agent-crjvj\" (UID: \"9c8cbaaf-e2cd-4364-9a9a-ac388dca0991\") " pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:18.748707 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.748360 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-tmp\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.756511 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.756487 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:18.756511 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.756516 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:18.756703 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.756530 2558 projected.go:196] Error preparing data for projected volume kube-api-access-7n4c7 for pod openshift-network-diagnostics/network-check-target-qm4gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:18.756703 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.756599 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7 podName:19a8b683-e9ae-4a8e-863c-91ce41bf0ca3 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:19.256580273 +0000 UTC m=+2.979116117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7n4c7" (UniqueName: "kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7") pod "network-check-target-qm4gq" (UID: "19a8b683-e9ae-4a8e-863c-91ce41bf0ca3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:18.764874 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.764841 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r99q4\" (UniqueName: \"kubernetes.io/projected/a9a1e881-bf63-40df-9147-d7dd0fc22d3c-kube-api-access-r99q4\") pod \"multus-56prl\" (UID: \"a9a1e881-bf63-40df-9147-d7dd0fc22d3c\") " pod="openshift-multus/multus-56prl" Jun 11 23:32:18.764874 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.764858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgjqq\" (UniqueName: \"kubernetes.io/projected/16fe4fdf-cb86-47f1-8aec-62a5867eeeb3-kube-api-access-dgjqq\") pod \"iptables-alerter-fmwpt\" (UID: \"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3\") " pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.765285 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.765266 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rsn\" (UniqueName: \"kubernetes.io/projected/5a4e365c-386c-4127-b26a-27ea56281bc4-kube-api-access-c9rsn\") pod \"aws-ebs-csi-driver-node-l4k8f\" (UID: \"5a4e365c-386c-4127-b26a-27ea56281bc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.765451 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.765365 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpdrp\" (UniqueName: \"kubernetes.io/projected/a9028892-956f-45c6-a197-16d553d9eb9e-kube-api-access-wpdrp\") pod \"multus-additional-cni-plugins-p7kht\" (UID: \"a9028892-956f-45c6-a197-16d553d9eb9e\") " pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.765801 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.765777 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd6mk\" (UniqueName: \"kubernetes.io/projected/6220ce74-b1b0-48b3-ae6a-dbc39011dbe3-kube-api-access-xd6mk\") pod \"node-ca-tz4hv\" (UID: \"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3\") " pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.766588 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.766570 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdqfj\" (UniqueName: \"kubernetes.io/projected/0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed-kube-api-access-wdqfj\") pod \"tuned-22xhp\" (UID: \"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed\") " pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.847052 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847014 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:18.847052 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847051 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-var-lib-openvswitch\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847069 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847096 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-slash\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-run-systemd\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847159 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-var-lib-openvswitch\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847171 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-node-log\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847173 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.847186 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847206 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-slash\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847216 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-node-log\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847228 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/266b6897-265f-4c0e-aa76-50d81144c6a7-env-overrides\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847232 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-run-systemd\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:18.847260 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs podName:dda14d2a-dc6e-4531-bb06-0ab0a7b747e0 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:19.347239281 +0000 UTC m=+3.069775122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs") pod "network-metrics-daemon-7zxrn" (UID: "dda14d2a-dc6e-4531-bb06-0ab0a7b747e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:18.847301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad8ec8a6-ec32-431f-96aa-a595b6e6d53f-hosts-file\") pod \"node-resolver-8p2hj\" (UID: \"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f\") " pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847312 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p268\" (UniqueName: \"kubernetes.io/projected/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-kube-api-access-7p268\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847335 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-run-openvswitch\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847351 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad8ec8a6-ec32-431f-96aa-a595b6e6d53f-hosts-file\") pod \"node-resolver-8p2hj\" (UID: \"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f\") " pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-kubelet\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-etc-openvswitch\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847395 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-run-openvswitch\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad8ec8a6-ec32-431f-96aa-a595b6e6d53f-tmp-dir\") pod \"node-resolver-8p2hj\" (UID: \"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f\") " pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847464 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-kubelet\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-run-netns\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847502 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-etc-openvswitch\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847524 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-run-netns\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx544\" (UniqueName: \"kubernetes.io/projected/ad8ec8a6-ec32-431f-96aa-a595b6e6d53f-kube-api-access-rx544\") pod \"node-resolver-8p2hj\" (UID: \"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f\") " pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847663 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-log-socket\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-cni-netd\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847753 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-cni-netd\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847766 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad8ec8a6-ec32-431f-96aa-a595b6e6d53f-tmp-dir\") pod \"node-resolver-8p2hj\" (UID: \"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f\") " pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847751 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-log-socket\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.847957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-cni-bin\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/266b6897-265f-4c0e-aa76-50d81144c6a7-ovnkube-config\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847767 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/266b6897-265f-4c0e-aa76-50d81144c6a7-env-overrides\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847835 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-systemd-units\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847865 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-systemd-units\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847892 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-cni-bin\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847912 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/266b6897-265f-4c0e-aa76-50d81144c6a7-ovn-node-metrics-cert\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs2pn\" (UniqueName: \"kubernetes.io/projected/266b6897-265f-4c0e-aa76-50d81144c6a7-kube-api-access-fs2pn\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.847974 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/266b6897-265f-4c0e-aa76-50d81144c6a7-ovnkube-script-lib\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.848006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-run-ovn\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.848059 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/266b6897-265f-4c0e-aa76-50d81144c6a7-run-ovn\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.848328 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/266b6897-265f-4c0e-aa76-50d81144c6a7-ovnkube-config\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.848672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.848560 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/266b6897-265f-4c0e-aa76-50d81144c6a7-ovnkube-script-lib\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.850723 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.850699 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/266b6897-265f-4c0e-aa76-50d81144c6a7-ovn-node-metrics-cert\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.870365 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.870330 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs2pn\" (UniqueName: \"kubernetes.io/projected/266b6897-265f-4c0e-aa76-50d81144c6a7-kube-api-access-fs2pn\") pod \"ovnkube-node-rtrh4\" (UID: \"266b6897-265f-4c0e-aa76-50d81144c6a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:18.870676 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.870653 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx544\" (UniqueName: \"kubernetes.io/projected/ad8ec8a6-ec32-431f-96aa-a595b6e6d53f-kube-api-access-rx544\") pod \"node-resolver-8p2hj\" (UID: \"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f\") " pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:18.870676 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.870669 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p268\" (UniqueName: \"kubernetes.io/projected/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-kube-api-access-7p268\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:18.935653 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.935611 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:18.946556 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.946526 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-56prl" Jun 11 23:32:18.955476 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.955435 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22xhp" Jun 11 23:32:18.962642 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.962619 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmwpt" Jun 11 23:32:18.970335 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.970290 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" Jun 11 23:32:18.977483 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.977458 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tz4hv" Jun 11 23:32:18.984370 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.984347 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p7kht" Jun 11 23:32:18.993895 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:18.993822 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:19.001264 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.001231 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8p2hj" Jun 11 23:32:19.249740 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.249647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:19.249898 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:19.249771 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:19.249898 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:19.249838 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret podName:f1aa934a-1027-41b7-bfbf-9eeb2bfddce1 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:20.249822427 +0000 UTC m=+3.972358271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret") pod "global-pull-secret-syncer-qngnd" (UID: "f1aa934a-1027-41b7-bfbf-9eeb2bfddce1") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:19.350200 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.350156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4c7\" (UniqueName: \"kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7\") pod \"network-check-target-qm4gq\" (UID: \"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3\") " pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:19.350392 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.350230 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:19.350392 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:19.350338 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:19.350392 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:19.350342 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:19.350392 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:19.350372 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:19.350392 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:19.350386 2558 projected.go:196] Error preparing data for projected volume kube-api-access-7n4c7 for pod openshift-network-diagnostics/network-check-target-qm4gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:19.350672 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:19.350397 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs podName:dda14d2a-dc6e-4531-bb06-0ab0a7b747e0 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:20.350380164 +0000 UTC m=+4.072916004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs") pod "network-metrics-daemon-7zxrn" (UID: "dda14d2a-dc6e-4531-bb06-0ab0a7b747e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:19.350672 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:19.350449 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7 podName:19a8b683-e9ae-4a8e-863c-91ce41bf0ca3 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:20.350436775 +0000 UTC m=+4.072972618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n4c7" (UniqueName: "kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7") pod "network-check-target-qm4gq" (UID: "19a8b683-e9ae-4a8e-863c-91ce41bf0ca3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:19.359623 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.359595 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:19.629450 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:19.629207 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266b6897_265f_4c0e_aa76_50d81144c6a7.slice/crio-3a24089875a30b65feb0bd8a922b0779ab254993c164c7916a6fa55885521a36 WatchSource:0}: Error finding container 3a24089875a30b65feb0bd8a922b0779ab254993c164c7916a6fa55885521a36: Status 404 returned error can't find the container with id 3a24089875a30b65feb0bd8a922b0779ab254993c164c7916a6fa55885521a36 Jun 11 23:32:19.630276 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:19.630255 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6220ce74_b1b0_48b3_ae6a_dbc39011dbe3.slice/crio-86e6290bd1c1b56e364d01a5c2ecb41a9ebafd74dd371333decd1347cb5ffbbb WatchSource:0}: Error finding container 86e6290bd1c1b56e364d01a5c2ecb41a9ebafd74dd371333decd1347cb5ffbbb: Status 404 returned error can't find the container with id 86e6290bd1c1b56e364d01a5c2ecb41a9ebafd74dd371333decd1347cb5ffbbb Jun 11 23:32:19.631139 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:19.631114 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8cbaaf_e2cd_4364_9a9a_ac388dca0991.slice/crio-abd383f53f45131d1a7a11bc5220f6af147ce17dddcec3ce1221549f7318f787 WatchSource:0}: Error finding container abd383f53f45131d1a7a11bc5220f6af147ce17dddcec3ce1221549f7318f787: Status 404 returned error can't find the container with id abd383f53f45131d1a7a11bc5220f6af147ce17dddcec3ce1221549f7318f787 Jun 11 23:32:19.635000 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:19.634957 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8ec8a6_ec32_431f_96aa_a595b6e6d53f.slice/crio-4c0cb0a64d93b5aee7999d7122e1d408fe09cbcaadb85a6538c804e851056a9c WatchSource:0}: Error finding container 4c0cb0a64d93b5aee7999d7122e1d408fe09cbcaadb85a6538c804e851056a9c: Status 404 returned error can't find the container with id 4c0cb0a64d93b5aee7999d7122e1d408fe09cbcaadb85a6538c804e851056a9c Jun 11 23:32:19.636367 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:19.636336 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ebfa027_8e5f_4b63_989d_09e2e5cdf6ed.slice/crio-12dd357811c2f3da14af54f5a4ca38846425ca9a9d91b8285daf8cb31025b1bf WatchSource:0}: Error finding container 12dd357811c2f3da14af54f5a4ca38846425ca9a9d91b8285daf8cb31025b1bf: Status 404 returned error can't find the container with id 12dd357811c2f3da14af54f5a4ca38846425ca9a9d91b8285daf8cb31025b1bf Jun 11 23:32:19.637185 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:19.637165 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fe4fdf_cb86_47f1_8aec_62a5867eeeb3.slice/crio-e27c3d845494e9edb6e26c2843af2add314cdb10eedb4c38903026156f38a803 WatchSource:0}: Error finding container e27c3d845494e9edb6e26c2843af2add314cdb10eedb4c38903026156f38a803: Status 404 returned error can't find the container with id e27c3d845494e9edb6e26c2843af2add314cdb10eedb4c38903026156f38a803 Jun 11 23:32:19.638776 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:19.638748 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4e365c_386c_4127_b26a_27ea56281bc4.slice/crio-c04a2336d1352245158da3c82a3e6dfc58182a7952123757006328a0b2bb5cbd WatchSource:0}: Error finding container c04a2336d1352245158da3c82a3e6dfc58182a7952123757006328a0b2bb5cbd: Status 404 returned error can't find the container with id c04a2336d1352245158da3c82a3e6dfc58182a7952123757006328a0b2bb5cbd Jun 11 23:32:19.641364 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:19.641161 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9028892_956f_45c6_a197_16d553d9eb9e.slice/crio-9e2116ad046909aac0e32532a6cde2b533a29625fd35dbdff2b7b8acc2081458 WatchSource:0}: Error finding container 9e2116ad046909aac0e32532a6cde2b533a29625fd35dbdff2b7b8acc2081458: Status 404 returned error can't find the container with id 9e2116ad046909aac0e32532a6cde2b533a29625fd35dbdff2b7b8acc2081458 Jun 11 23:32:19.644666 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:19.644324 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a1e881_bf63_40df_9147_d7dd0fc22d3c.slice/crio-e05b640090b3159032caab68f4b580b04c5726491027a00d66b6fa0404213790 WatchSource:0}: Error finding container e05b640090b3159032caab68f4b580b04c5726491027a00d66b6fa0404213790: Status 404 returned error can't find the container with id e05b640090b3159032caab68f4b580b04c5726491027a00d66b6fa0404213790 Jun 11 23:32:19.683001 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.682950 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:27:18 +0000 UTC" deadline="2028-01-31 07:42:53.992676676 +0000 UTC" Jun 11 23:32:19.683001 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.682997 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14360h10m34.309683488s" Jun 11 23:32:19.703079 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.703050 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tz4hv" event={"ID":"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3","Type":"ContainerStarted","Data":"86e6290bd1c1b56e364d01a5c2ecb41a9ebafd74dd371333decd1347cb5ffbbb"} Jun 11 23:32:19.703999 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.703973 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" event={"ID":"5a4e365c-386c-4127-b26a-27ea56281bc4","Type":"ContainerStarted","Data":"c04a2336d1352245158da3c82a3e6dfc58182a7952123757006328a0b2bb5cbd"} Jun 11 23:32:19.705011 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.704982 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-crjvj" event={"ID":"9c8cbaaf-e2cd-4364-9a9a-ac388dca0991","Type":"ContainerStarted","Data":"abd383f53f45131d1a7a11bc5220f6af147ce17dddcec3ce1221549f7318f787"} Jun 11 23:32:19.706036 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.706017 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerStarted","Data":"3a24089875a30b65feb0bd8a922b0779ab254993c164c7916a6fa55885521a36"} Jun 11 23:32:19.707064 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.707045 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-56prl" event={"ID":"a9a1e881-bf63-40df-9147-d7dd0fc22d3c","Type":"ContainerStarted","Data":"e05b640090b3159032caab68f4b580b04c5726491027a00d66b6fa0404213790"} Jun 11 23:32:19.708084 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.708062 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7kht" event={"ID":"a9028892-956f-45c6-a197-16d553d9eb9e","Type":"ContainerStarted","Data":"9e2116ad046909aac0e32532a6cde2b533a29625fd35dbdff2b7b8acc2081458"} Jun 11 23:32:19.709044 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.709020 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22xhp" event={"ID":"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed","Type":"ContainerStarted","Data":"12dd357811c2f3da14af54f5a4ca38846425ca9a9d91b8285daf8cb31025b1bf"} Jun 11 23:32:19.709957 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.709936 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmwpt" event={"ID":"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3","Type":"ContainerStarted","Data":"e27c3d845494e9edb6e26c2843af2add314cdb10eedb4c38903026156f38a803"} Jun 11 23:32:19.711002 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:19.710979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8p2hj" event={"ID":"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f","Type":"ContainerStarted","Data":"4c0cb0a64d93b5aee7999d7122e1d408fe09cbcaadb85a6538c804e851056a9c"} Jun 11 23:32:20.257813 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.257077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:20.257813 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.257291 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:20.257813 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.257353 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret podName:f1aa934a-1027-41b7-bfbf-9eeb2bfddce1 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:22.257335426 +0000 UTC m=+5.979871267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret") pod "global-pull-secret-syncer-qngnd" (UID: "f1aa934a-1027-41b7-bfbf-9eeb2bfddce1") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:20.357984 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.357944 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:20.358206 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.358035 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4c7\" (UniqueName: \"kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7\") pod \"network-check-target-qm4gq\" (UID: \"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3\") " pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:20.358206 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.358195 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:20.358356 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.358211 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:20.358356 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.358224 2558 projected.go:196] Error preparing data for projected volume kube-api-access-7n4c7 for pod openshift-network-diagnostics/network-check-target-qm4gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:20.358356 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.358286 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7 podName:19a8b683-e9ae-4a8e-863c-91ce41bf0ca3 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:22.358268367 +0000 UTC m=+6.080804210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n4c7" (UniqueName: "kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7") pod "network-check-target-qm4gq" (UID: "19a8b683-e9ae-4a8e-863c-91ce41bf0ca3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:20.358770 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.358695 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:20.358770 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.358749 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs podName:dda14d2a-dc6e-4531-bb06-0ab0a7b747e0 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:22.358735711 +0000 UTC m=+6.081271553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs") pod "network-metrics-daemon-7zxrn" (UID: "dda14d2a-dc6e-4531-bb06-0ab0a7b747e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:20.684220 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.684166 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:27:18 +0000 UTC" deadline="2027-11-16 15:24:39.60099358 +0000 UTC" Jun 11 23:32:20.684220 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.684205 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12543h52m18.916793412s" Jun 11 23:32:20.694736 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.694659 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:20.694912 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.694886 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:20.697538 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.697251 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:20.697538 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.697382 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:20.697538 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.697432 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:20.697538 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:20.697508 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:20.723361 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.723321 2558 generic.go:356] "Generic (PLEG): container finished" podID="3415ecf8c783ed50447e4624baa8e89e" containerID="3563cad7af43b17c16c9479ba8787d21fb702b00ad910ab7fb3c257bad65f740" exitCode=0 Jun 11 23:32:20.723680 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.723604 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" event={"ID":"3415ecf8c783ed50447e4624baa8e89e","Type":"ContainerDied","Data":"3563cad7af43b17c16c9479ba8787d21fb702b00ad910ab7fb3c257bad65f740"} Jun 11 23:32:20.739301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:20.735818 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal" event={"ID":"1c5239f57b02f406b49d6cca729c0e25","Type":"ContainerStarted","Data":"e08d27209b045b9737c55e8668976bc6a58896ae69bb87259dd6ffad970e5d24"} Jun 11 23:32:21.772615 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:21.772579 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" event={"ID":"3415ecf8c783ed50447e4624baa8e89e","Type":"ContainerStarted","Data":"c9eab9951ba0754ebd419446776677b0298e0a7c9278a6783aa0ee4ab75c2cd7"} Jun 11 23:32:21.789277 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:21.789214 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-183.ec2.internal" podStartSLOduration=3.789189567 podStartE2EDuration="3.789189567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:20.763089534 +0000 UTC m=+4.485625399" watchObservedRunningTime="2026-06-11 23:32:21.789189567 +0000 UTC m=+5.511725432" Jun 11 23:32:22.274343 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:22.274298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:22.274575 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.274557 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:22.274646 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.274623 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret podName:f1aa934a-1027-41b7-bfbf-9eeb2bfddce1 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:26.274605594 +0000 UTC m=+9.997141439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret") pod "global-pull-secret-syncer-qngnd" (UID: "f1aa934a-1027-41b7-bfbf-9eeb2bfddce1") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:22.375085 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:22.375046 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4c7\" (UniqueName: \"kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7\") pod \"network-check-target-qm4gq\" (UID: \"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3\") " pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:22.375255 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:22.375122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:22.375324 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.375257 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:22.375324 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.375316 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs podName:dda14d2a-dc6e-4531-bb06-0ab0a7b747e0 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:26.375299778 +0000 UTC m=+10.097835624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs") pod "network-metrics-daemon-7zxrn" (UID: "dda14d2a-dc6e-4531-bb06-0ab0a7b747e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:22.375577 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.375554 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:22.375649 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.375619 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:22.375649 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.375633 2558 projected.go:196] Error preparing data for projected volume kube-api-access-7n4c7 for pod openshift-network-diagnostics/network-check-target-qm4gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:22.375751 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.375683 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7 podName:19a8b683-e9ae-4a8e-863c-91ce41bf0ca3 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:26.375666249 +0000 UTC m=+10.098202112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n4c7" (UniqueName: "kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7") pod "network-check-target-qm4gq" (UID: "19a8b683-e9ae-4a8e-863c-91ce41bf0ca3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:22.695557 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:22.695525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:22.695736 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:22.695525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:22.695736 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.695657 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:22.695823 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.695761 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:22.695875 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:22.695820 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:22.695949 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:22.695926 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:24.694858 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:24.694825 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:24.695407 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:24.694945 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:24.695407 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:24.694971 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:24.695407 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:24.695056 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:24.695407 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:24.694835 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:24.695407 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:24.695169 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:26.316293 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:26.316254 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:26.316786 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.316444 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:26.316786 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.316514 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret podName:f1aa934a-1027-41b7-bfbf-9eeb2bfddce1 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:34.316493333 +0000 UTC m=+18.039029188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret") pod "global-pull-secret-syncer-qngnd" (UID: "f1aa934a-1027-41b7-bfbf-9eeb2bfddce1") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:26.416932 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:26.416901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:26.417101 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:26.416975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4c7\" (UniqueName: \"kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7\") pod \"network-check-target-qm4gq\" (UID: \"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3\") " pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:26.417101 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.417088 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:26.417101 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.417103 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:26.417216 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.417112 2558 projected.go:196] Error preparing data for projected volume kube-api-access-7n4c7 for pod openshift-network-diagnostics/network-check-target-qm4gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:26.417216 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.417152 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7 podName:19a8b683-e9ae-4a8e-863c-91ce41bf0ca3 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:34.417138369 +0000 UTC m=+18.139674208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n4c7" (UniqueName: "kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7") pod "network-check-target-qm4gq" (UID: "19a8b683-e9ae-4a8e-863c-91ce41bf0ca3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:26.417216 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.417198 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:26.417307 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.417219 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs podName:dda14d2a-dc6e-4531-bb06-0ab0a7b747e0 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:34.417211816 +0000 UTC m=+18.139747656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs") pod "network-metrics-daemon-7zxrn" (UID: "dda14d2a-dc6e-4531-bb06-0ab0a7b747e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:26.695388 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:26.695351 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:26.695581 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:26.695504 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:26.695581 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.695529 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:26.695700 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.695617 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:26.695700 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:26.695671 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:26.695798 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:26.695722 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:28.695075 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:28.695035 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:28.695590 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:28.695174 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:28.695590 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:28.695529 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:28.695590 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:28.695545 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:28.695729 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:28.695614 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:28.695729 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:28.695691 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:30.695346 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:30.695265 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:30.695760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:30.695266 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:30.695760 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:30.695397 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:30.695760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:30.695433 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:30.695760 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:30.695505 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:30.695760 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:30.695586 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:32.694674 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:32.694634 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:32.694674 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:32.694667 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:32.695196 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:32.694634 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:32.695196 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:32.694793 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:32.695196 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:32.694949 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:32.695196 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:32.695004 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:34.381080 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.380872 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:34.381762 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.381035 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:34.381762 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.381167 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret podName:f1aa934a-1027-41b7-bfbf-9eeb2bfddce1 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:50.381147812 +0000 UTC m=+34.103683672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret") pod "global-pull-secret-syncer-qngnd" (UID: "f1aa934a-1027-41b7-bfbf-9eeb2bfddce1") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:34.481714 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.481674 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4c7\" (UniqueName: \"kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7\") pod \"network-check-target-qm4gq\" (UID: \"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3\") " pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:34.481892 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.481746 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:34.481892 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.481812 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:34.481892 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.481841 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:34.481892 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.481854 2558 projected.go:196] Error preparing data for projected volume kube-api-access-7n4c7 for pod openshift-network-diagnostics/network-check-target-qm4gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:34.481892 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.481856 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:34.482121 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.481922 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7 podName:19a8b683-e9ae-4a8e-863c-91ce41bf0ca3 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:50.481904062 +0000 UTC m=+34.204439916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n4c7" (UniqueName: "kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7") pod "network-check-target-qm4gq" (UID: "19a8b683-e9ae-4a8e-863c-91ce41bf0ca3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:34.482121 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.481945 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs podName:dda14d2a-dc6e-4531-bb06-0ab0a7b747e0 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:50.481936239 +0000 UTC m=+34.204472080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs") pod "network-metrics-daemon-7zxrn" (UID: "dda14d2a-dc6e-4531-bb06-0ab0a7b747e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:34.695210 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.695130 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:34.695367 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.695261 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:34.695367 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.695136 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:34.695509 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.695372 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:34.695509 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.695129 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:34.695509 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:34.695481 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:34.804153 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.804115 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22xhp" event={"ID":"0ebfa027-8e5f-4b63-989d-09e2e5cdf6ed","Type":"ContainerStarted","Data":"9303c60fc28ad8833218cd029a402fd94296e95a0efd49a875e3be1d8cb3e92f"} Jun 11 23:32:34.805901 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.805870 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8p2hj" event={"ID":"ad8ec8a6-ec32-431f-96aa-a595b6e6d53f","Type":"ContainerStarted","Data":"7c40b35bce55c4d339e2c1905d9395cbd8822aab31bcda17b7ecaf11b4f1737b"} Jun 11 23:32:34.807541 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.807499 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tz4hv" event={"ID":"6220ce74-b1b0-48b3-ae6a-dbc39011dbe3","Type":"ContainerStarted","Data":"6afa36e2faa781a0d24b22313d19127b6b85ad450151509ae22a74d388c82c91"} Jun 11 23:32:34.809040 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.809014 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" event={"ID":"5a4e365c-386c-4127-b26a-27ea56281bc4","Type":"ContainerStarted","Data":"2ea3411de3cccc65a4567fb1493a25363e0a50f2e81159037d186732f7f909b8"} Jun 11 23:32:34.810646 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.810612 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-crjvj" event={"ID":"9c8cbaaf-e2cd-4364-9a9a-ac388dca0991","Type":"ContainerStarted","Data":"11374f704218bcea41d06da66bb708c5b04b265ad71ae9fe760963e57b8b2600"} Jun 11 23:32:34.812558 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.812170 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-56prl" event={"ID":"a9a1e881-bf63-40df-9147-d7dd0fc22d3c","Type":"ContainerStarted","Data":"8fd828b147a7a178a073392c5af36e1a54099661948a2ee2feb849a416220e04"} Jun 11 23:32:34.813869 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.813844 2558 generic.go:356] "Generic (PLEG): container finished" podID="a9028892-956f-45c6-a197-16d553d9eb9e" containerID="f303e5cb7f6ceefad35fed7d00042e59dc52905396b050f1c5cbe3f2e4ccdff5" exitCode=0 Jun 11 23:32:34.813952 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.813880 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7kht" event={"ID":"a9028892-956f-45c6-a197-16d553d9eb9e","Type":"ContainerDied","Data":"f303e5cb7f6ceefad35fed7d00042e59dc52905396b050f1c5cbe3f2e4ccdff5"} Jun 11 23:32:34.821426 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.821369 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-183.ec2.internal" podStartSLOduration=16.82135066 podStartE2EDuration="16.82135066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:21.789976604 +0000 UTC m=+5.512512468" watchObservedRunningTime="2026-06-11 23:32:34.82135066 +0000 UTC m=+18.543886523" Jun 11 23:32:34.837607 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.837540 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-22xhp" podStartSLOduration=4.7017309659999995 podStartE2EDuration="18.837520688s" totalImagesPullingTime="14.135789722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:34.82180398 +0000 UTC m=+18.544339843" watchObservedRunningTime="2026-06-11 23:32:34.837520688 +0000 UTC m=+18.560056551" Jun 11 23:32:34.837767 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.837708 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tz4hv" podStartSLOduration=3.721288202 podStartE2EDuration="17.837702084s" totalImagesPullingTime="14.116413882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:34.836192985 +0000 UTC m=+18.558728848" watchObservedRunningTime="2026-06-11 23:32:34.837702084 +0000 UTC m=+18.560237947" Jun 11 23:32:34.883139 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.883083 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-crjvj" podStartSLOduration=4.811365717 podStartE2EDuration="18.883067083s" totalImagesPullingTime="14.071701366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:34.882614102 +0000 UTC m=+18.605149987" watchObservedRunningTime="2026-06-11 23:32:34.883067083 +0000 UTC m=+18.605602944" Jun 11 23:32:34.898476 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.898399 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8p2hj" podStartSLOduration=3.786829925 podStartE2EDuration="17.898357965s" totalImagesPullingTime="14.11152804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:34.89740495 +0000 UTC m=+18.619940812" watchObservedRunningTime="2026-06-11 23:32:34.898357965 +0000 UTC m=+18.620893827" Jun 11 23:32:34.917318 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:34.917259 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-56prl" podStartSLOduration=4.725912085 podStartE2EDuration="18.91723952s" totalImagesPullingTime="14.191327435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:34.916703424 +0000 UTC m=+18.639239287" watchObservedRunningTime="2026-06-11 23:32:34.91723952 +0000 UTC m=+18.639775382" Jun 11 23:32:35.818146 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:35.818096 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmwpt" event={"ID":"16fe4fdf-cb86-47f1-8aec-62a5867eeeb3","Type":"ContainerStarted","Data":"4cf3d8467fb28f1c0f8adf84e2410f6663616517051c57296ff61b84f25c6bf0"} Jun 11 23:32:35.833428 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:35.833365 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fmwpt" podStartSLOduration=4.723970092 podStartE2EDuration="18.833343966s" totalImagesPullingTime="14.109373874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:35.833260111 +0000 UTC m=+19.555796000" watchObservedRunningTime="2026-06-11 23:32:35.833343966 +0000 UTC m=+19.555879841" Jun 11 23:32:36.694963 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:36.694936 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:36.695230 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:36.695010 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:36.695230 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:36.695027 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:36.695230 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:36.695120 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:36.695230 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:36.695160 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:36.695479 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:36.695269 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:38.694769 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:38.694535 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:38.695214 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:38.694535 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:38.695214 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:38.694873 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:38.695214 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:38.694958 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:38.695214 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:38.694543 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:38.695214 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:38.695068 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:38.826020 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:38.825986 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerStarted","Data":"ae12977d575bbf605f74d3846271748c0f2c7680ebf7df57bd5fa9be249e3df8"} Jun 11 23:32:38.826194 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:38.826081 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerStarted","Data":"aea3ce51d8218e6e6ecd8e3d6540b88e57732ce8ebc24b954ede3fae64ff6075"} Jun 11 23:32:39.583650 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.583464 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:39.587564 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.587542 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:39.599542 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.599521 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 23:32:39.706911 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.706818 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T23:32:39.599536345Z","UUID":"28a4da70-24d0-4eff-90db-0e8c37f821af","Handler":null,"Name":"","Endpoint":""} Jun 11 23:32:39.708654 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.708628 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 23:32:39.708784 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.708670 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 23:32:39.830453 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.830344 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" event={"ID":"5a4e365c-386c-4127-b26a-27ea56281bc4","Type":"ContainerStarted","Data":"d3d5f98994d4f14939190eb7f9d9d86f825f45c8e8564023429c8ca444c1ac85"} Jun 11 23:32:39.833282 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.833259 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:32:39.833644 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.833623 2558 generic.go:356] "Generic (PLEG): container finished" podID="266b6897-265f-4c0e-aa76-50d81144c6a7" containerID="ae12977d575bbf605f74d3846271748c0f2c7680ebf7df57bd5fa9be249e3df8" exitCode=1 Jun 11 23:32:39.833732 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.833704 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerDied","Data":"ae12977d575bbf605f74d3846271748c0f2c7680ebf7df57bd5fa9be249e3df8"} Jun 11 23:32:39.833802 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.833786 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerStarted","Data":"2c6cb185410f8b6a48367ccc3868547e02806666e071d1ba5ca1d8db96d8fbca"} Jun 11 23:32:39.833861 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.833847 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerStarted","Data":"cf3c2f697793c492b7eeadd2e13150b4464eccf431e3135e47276335127c5c1b"} Jun 11 23:32:39.833902 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.833890 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerStarted","Data":"690508fcc94c46c86dc2ae44d89fe825917319cac72b232e6f920b15a4f01e59"} Jun 11 23:32:39.833940 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:39.833920 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerStarted","Data":"ac87d112f7ef88758bfba23cb6c7891afcca0ed28be210de8bcfa1337278435e"} Jun 11 23:32:40.694932 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:40.694837 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:40.695100 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:40.694840 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:40.695100 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:40.694951 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:40.695100 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:40.694840 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:40.695100 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:40.695038 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:40.695257 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:40.695132 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:40.837928 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:40.837896 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" event={"ID":"5a4e365c-386c-4127-b26a-27ea56281bc4","Type":"ContainerStarted","Data":"92b119bc0263ec3efaa0ea3f9fa551f014780f4222ec0b679fd9faf51e74e4b9"} Jun 11 23:32:40.873004 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:40.872944 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l4k8f" podStartSLOduration=7.438972091 podStartE2EDuration="23.872925541s" totalImagesPullingTime="16.43395345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:40.872857702 +0000 UTC m=+24.595393564" watchObservedRunningTime="2026-06-11 23:32:40.872925541 +0000 UTC m=+24.595461406" Jun 11 23:32:40.975521 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:40.975406 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:40.975675 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:40.975556 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 23:32:40.976041 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:40.976024 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-crjvj" Jun 11 23:32:41.845597 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:41.845571 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:32:41.845992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:41.845875 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerStarted","Data":"58bc0eb8a16a9ea7f386c8f38967965236b7fce4314920da97aedada248955ca"} Jun 11 23:32:42.694405 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:42.694374 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:42.694602 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:42.694375 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:42.694602 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:42.694503 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:42.694602 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:42.694514 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:42.694761 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:42.694649 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:42.694761 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:42.694727 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:44.695067 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:44.694876 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:44.695548 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:44.694876 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:44.695548 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:44.695148 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:44.695548 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:44.695212 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:44.695548 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:44.694893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:44.695548 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:44.695275 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:44.855318 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:44.855284 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:32:44.855664 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:44.855642 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerStarted","Data":"a0f639f965bc53639bf6bb001206cf514f623eac8f267237489ec66724982c41"} Jun 11 23:32:44.855927 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:44.855896 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:44.856056 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:44.856032 2558 scope.go:117] "RemoveContainer" containerID="ae12977d575bbf605f74d3846271748c0f2c7680ebf7df57bd5fa9be249e3df8" Jun 11 23:32:44.857599 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:44.857574 2558 generic.go:356] "Generic (PLEG): container finished" podID="a9028892-956f-45c6-a197-16d553d9eb9e" containerID="1bead002ed000e370250134c7408ce9e615c2fceea425822e68ead16464c397e" exitCode=0 Jun 11 23:32:44.857726 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:44.857606 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7kht" event={"ID":"a9028892-956f-45c6-a197-16d553d9eb9e","Type":"ContainerDied","Data":"1bead002ed000e370250134c7408ce9e615c2fceea425822e68ead16464c397e"} Jun 11 23:32:44.875301 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:44.875278 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:45.864183 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:45.864160 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:32:45.864686 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:45.864564 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" event={"ID":"266b6897-265f-4c0e-aa76-50d81144c6a7","Type":"ContainerStarted","Data":"5fb1d44e4425316c2f56a01afbe96e312bdf7815030581c423ea9f7ad08997bb"} Jun 11 23:32:45.864929 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:45.864904 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:45.865061 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:45.864984 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:45.880951 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:45.880927 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:32:45.893556 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:45.893505 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" podStartSLOduration=9.898983302 podStartE2EDuration="28.893489741s" totalImagesPullingTime="18.994506439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:45.892253965 +0000 UTC m=+29.614789828" watchObservedRunningTime="2026-06-11 23:32:45.893489741 +0000 UTC m=+29.616025636" Jun 11 23:32:46.243898 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:46.243816 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qm4gq"] Jun 11 23:32:46.244030 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:46.243953 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:46.244069 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:46.244032 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:46.247216 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:46.247025 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qngnd"] Jun 11 23:32:46.247216 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:46.247137 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:46.247410 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:46.247234 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:46.247576 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:46.247558 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7zxrn"] Jun 11 23:32:46.247668 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:46.247642 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:46.247785 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:46.247739 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:46.868491 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:46.868457 2558 generic.go:356] "Generic (PLEG): container finished" podID="a9028892-956f-45c6-a197-16d553d9eb9e" containerID="2058aa975c733bc96d41f667cb996e02691badd556672040e3b0d21eadda3863" exitCode=0 Jun 11 23:32:46.868882 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:46.868539 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7kht" event={"ID":"a9028892-956f-45c6-a197-16d553d9eb9e","Type":"ContainerDied","Data":"2058aa975c733bc96d41f667cb996e02691badd556672040e3b0d21eadda3863"} Jun 11 23:32:47.694238 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:47.694205 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:47.694393 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:47.694211 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:47.694393 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:47.694310 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:47.694486 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:47.694211 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:47.694486 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:47.694396 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:47.694568 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:47.694494 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:48.875156 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:48.874909 2558 generic.go:356] "Generic (PLEG): container finished" podID="a9028892-956f-45c6-a197-16d553d9eb9e" containerID="7937a50136c341128b71c9821cb3cfa9781c728bdfd9ce1b7f7a5ebede086ca1" exitCode=0 Jun 11 23:32:48.875711 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:48.874992 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7kht" event={"ID":"a9028892-956f-45c6-a197-16d553d9eb9e","Type":"ContainerDied","Data":"7937a50136c341128b71c9821cb3cfa9781c728bdfd9ce1b7f7a5ebede086ca1"} Jun 11 23:32:49.694132 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:49.694104 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:49.694132 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:49.694127 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:49.694364 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:49.694104 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:49.694364 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:49.694234 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:32:49.694364 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:49.694289 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qm4gq" podUID="19a8b683-e9ae-4a8e-863c-91ce41bf0ca3" Jun 11 23:32:49.694540 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:49.694360 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qngnd" podUID="f1aa934a-1027-41b7-bfbf-9eeb2bfddce1" Jun 11 23:32:50.394596 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:50.394552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:50.395095 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:50.394702 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:50.395095 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:50.394766 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret podName:f1aa934a-1027-41b7-bfbf-9eeb2bfddce1 nodeName:}" failed. No retries permitted until 2026-06-11 23:33:22.394747553 +0000 UTC m=+66.117283413 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret") pod "global-pull-secret-syncer-qngnd" (UID: "f1aa934a-1027-41b7-bfbf-9eeb2bfddce1") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:50.495346 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:50.495310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:50.495551 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:50.495389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4c7\" (UniqueName: \"kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7\") pod \"network-check-target-qm4gq\" (UID: \"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3\") " pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:50.495551 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:50.495491 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:50.495551 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:50.495511 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:50.495551 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:50.495524 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:50.495551 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:50.495536 2558 projected.go:196] Error preparing data for projected volume kube-api-access-7n4c7 for pod openshift-network-diagnostics/network-check-target-qm4gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:50.495750 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:50.495562 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs podName:dda14d2a-dc6e-4531-bb06-0ab0a7b747e0 nodeName:}" failed. No retries permitted until 2026-06-11 23:33:22.495543386 +0000 UTC m=+66.218079246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs") pod "network-metrics-daemon-7zxrn" (UID: "dda14d2a-dc6e-4531-bb06-0ab0a7b747e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:50.495750 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:50.495579 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7 podName:19a8b683-e9ae-4a8e-863c-91ce41bf0ca3 nodeName:}" failed. No retries permitted until 2026-06-11 23:33:22.495570416 +0000 UTC m=+66.218106259 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7n4c7" (UniqueName: "kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7") pod "network-check-target-qm4gq" (UID: "19a8b683-e9ae-4a8e-863c-91ce41bf0ca3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:51.622436 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.622392 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-183.ec2.internal" event="NodeReady" Jun 11 23:32:51.622864 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.622546 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 23:32:51.656530 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.656491 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb"] Jun 11 23:32:51.672188 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.672122 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85f6fb5c6b-6ddx7"] Jun 11 23:32:51.672371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.672242 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" Jun 11 23:32:51.675272 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.675234 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 23:32:51.675513 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.675498 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 23:32:51.675673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.675658 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sltfr\"" Jun 11 23:32:51.678294 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.675941 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 23:32:51.678294 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.676183 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 23:32:51.682502 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.681655 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7"] Jun 11 23:32:51.682502 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.681837 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.684437 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.684390 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 23:32:51.684693 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.684645 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7rvk7\"" Jun 11 23:32:51.684693 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.684643 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 23:32:51.684833 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.684675 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 23:32:51.690541 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.690520 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 23:32:51.696279 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.696253 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz"] Jun 11 23:32:51.696933 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.696916 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.699635 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.699603 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 23:32:51.699635 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.699616 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 23:32:51.700064 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.700020 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 23:32:51.701935 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.701913 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 23:32:51.710281 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.710259 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb"] Jun 11 23:32:51.710384 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.710322 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz"] Jun 11 23:32:51.710384 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.710336 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7"] Jun 11 23:32:51.710384 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.710348 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85f6fb5c6b-6ddx7"] Jun 11 23:32:51.710384 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.710363 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-htfbs"] Jun 11 23:32:51.710620 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.710433 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:32:51.710620 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.710475 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:51.710620 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.710510 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:32:51.710760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.710718 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:32:51.714673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.714634 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:32:51.715269 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.714893 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:32:51.715269 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.715064 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mx7t4\"" Jun 11 23:32:51.715269 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.715174 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:32:51.715525 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.715506 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x5wbg\"" Jun 11 23:32:51.715805 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.715784 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 23:32:51.716395 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.716377 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:32:51.725196 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.725171 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k4hdg"] Jun 11 23:32:51.725326 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.725304 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.727884 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.727864 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 23:32:51.727989 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.727938 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krlkn\"" Jun 11 23:32:51.727989 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.727958 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 23:32:51.739618 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.739587 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k4hdg"] Jun 11 23:32:51.739722 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.739626 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-htfbs"] Jun 11 23:32:51.739722 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.739708 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k4hdg" Jun 11 23:32:51.742293 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.742272 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 23:32:51.742393 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.742305 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 23:32:51.742393 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.742354 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 23:32:51.742539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.742475 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pzwgk\"" Jun 11 23:32:51.805108 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3ba3755-0756-47b5-a08c-fdfc07cf333e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85ff9896d4-bxpsb\" (UID: \"b3ba3755-0756-47b5-a08c-fdfc07cf333e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" Jun 11 23:32:51.805273 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805194 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51ab87a8-031d-453d-a44b-f10d222141fa-tmp-dir\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.805341 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c57db9a9-04b8-4419-8333-e908c355cb5b-ca-trust-extracted\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.805341 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.805341 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805332 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.805506 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805358 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tk2s\" (UniqueName: \"kubernetes.io/projected/51ab87a8-031d-453d-a44b-f10d222141fa-kube-api-access-5tk2s\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.805506 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df7k7\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-kube-api-access-df7k7\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.805590 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-ca\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.805590 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805540 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-hub\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.805590 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805563 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tktsc\" (UniqueName: \"kubernetes.io/projected/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-kube-api-access-tktsc\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.805719 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805606 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.805719 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805679 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-bound-sa-token\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.805797 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805741 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.805797 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805759 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-certificates\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.805871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.805871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805831 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-image-registry-private-configuration\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.805871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805858 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-trusted-ca\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.806010 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-installation-pull-secrets\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.806010 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.805971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j42zv\" (UniqueName: \"kubernetes.io/projected/b3ba3755-0756-47b5-a08c-fdfc07cf333e-kube-api-access-j42zv\") pod \"managed-serviceaccount-addon-agent-85ff9896d4-bxpsb\" (UID: \"b3ba3755-0756-47b5-a08c-fdfc07cf333e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" Jun 11 23:32:51.806111 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.806017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/11566a17-02e0-4a6c-a3fa-6dbd1f943b35-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c4994b788-dpdrz\" (UID: \"11566a17-02e0-4a6c-a3fa-6dbd1f943b35\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:51.806111 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.806053 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5n89\" (UniqueName: \"kubernetes.io/projected/11566a17-02e0-4a6c-a3fa-6dbd1f943b35-kube-api-access-q5n89\") pod \"klusterlet-addon-workmgr-6c4994b788-dpdrz\" (UID: \"11566a17-02e0-4a6c-a3fa-6dbd1f943b35\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:51.806111 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.806095 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11566a17-02e0-4a6c-a3fa-6dbd1f943b35-tmp\") pod \"klusterlet-addon-workmgr-6c4994b788-dpdrz\" (UID: \"11566a17-02e0-4a6c-a3fa-6dbd1f943b35\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:51.806307 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.806119 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51ab87a8-031d-453d-a44b-f10d222141fa-config-volume\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.836789 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.836746 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:51.906609 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906518 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.906609 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906569 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906694 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tk2s\" (UniqueName: \"kubernetes.io/projected/51ab87a8-031d-453d-a44b-f10d222141fa-kube-api-access-5tk2s\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df7k7\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-kube-api-access-df7k7\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-ca\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906808 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-hub\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906831 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tktsc\" (UniqueName: \"kubernetes.io/projected/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-kube-api-access-tktsc\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-bound-sa-token\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906919 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-certificates\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.906992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.906996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-image-registry-private-configuration\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-trusted-ca\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-installation-pull-secrets\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j42zv\" (UniqueName: \"kubernetes.io/projected/b3ba3755-0756-47b5-a08c-fdfc07cf333e-kube-api-access-j42zv\") pod \"managed-serviceaccount-addon-agent-85ff9896d4-bxpsb\" (UID: \"b3ba3755-0756-47b5-a08c-fdfc07cf333e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907141 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/11566a17-02e0-4a6c-a3fa-6dbd1f943b35-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c4994b788-dpdrz\" (UID: \"11566a17-02e0-4a6c-a3fa-6dbd1f943b35\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5n89\" (UniqueName: \"kubernetes.io/projected/11566a17-02e0-4a6c-a3fa-6dbd1f943b35-kube-api-access-q5n89\") pod \"klusterlet-addon-workmgr-6c4994b788-dpdrz\" (UID: \"11566a17-02e0-4a6c-a3fa-6dbd1f943b35\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907230 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6jmj\" (UniqueName: \"kubernetes.io/projected/ab72fbbb-b32d-4fd3-8544-e43364ac371c-kube-api-access-r6jmj\") pod \"ingress-canary-k4hdg\" (UID: \"ab72fbbb-b32d-4fd3-8544-e43364ac371c\") " pod="openshift-ingress-canary/ingress-canary-k4hdg" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907264 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11566a17-02e0-4a6c-a3fa-6dbd1f943b35-tmp\") pod \"klusterlet-addon-workmgr-6c4994b788-dpdrz\" (UID: \"11566a17-02e0-4a6c-a3fa-6dbd1f943b35\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51ab87a8-031d-453d-a44b-f10d222141fa-config-volume\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3ba3755-0756-47b5-a08c-fdfc07cf333e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85ff9896d4-bxpsb\" (UID: \"b3ba3755-0756-47b5-a08c-fdfc07cf333e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51ab87a8-031d-453d-a44b-f10d222141fa-tmp-dir\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907437 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c57db9a9-04b8-4419-8333-e908c355cb5b-ca-trust-extracted\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.907593 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.907473 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab72fbbb-b32d-4fd3-8544-e43364ac371c-cert\") pod \"ingress-canary-k4hdg\" (UID: \"ab72fbbb-b32d-4fd3-8544-e43364ac371c\") " pod="openshift-ingress-canary/ingress-canary-k4hdg" Jun 11 23:32:51.908149 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:51.907613 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:32:51.908149 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:51.907629 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f6fb5c6b-6ddx7: secret "image-registry-tls" not found Jun 11 23:32:51.908149 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:51.907681 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls podName:c57db9a9-04b8-4419-8333-e908c355cb5b nodeName:}" failed. No retries permitted until 2026-06-11 23:32:52.407663461 +0000 UTC m=+36.130199316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls") pod "image-registry-85f6fb5c6b-6ddx7" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b") : secret "image-registry-tls" not found Jun 11 23:32:51.908376 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.908157 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.908376 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.908318 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11566a17-02e0-4a6c-a3fa-6dbd1f943b35-tmp\") pod \"klusterlet-addon-workmgr-6c4994b788-dpdrz\" (UID: \"11566a17-02e0-4a6c-a3fa-6dbd1f943b35\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:51.909054 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.908537 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-certificates\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.909054 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:51.908609 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:32:51.909054 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:51.908666 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls podName:51ab87a8-031d-453d-a44b-f10d222141fa nodeName:}" failed. No retries permitted until 2026-06-11 23:32:52.408648136 +0000 UTC m=+36.131183982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls") pod "dns-default-htfbs" (UID: "51ab87a8-031d-453d-a44b-f10d222141fa") : secret "dns-default-metrics-tls" not found Jun 11 23:32:51.909054 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.908816 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51ab87a8-031d-453d-a44b-f10d222141fa-config-volume\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.909541 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.909517 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-trusted-ca\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.909784 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.909757 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51ab87a8-031d-453d-a44b-f10d222141fa-tmp-dir\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.909854 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.909819 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c57db9a9-04b8-4419-8333-e908c355cb5b-ca-trust-extracted\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.912710 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.912683 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.912816 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.912750 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/11566a17-02e0-4a6c-a3fa-6dbd1f943b35-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c4994b788-dpdrz\" (UID: \"11566a17-02e0-4a6c-a3fa-6dbd1f943b35\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:51.913880 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.913793 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-hub\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.913880 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.913834 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-installation-pull-secrets\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.914406 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.914379 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-ca\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.916691 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.916648 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.918374 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.918352 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3ba3755-0756-47b5-a08c-fdfc07cf333e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85ff9896d4-bxpsb\" (UID: \"b3ba3755-0756-47b5-a08c-fdfc07cf333e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" Jun 11 23:32:51.918760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.918731 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-bound-sa-token\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.920058 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.920000 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df7k7\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-kube-api-access-df7k7\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.920058 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.920016 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j42zv\" (UniqueName: \"kubernetes.io/projected/b3ba3755-0756-47b5-a08c-fdfc07cf333e-kube-api-access-j42zv\") pod \"managed-serviceaccount-addon-agent-85ff9896d4-bxpsb\" (UID: \"b3ba3755-0756-47b5-a08c-fdfc07cf333e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" Jun 11 23:32:51.920286 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.920265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5n89\" (UniqueName: \"kubernetes.io/projected/11566a17-02e0-4a6c-a3fa-6dbd1f943b35-kube-api-access-q5n89\") pod \"klusterlet-addon-workmgr-6c4994b788-dpdrz\" (UID: \"11566a17-02e0-4a6c-a3fa-6dbd1f943b35\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:51.920776 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.920752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-image-registry-private-configuration\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:51.921305 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.921283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tktsc\" (UniqueName: \"kubernetes.io/projected/89d9f4b3-5496-4f2e-9aac-daa3387f6cc9-kube-api-access-tktsc\") pod \"cluster-proxy-proxy-agent-695f47b76c-vzwk7\" (UID: \"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:51.921838 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.921812 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:51.928047 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.928026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tk2s\" (UniqueName: \"kubernetes.io/projected/51ab87a8-031d-453d-a44b-f10d222141fa-kube-api-access-5tk2s\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:51.983621 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.983584 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:51.996379 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:51.996349 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" Jun 11 23:32:52.008804 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.008773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6jmj\" (UniqueName: \"kubernetes.io/projected/ab72fbbb-b32d-4fd3-8544-e43364ac371c-kube-api-access-r6jmj\") pod \"ingress-canary-k4hdg\" (UID: \"ab72fbbb-b32d-4fd3-8544-e43364ac371c\") " pod="openshift-ingress-canary/ingress-canary-k4hdg" Jun 11 23:32:52.008985 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.008835 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab72fbbb-b32d-4fd3-8544-e43364ac371c-cert\") pod \"ingress-canary-k4hdg\" (UID: \"ab72fbbb-b32d-4fd3-8544-e43364ac371c\") " pod="openshift-ingress-canary/ingress-canary-k4hdg" Jun 11 23:32:52.011704 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.011675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab72fbbb-b32d-4fd3-8544-e43364ac371c-cert\") pod \"ingress-canary-k4hdg\" (UID: \"ab72fbbb-b32d-4fd3-8544-e43364ac371c\") " pod="openshift-ingress-canary/ingress-canary-k4hdg" Jun 11 23:32:52.013470 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.013443 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:32:52.018000 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.017970 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6jmj\" (UniqueName: \"kubernetes.io/projected/ab72fbbb-b32d-4fd3-8544-e43364ac371c-kube-api-access-r6jmj\") pod \"ingress-canary-k4hdg\" (UID: \"ab72fbbb-b32d-4fd3-8544-e43364ac371c\") " pod="openshift-ingress-canary/ingress-canary-k4hdg" Jun 11 23:32:52.035448 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.035394 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:32:52.068056 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.068027 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k4hdg" Jun 11 23:32:52.277359 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:52.277324 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11566a17_02e0_4a6c_a3fa_6dbd1f943b35.slice/crio-1d00b3e7f4241a1bacc5f1971c26d82df240d3463cca3f7e429ccc241ef30c30 WatchSource:0}: Error finding container 1d00b3e7f4241a1bacc5f1971c26d82df240d3463cca3f7e429ccc241ef30c30: Status 404 returned error can't find the container with id 1d00b3e7f4241a1bacc5f1971c26d82df240d3463cca3f7e429ccc241ef30c30 Jun 11 23:32:52.278699 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.278669 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz"] Jun 11 23:32:52.287302 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.287279 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7"] Jun 11 23:32:52.289678 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:52.289649 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89d9f4b3_5496_4f2e_9aac_daa3387f6cc9.slice/crio-3783d418ff4ec25b48c903044b93f91ae79ca04f309c642d8219744a2adc53fb WatchSource:0}: Error finding container 3783d418ff4ec25b48c903044b93f91ae79ca04f309c642d8219744a2adc53fb: Status 404 returned error can't find the container with id 3783d418ff4ec25b48c903044b93f91ae79ca04f309c642d8219744a2adc53fb Jun 11 23:32:52.307765 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.307733 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb"] Jun 11 23:32:52.310519 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:52.310496 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3ba3755_0756_47b5_a08c_fdfc07cf333e.slice/crio-7de68b20a2caf9e4195431a9b8446ecdf38d4d668ccc26f0aa38e6c3ad56ce01 WatchSource:0}: Error finding container 7de68b20a2caf9e4195431a9b8446ecdf38d4d668ccc26f0aa38e6c3ad56ce01: Status 404 returned error can't find the container with id 7de68b20a2caf9e4195431a9b8446ecdf38d4d668ccc26f0aa38e6c3ad56ce01 Jun 11 23:32:52.313536 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.313517 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k4hdg"] Jun 11 23:32:52.316722 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:32:52.316700 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab72fbbb_b32d_4fd3_8544_e43364ac371c.slice/crio-9e50cc460ce1f9b27eed780feb11ba1ab0f6f529a1218956ffc9da9b7680b9c9 WatchSource:0}: Error finding container 9e50cc460ce1f9b27eed780feb11ba1ab0f6f529a1218956ffc9da9b7680b9c9: Status 404 returned error can't find the container with id 9e50cc460ce1f9b27eed780feb11ba1ab0f6f529a1218956ffc9da9b7680b9c9 Jun 11 23:32:52.412377 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.412344 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:52.412584 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.412451 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:52.412584 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:52.412530 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:32:52.412584 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:52.412576 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:32:52.412726 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:52.412591 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f6fb5c6b-6ddx7: secret "image-registry-tls" not found Jun 11 23:32:52.412726 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:52.412609 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls podName:51ab87a8-031d-453d-a44b-f10d222141fa nodeName:}" failed. No retries permitted until 2026-06-11 23:32:53.412589984 +0000 UTC m=+37.135125843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls") pod "dns-default-htfbs" (UID: "51ab87a8-031d-453d-a44b-f10d222141fa") : secret "dns-default-metrics-tls" not found Jun 11 23:32:52.412726 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:52.412639 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls podName:c57db9a9-04b8-4419-8333-e908c355cb5b nodeName:}" failed. No retries permitted until 2026-06-11 23:32:53.412624524 +0000 UTC m=+37.135160367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls") pod "image-registry-85f6fb5c6b-6ddx7" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b") : secret "image-registry-tls" not found Jun 11 23:32:52.642649 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.642596 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:52.728603 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.728568 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:52.803162 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.803117 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:52.887048 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.887018 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k4hdg" event={"ID":"ab72fbbb-b32d-4fd3-8544-e43364ac371c","Type":"ContainerStarted","Data":"9e50cc460ce1f9b27eed780feb11ba1ab0f6f529a1218956ffc9da9b7680b9c9"} Jun 11 23:32:52.888174 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.888151 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" event={"ID":"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9","Type":"ContainerStarted","Data":"3783d418ff4ec25b48c903044b93f91ae79ca04f309c642d8219744a2adc53fb"} Jun 11 23:32:52.889288 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.889265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" event={"ID":"b3ba3755-0756-47b5-a08c-fdfc07cf333e","Type":"ContainerStarted","Data":"7de68b20a2caf9e4195431a9b8446ecdf38d4d668ccc26f0aa38e6c3ad56ce01"} Jun 11 23:32:52.890357 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:52.890338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" event={"ID":"11566a17-02e0-4a6c-a3fa-6dbd1f943b35","Type":"ContainerStarted","Data":"1d00b3e7f4241a1bacc5f1971c26d82df240d3463cca3f7e429ccc241ef30c30"} Jun 11 23:32:53.421310 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:53.421269 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:53.421512 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:53.421351 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:53.421883 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:53.421860 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:32:53.421963 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:53.421952 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls podName:51ab87a8-031d-453d-a44b-f10d222141fa nodeName:}" failed. No retries permitted until 2026-06-11 23:32:55.421931943 +0000 UTC m=+39.144467785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls") pod "dns-default-htfbs" (UID: "51ab87a8-031d-453d-a44b-f10d222141fa") : secret "dns-default-metrics-tls" not found Jun 11 23:32:53.433578 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:53.430603 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:32:53.433578 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:53.430632 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f6fb5c6b-6ddx7: secret "image-registry-tls" not found Jun 11 23:32:53.433578 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:53.430738 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls podName:c57db9a9-04b8-4419-8333-e908c355cb5b nodeName:}" failed. No retries permitted until 2026-06-11 23:32:55.430685918 +0000 UTC m=+39.153221783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls") pod "image-registry-85f6fb5c6b-6ddx7" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b") : secret "image-registry-tls" not found Jun 11 23:32:54.692320 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:54.692283 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:54.752973 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:54.752860 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:55.442232 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:55.441445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:55.442232 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:55.441527 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:55.442232 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:55.441680 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:32:55.442232 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:55.441742 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls podName:51ab87a8-031d-453d-a44b-f10d222141fa nodeName:}" failed. No retries permitted until 2026-06-11 23:32:59.441722302 +0000 UTC m=+43.164258165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls") pod "dns-default-htfbs" (UID: "51ab87a8-031d-453d-a44b-f10d222141fa") : secret "dns-default-metrics-tls" not found Jun 11 23:32:55.442232 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:55.442134 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:32:55.442232 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:55.442151 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f6fb5c6b-6ddx7: secret "image-registry-tls" not found Jun 11 23:32:55.442232 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:55.442192 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls podName:c57db9a9-04b8-4419-8333-e908c355cb5b nodeName:}" failed. No retries permitted until 2026-06-11 23:32:59.442176342 +0000 UTC m=+43.164712183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls") pod "image-registry-85f6fb5c6b-6ddx7" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b") : secret "image-registry-tls" not found Jun 11 23:32:55.650923 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:55.650879 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:56.330972 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:56.330922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:56.382386 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:56.382345 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:32:59.478549 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:59.478504 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:32:59.479029 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:32:59.478584 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:32:59.479029 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:59.478631 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:32:59.479029 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:59.478651 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f6fb5c6b-6ddx7: secret "image-registry-tls" not found Jun 11 23:32:59.479029 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:59.478723 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls podName:c57db9a9-04b8-4419-8333-e908c355cb5b nodeName:}" failed. No retries permitted until 2026-06-11 23:33:07.478701598 +0000 UTC m=+51.201237448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls") pod "image-registry-85f6fb5c6b-6ddx7" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b") : secret "image-registry-tls" not found Jun 11 23:32:59.479029 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:59.478757 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:32:59.479029 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:32:59.478828 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls podName:51ab87a8-031d-453d-a44b-f10d222141fa nodeName:}" failed. No retries permitted until 2026-06-11 23:33:07.478809501 +0000 UTC m=+51.201345342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls") pod "dns-default-htfbs" (UID: "51ab87a8-031d-453d-a44b-f10d222141fa") : secret "dns-default-metrics-tls" not found Jun 11 23:33:00.915720 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.915686 2558 generic.go:356] "Generic (PLEG): container finished" podID="a9028892-956f-45c6-a197-16d553d9eb9e" containerID="8a6541e72020120a72a4123925cc9a44025035717893d7bf3f1417a487d00f00" exitCode=0 Jun 11 23:33:00.916197 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.915768 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7kht" event={"ID":"a9028892-956f-45c6-a197-16d553d9eb9e","Type":"ContainerDied","Data":"8a6541e72020120a72a4123925cc9a44025035717893d7bf3f1417a487d00f00"} Jun 11 23:33:00.917368 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.917343 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k4hdg" event={"ID":"ab72fbbb-b32d-4fd3-8544-e43364ac371c","Type":"ContainerStarted","Data":"a326cef8be00effab4a29ccc3b5c45b62d31e58a1e63aa3c50fcc0ca976d4a17"} Jun 11 23:33:00.919481 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.919459 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" event={"ID":"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9","Type":"ContainerStarted","Data":"ed388de17054172c4bedbc7ef374ab42227ee7a9ea0ab8bb4aa2de4b38c7e71f"} Jun 11 23:33:00.919570 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.919495 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" event={"ID":"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9","Type":"ContainerStarted","Data":"2d8a07b2195ff22b2c2a4ec6c2a0e76871475177ee9a001dcde9f3779005ab54"} Jun 11 23:33:00.919570 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.919514 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" event={"ID":"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9","Type":"ContainerStarted","Data":"33950c9b039d98380576fad8ece53c8883389e29410a96b0c274141a7dca39be"} Jun 11 23:33:00.920921 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.920900 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" event={"ID":"b3ba3755-0756-47b5-a08c-fdfc07cf333e","Type":"ContainerStarted","Data":"48f0d109a7603a7ed24a64d0cd5a72d498194b96476366dbe2c54446fb1e86a1"} Jun 11 23:33:00.922207 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.922187 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" event={"ID":"11566a17-02e0-4a6c-a3fa-6dbd1f943b35","Type":"ContainerStarted","Data":"b87d0e5ebc102a167bbf86d16efeff9b5538312dae8e6f4d29df36de151edf6f"} Jun 11 23:33:00.922449 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.922409 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:33:00.924210 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.924191 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:33:00.965556 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.962790 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" podStartSLOduration=29.76506664 podStartE2EDuration="37.962766289s" totalImagesPullingTime="8.197699649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:00.960148525 +0000 UTC m=+44.682684404" watchObservedRunningTime="2026-06-11 23:33:00.962766289 +0000 UTC m=+44.685302151" Jun 11 23:33:00.976784 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.976735 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" podStartSLOduration=30.186126855 podStartE2EDuration="37.976718939s" totalImagesPullingTime="7.790592084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:00.976228246 +0000 UTC m=+44.698764124" watchObservedRunningTime="2026-06-11 23:33:00.976718939 +0000 UTC m=+44.699254779" Jun 11 23:33:00.994567 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.994511 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" podStartSLOduration=30.253127975 podStartE2EDuration="37.994492542s" totalImagesPullingTime="7.741364567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:00.993933388 +0000 UTC m=+44.716469250" watchObservedRunningTime="2026-06-11 23:33:00.994492542 +0000 UTC m=+44.717028404" Jun 11 23:33:00.998583 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:00.998558 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:01.012804 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:01.012757 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k4hdg" podStartSLOduration=2.277306544 podStartE2EDuration="10.012738099s" totalImagesPullingTime="7.735431555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:01.011647415 +0000 UTC m=+44.734183293" watchObservedRunningTime="2026-06-11 23:33:01.012738099 +0000 UTC m=+44.735273960" Jun 11 23:33:01.928915 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:01.928873 2558 generic.go:356] "Generic (PLEG): container finished" podID="a9028892-956f-45c6-a197-16d553d9eb9e" containerID="421801665a6a0b05e56869070df77e85248718d51dad96db0f68a94c4b5acca5" exitCode=0 Jun 11 23:33:01.929455 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:01.928933 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7kht" event={"ID":"a9028892-956f-45c6-a197-16d553d9eb9e","Type":"ContainerDied","Data":"421801665a6a0b05e56869070df77e85248718d51dad96db0f68a94c4b5acca5"} Jun 11 23:33:02.935252 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:02.935217 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7kht" event={"ID":"a9028892-956f-45c6-a197-16d553d9eb9e","Type":"ContainerStarted","Data":"8a82f831aabd70ddffaba468aa81073b2579c9de3c78bba6c1e4682f975f19a7"} Jun 11 23:33:02.957771 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:02.957677 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p7kht" podStartSLOduration=9.324733579 podStartE2EDuration="45.957650601s" totalImagesPullingTime="36.632917022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:02.956515801 +0000 UTC m=+46.679051688" watchObservedRunningTime="2026-06-11 23:33:02.957650601 +0000 UTC m=+46.680186463" Jun 11 23:33:03.076786 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:03.076752 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:03.132743 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:03.132711 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:04.338739 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:04.338694 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:04.392488 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:04.392450 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:05.074557 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:05.074517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:05.128489 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:05.128447 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:06.536536 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:06.536499 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:06.589746 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:06.589709 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:07.540573 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:07.540530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:33:07.540987 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:07.540589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:33:07.540987 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:07.540682 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:33:07.540987 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:07.540692 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:33:07.540987 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:07.540713 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f6fb5c6b-6ddx7: secret "image-registry-tls" not found Jun 11 23:33:07.540987 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:07.540743 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls podName:51ab87a8-031d-453d-a44b-f10d222141fa nodeName:}" failed. No retries permitted until 2026-06-11 23:33:23.540728754 +0000 UTC m=+67.263264594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls") pod "dns-default-htfbs" (UID: "51ab87a8-031d-453d-a44b-f10d222141fa") : secret "dns-default-metrics-tls" not found Jun 11 23:33:07.540987 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:07.540788 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls podName:c57db9a9-04b8-4419-8333-e908c355cb5b nodeName:}" failed. No retries permitted until 2026-06-11 23:33:23.540774363 +0000 UTC m=+67.263310208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls") pod "image-registry-85f6fb5c6b-6ddx7" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b") : secret "image-registry-tls" not found Jun 11 23:33:09.599254 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:09.599210 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:09.800489 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:09.800453 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:09.900481 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:09.900376 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:17.886224 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:17.886195 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtrh4" Jun 11 23:33:18.037464 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:18.037428 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:18.088112 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:18.088081 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:22.452992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.452948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:33:22.455600 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.455581 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:33:22.466530 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.466506 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1aa934a-1027-41b7-bfbf-9eeb2bfddce1-original-pull-secret\") pod \"global-pull-secret-syncer-qngnd\" (UID: \"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1\") " pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:33:22.553933 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.553896 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:33:22.554080 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.553968 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4c7\" (UniqueName: \"kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7\") pod \"network-check-target-qm4gq\" (UID: \"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3\") " pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:33:22.556300 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.556282 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:33:22.556519 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.556503 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:33:22.564554 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:22.564534 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 23:33:22.564626 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:22.564609 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs podName:dda14d2a-dc6e-4531-bb06-0ab0a7b747e0 nodeName:}" failed. No retries permitted until 2026-06-11 23:34:26.564592519 +0000 UTC m=+130.287128359 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs") pod "network-metrics-daemon-7zxrn" (UID: "dda14d2a-dc6e-4531-bb06-0ab0a7b747e0") : secret "metrics-daemon-secret" not found Jun 11 23:33:22.566535 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.566520 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:33:22.577155 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.577130 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n4c7\" (UniqueName: \"kubernetes.io/projected/19a8b683-e9ae-4a8e-863c-91ce41bf0ca3-kube-api-access-7n4c7\") pod \"network-check-target-qm4gq\" (UID: \"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3\") " pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:33:22.642036 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.642004 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qngnd" Jun 11 23:33:22.658870 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.658842 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x5wbg\"" Jun 11 23:33:22.666735 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.666720 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:33:22.799827 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.799785 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qngnd"] Jun 11 23:33:22.803188 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:33:22.803149 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1aa934a_1027_41b7_bfbf_9eeb2bfddce1.slice/crio-961fbd69c94d2a71208bfc99fcc1f399faffaa009aa6bbf8841695aa0e506888 WatchSource:0}: Error finding container 961fbd69c94d2a71208bfc99fcc1f399faffaa009aa6bbf8841695aa0e506888: Status 404 returned error can't find the container with id 961fbd69c94d2a71208bfc99fcc1f399faffaa009aa6bbf8841695aa0e506888 Jun 11 23:33:22.816520 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.816496 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qm4gq"] Jun 11 23:33:22.997956 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.997870 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qm4gq" event={"ID":"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3","Type":"ContainerStarted","Data":"1b2c3cf759ceb2a8cea223581bcd0b6f8ed2fd8ae34d394cb374ff3937603fb4"} Jun 11 23:33:22.998858 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:22.998830 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qngnd" event={"ID":"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1","Type":"ContainerStarted","Data":"961fbd69c94d2a71208bfc99fcc1f399faffaa009aa6bbf8841695aa0e506888"} Jun 11 23:33:23.561352 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:23.561315 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:33:23.561806 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:23.561374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:33:23.561806 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:23.561499 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:33:23.561806 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:23.561520 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f6fb5c6b-6ddx7: secret "image-registry-tls" not found Jun 11 23:33:23.561806 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:23.561577 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls podName:c57db9a9-04b8-4419-8333-e908c355cb5b nodeName:}" failed. No retries permitted until 2026-06-11 23:33:55.561557363 +0000 UTC m=+99.284093206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls") pod "image-registry-85f6fb5c6b-6ddx7" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b") : secret "image-registry-tls" not found Jun 11 23:33:23.561806 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:23.561498 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:33:23.561806 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:23.561670 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls podName:51ab87a8-031d-453d-a44b-f10d222141fa nodeName:}" failed. No retries permitted until 2026-06-11 23:33:55.561645356 +0000 UTC m=+99.284181199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls") pod "dns-default-htfbs" (UID: "51ab87a8-031d-453d-a44b-f10d222141fa") : secret "dns-default-metrics-tls" not found Jun 11 23:33:26.312357 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:26.312320 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:26.361841 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:26.361807 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:28.017941 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:28.017899 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qm4gq" event={"ID":"19a8b683-e9ae-4a8e-863c-91ce41bf0ca3","Type":"ContainerStarted","Data":"cc65d0b3fdf581f5fa9250390bc3b25018a459f9ed8899c5b31ca466dcbec7ad"} Jun 11 23:33:28.018492 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:28.018007 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:33:28.019393 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:28.019354 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qngnd" event={"ID":"f1aa934a-1027-41b7-bfbf-9eeb2bfddce1","Type":"ContainerStarted","Data":"d444b0e937b41a4d011bd50d193e8ab0c9015d1cd680d1bd99c024f7959a92f4"} Jun 11 23:33:28.031698 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:28.031648 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qm4gq" podStartSLOduration=66.55350697 podStartE2EDuration="1m11.031631755s" totalImagesPullingTime="4.478124785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:28.031376683 +0000 UTC m=+71.753912542" watchObservedRunningTime="2026-06-11 23:33:28.031631755 +0000 UTC m=+71.754167618" Jun 11 23:33:28.045180 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:28.045138 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qngnd" podStartSLOduration=66.545825947 podStartE2EDuration="1m11.045124573s" totalImagesPullingTime="4.499298626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:28.044267738 +0000 UTC m=+71.766803600" watchObservedRunningTime="2026-06-11 23:33:28.045124573 +0000 UTC m=+71.767660436" Jun 11 23:33:30.707975 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:30.707938 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:30.762102 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:30.762058 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:30.812385 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:30.812348 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:33:55.612222 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:55.612175 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:33:55.612608 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:55.612260 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:33:55.612608 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:55.612324 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:33:55.612608 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:55.612348 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:33:55.612608 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:55.612359 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f6fb5c6b-6ddx7: secret "image-registry-tls" not found Jun 11 23:33:55.612608 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:55.612399 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls podName:51ab87a8-031d-453d-a44b-f10d222141fa nodeName:}" failed. No retries permitted until 2026-06-11 23:34:59.61238488 +0000 UTC m=+163.334920722 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls") pod "dns-default-htfbs" (UID: "51ab87a8-031d-453d-a44b-f10d222141fa") : secret "dns-default-metrics-tls" not found Jun 11 23:33:55.612608 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:33:55.612431 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls podName:c57db9a9-04b8-4419-8333-e908c355cb5b nodeName:}" failed. No retries permitted until 2026-06-11 23:34:59.612407923 +0000 UTC m=+163.334943762 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls") pod "image-registry-85f6fb5c6b-6ddx7" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b") : secret "image-registry-tls" not found Jun 11 23:33:59.025150 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:33:59.025118 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qm4gq" Jun 11 23:34:26.632308 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:34:26.632268 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:34:26.632810 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:34:26.632380 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 23:34:26.632810 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:34:26.632470 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs podName:dda14d2a-dc6e-4531-bb06-0ab0a7b747e0 nodeName:}" failed. No retries permitted until 2026-06-11 23:36:28.632456349 +0000 UTC m=+252.354992189 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs") pod "network-metrics-daemon-7zxrn" (UID: "dda14d2a-dc6e-4531-bb06-0ab0a7b747e0") : secret "metrics-daemon-secret" not found Jun 11 23:34:54.706186 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:34:54.706102 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" podUID="c57db9a9-04b8-4419-8333-e908c355cb5b" Jun 11 23:34:54.748301 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:34:54.748252 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7zxrn" podUID="dda14d2a-dc6e-4531-bb06-0ab0a7b747e0" Jun 11 23:34:54.763608 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:34:54.763576 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-htfbs" podUID="51ab87a8-031d-453d-a44b-f10d222141fa" Jun 11 23:34:55.275928 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:34:55.275900 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:34:55.276098 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:34:55.275900 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htfbs" Jun 11 23:34:59.694109 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:34:59.694068 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:34:59.694575 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:34:59.694137 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:34:59.694575 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:34:59.694227 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 23:34:59.694575 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:34:59.694227 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:34:59.694575 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:34:59.694237 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f6fb5c6b-6ddx7: secret "image-registry-tls" not found Jun 11 23:34:59.694575 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:34:59.694291 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls podName:c57db9a9-04b8-4419-8333-e908c355cb5b nodeName:}" failed. No retries permitted until 2026-06-11 23:37:01.694278138 +0000 UTC m=+285.416813978 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls") pod "image-registry-85f6fb5c6b-6ddx7" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b") : secret "image-registry-tls" not found Jun 11 23:34:59.694575 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:34:59.694303 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls podName:51ab87a8-031d-453d-a44b-f10d222141fa nodeName:}" failed. No retries permitted until 2026-06-11 23:37:01.694297697 +0000 UTC m=+285.416833537 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls") pod "dns-default-htfbs" (UID: "51ab87a8-031d-453d-a44b-f10d222141fa") : secret "dns-default-metrics-tls" not found Jun 11 23:35:00.923480 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:00.923435 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" podUID="11566a17-02e0-4a6c-a3fa-6dbd1f943b35" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 11 23:35:01.295030 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:01.294945 2558 generic.go:356] "Generic (PLEG): container finished" podID="b3ba3755-0756-47b5-a08c-fdfc07cf333e" containerID="48f0d109a7603a7ed24a64d0cd5a72d498194b96476366dbe2c54446fb1e86a1" exitCode=255 Jun 11 23:35:01.295182 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:01.295022 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" event={"ID":"b3ba3755-0756-47b5-a08c-fdfc07cf333e","Type":"ContainerDied","Data":"48f0d109a7603a7ed24a64d0cd5a72d498194b96476366dbe2c54446fb1e86a1"} Jun 11 23:35:01.295376 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:01.295357 2558 scope.go:117] "RemoveContainer" containerID="48f0d109a7603a7ed24a64d0cd5a72d498194b96476366dbe2c54446fb1e86a1" Jun 11 23:35:01.296597 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:01.296570 2558 generic.go:356] "Generic (PLEG): container finished" podID="11566a17-02e0-4a6c-a3fa-6dbd1f943b35" containerID="b87d0e5ebc102a167bbf86d16efeff9b5538312dae8e6f4d29df36de151edf6f" exitCode=1 Jun 11 23:35:01.296690 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:01.296615 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" event={"ID":"11566a17-02e0-4a6c-a3fa-6dbd1f943b35","Type":"ContainerDied","Data":"b87d0e5ebc102a167bbf86d16efeff9b5538312dae8e6f4d29df36de151edf6f"} Jun 11 23:35:01.296906 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:01.296893 2558 scope.go:117] "RemoveContainer" containerID="b87d0e5ebc102a167bbf86d16efeff9b5538312dae8e6f4d29df36de151edf6f" Jun 11 23:35:01.996967 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:01.996929 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" Jun 11 23:35:02.036328 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:02.036277 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:35:02.302089 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:02.301998 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" event={"ID":"11566a17-02e0-4a6c-a3fa-6dbd1f943b35","Type":"ContainerStarted","Data":"6f92af447632e551a3cf3ba6a5ae18b3ea70c981f8b1ad9107612b738ea761ad"} Jun 11 23:35:02.302261 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:02.302167 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:35:02.302793 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:02.302771 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:35:02.303795 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:02.303775 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" event={"ID":"b3ba3755-0756-47b5-a08c-fdfc07cf333e","Type":"ContainerStarted","Data":"86a208b118ec2c03c4aa75b1a17f6a35ada843566effc92bc9920ac993c32bea"} Jun 11 23:35:09.694607 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:09.694562 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:35:19.614865 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:19.614821 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:39.315600 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:39.315558 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:39.416274 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:39.416239 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:41.088814 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:41.088774 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:41.141341 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:41.141301 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:43.619563 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.619523 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:43.719500 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.719466 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:43.792679 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.792643 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d45jv"] Jun 11 23:35:43.795898 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.795873 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:43.799228 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.799193 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:43.799394 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.799370 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 23:35:43.799625 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.799602 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 23:35:43.800198 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.800180 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 23:35:43.800380 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.800350 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 23:35:43.803635 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.801180 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7htj6\"" Jun 11 23:35:43.811599 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.811575 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d45jv"] Jun 11 23:35:43.872871 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.872785 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:43.920944 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.920909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:43.921103 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.920953 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:43.921103 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.920982 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxdj2\" (UniqueName: \"kubernetes.io/projected/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-api-access-gxdj2\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:43.921103 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.921075 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c74611a-89d2-489c-9719-750a8b6c4f22-crio-socket\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:43.921103 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:43.921100 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c74611a-89d2-489c-9719-750a8b6c4f22-data-volume\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.021469 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.021436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c74611a-89d2-489c-9719-750a8b6c4f22-crio-socket\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.021636 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.021492 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c74611a-89d2-489c-9719-750a8b6c4f22-data-volume\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.021636 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.021539 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c74611a-89d2-489c-9719-750a8b6c4f22-crio-socket\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.021636 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.021541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.021636 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:44.021591 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:35:44.021636 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.021608 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.021895 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:44.021653 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm podName:2c74611a-89d2-489c-9719-750a8b6c4f22 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:44.5216365 +0000 UTC m=+208.244172345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d45jv" (UID: "2c74611a-89d2-489c-9719-750a8b6c4f22") : configmap "kube-rbac-proxy" not found Jun 11 23:35:44.021895 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.021677 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxdj2\" (UniqueName: \"kubernetes.io/projected/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-api-access-gxdj2\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.021895 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:44.021706 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:35:44.021895 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:44.021744 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls podName:2c74611a-89d2-489c-9719-750a8b6c4f22 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:44.521731898 +0000 UTC m=+208.244267738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d45jv" (UID: "2c74611a-89d2-489c-9719-750a8b6c4f22") : secret "insights-runtime-extractor-tls" not found Jun 11 23:35:44.021895 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.021879 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c74611a-89d2-489c-9719-750a8b6c4f22-data-volume\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.030995 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.030974 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxdj2\" (UniqueName: \"kubernetes.io/projected/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-api-access-gxdj2\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.484617 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.484574 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:44.524771 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.524733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.524887 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.524834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:44.524922 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:44.524891 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:35:44.524922 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:44.524899 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:35:44.524987 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:44.524954 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls podName:2c74611a-89d2-489c-9719-750a8b6c4f22 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:45.524936123 +0000 UTC m=+209.247471964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d45jv" (UID: "2c74611a-89d2-489c-9719-750a8b6c4f22") : secret "insights-runtime-extractor-tls" not found Jun 11 23:35:44.524987 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:44.524969 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm podName:2c74611a-89d2-489c-9719-750a8b6c4f22 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:45.524962241 +0000 UTC m=+209.247498080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d45jv" (UID: "2c74611a-89d2-489c-9719-750a8b6c4f22") : configmap "kube-rbac-proxy" not found Jun 11 23:35:44.584318 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:44.584271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:45.532579 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:45.532542 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:45.532972 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:45.532589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:45.532972 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:45.532667 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:35:45.532972 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:45.532690 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:35:45.532972 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:45.532730 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm podName:2c74611a-89d2-489c-9719-750a8b6c4f22 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:47.532715268 +0000 UTC m=+211.255251109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d45jv" (UID: "2c74611a-89d2-489c-9719-750a8b6c4f22") : configmap "kube-rbac-proxy" not found Jun 11 23:35:45.532972 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:45.532743 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls podName:2c74611a-89d2-489c-9719-750a8b6c4f22 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:47.532737658 +0000 UTC m=+211.255273498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d45jv" (UID: "2c74611a-89d2-489c-9719-750a8b6c4f22") : secret "insights-runtime-extractor-tls" not found Jun 11 23:35:46.037942 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:46.037906 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:46.105797 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:46.105758 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:46.202777 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:46.202742 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:46.380602 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:46.380574 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8p2hj_ad8ec8a6-ec32-431f-96aa-a595b6e6d53f/dns-node-resolver/0.log" Jun 11 23:35:46.988841 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:46.988810 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:47.549280 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:47.549239 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:47.549489 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:47.549343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:47.549489 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:47.549400 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:35:47.549489 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:47.549436 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:35:47.549489 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:47.549487 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm podName:2c74611a-89d2-489c-9719-750a8b6c4f22 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:51.54947085 +0000 UTC m=+215.272006690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d45jv" (UID: "2c74611a-89d2-489c-9719-750a8b6c4f22") : configmap "kube-rbac-proxy" not found Jun 11 23:35:47.549630 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:47.549500 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls podName:2c74611a-89d2-489c-9719-750a8b6c4f22 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:51.549493957 +0000 UTC m=+215.272029797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d45jv" (UID: "2c74611a-89d2-489c-9719-750a8b6c4f22") : secret "insights-runtime-extractor-tls" not found Jun 11 23:35:47.784639 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:47.784613 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tz4hv_6220ce74-b1b0-48b3-ae6a-dbc39011dbe3/node-ca/0.log" Jun 11 23:35:48.179728 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:48.179702 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k4hdg_ab72fbbb-b32d-4fd3-8544-e43364ac371c/serve-healthcheck-canary/0.log" Jun 11 23:35:49.597007 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:49.596977 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:49.793411 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:49.793378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:49.899505 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:49.899379 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:49.993875 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:49.993837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:50.098791 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:50.098756 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:50.299269 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:50.299175 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:51.261898 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:51.261859 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:51.583000 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:51.582913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:51.583000 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:51.582976 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:51.583180 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:51.583043 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:35:51.583180 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:51.583065 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:35:51.583180 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:51.583116 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls podName:2c74611a-89d2-489c-9719-750a8b6c4f22 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:59.583101502 +0000 UTC m=+223.305637342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d45jv" (UID: "2c74611a-89d2-489c-9719-750a8b6c4f22") : secret "insights-runtime-extractor-tls" not found Jun 11 23:35:51.583180 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:35:51.583128 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm podName:2c74611a-89d2-489c-9719-750a8b6c4f22 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:59.583122169 +0000 UTC m=+223.305658009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d45jv" (UID: "2c74611a-89d2-489c-9719-750a8b6c4f22") : configmap "kube-rbac-proxy" not found Jun 11 23:35:51.668502 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:51.668451 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:51.857876 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:51.857816 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:52.058146 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:52.058104 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:52.264475 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:52.264328 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:53.271825 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:53.271781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:53.455161 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:53.455129 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:53.513085 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:53.513054 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:53.567289 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:53.567202 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:53.660184 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:53.660149 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:53.854873 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:53.854842 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:54.058950 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:54.058912 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:54.263400 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:54.263315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:55.467560 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:55.467523 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:55.662877 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:55.662844 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:55.863548 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:55.863512 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:56.062652 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:56.062616 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:56.158900 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:56.158809 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:56.328123 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:56.328091 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:56.779580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:56.779548 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:57.255712 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:57.255670 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:57.456758 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:57.456727 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:57.856544 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:57.856510 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:58.057188 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:58.057150 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:58.458499 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:58.458459 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:59.263253 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:59.263221 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:59.648951 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:59.648914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:59.649140 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:59.648958 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:59.649470 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:59.649452 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c74611a-89d2-489c-9719-750a8b6c4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:59.651429 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:59.651400 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c74611a-89d2-489c-9719-750a8b6c4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d45jv\" (UID: \"2c74611a-89d2-489c-9719-750a8b6c4f22\") " pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:59.660807 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:59.660781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:35:59.707015 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:59.706978 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d45jv" Jun 11 23:35:59.831314 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:59.831284 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d45jv"] Jun 11 23:35:59.834369 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:35:59.834332 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c74611a_89d2_489c_9719_750a8b6c4f22.slice/crio-b7570f382f169b90ff3ae82bde8a2d960b51620e3f2abda687b777f4b6d42ac4 WatchSource:0}: Error finding container b7570f382f169b90ff3ae82bde8a2d960b51620e3f2abda687b777f4b6d42ac4: Status 404 returned error can't find the container with id b7570f382f169b90ff3ae82bde8a2d960b51620e3f2abda687b777f4b6d42ac4 Jun 11 23:35:59.868297 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:35:59.868265 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:00.057900 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:00.057826 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:00.258805 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:00.258768 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:00.477131 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:00.477091 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d45jv" event={"ID":"2c74611a-89d2-489c-9719-750a8b6c4f22","Type":"ContainerStarted","Data":"b7570f382f169b90ff3ae82bde8a2d960b51620e3f2abda687b777f4b6d42ac4"} Jun 11 23:36:03.487580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:03.487495 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d45jv" event={"ID":"2c74611a-89d2-489c-9719-750a8b6c4f22","Type":"ContainerStarted","Data":"c9860ee565848873dd08092dba564e5203b997793cb8b4f053c9b1ad4ebe58bd"} Jun 11 23:36:03.820553 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:03.820441 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:03.924189 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:03.924159 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:04.022376 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:04.022340 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:04.128332 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:04.128292 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:04.303840 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:04.303800 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:04.400625 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:04.400490 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:04.493575 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:04.493542 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d45jv" event={"ID":"2c74611a-89d2-489c-9719-750a8b6c4f22","Type":"ContainerStarted","Data":"3fabb2631b6b12515516fa58930da676a111f08c4f33ae90ab2b54cc3bbcbe63"} Jun 11 23:36:04.703562 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:04.703373 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:04.756018 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:04.755983 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:04.903378 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:04.903326 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:05.133880 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:05.133847 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:05.211984 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:05.211943 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:05.498973 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:05.498856 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:05.602024 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:05.601985 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:05.699918 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:05.699875 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:05.798942 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:05.798840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:06.502984 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:06.502951 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d45jv" event={"ID":"2c74611a-89d2-489c-9719-750a8b6c4f22","Type":"ContainerStarted","Data":"cf205bca8dbd807562b15c7c10e13b8d640f328cba2c53a67b031aabfabe54a7"} Jun 11 23:36:06.520984 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:06.520933 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d45jv" podStartSLOduration=17.800478025 podStartE2EDuration="23.52091838s" totalImagesPullingTime="5.720440355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:35:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:06.519752033 +0000 UTC m=+230.242287914" watchObservedRunningTime="2026-06-11 23:36:06.52091838 +0000 UTC m=+230.243454241" Jun 11 23:36:06.927836 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:06.927796 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:06.987760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:06.987723 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:11.335071 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:11.335036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:11.435596 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:11.435546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:11.935192 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:11.935159 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:12.408847 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:12.408815 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:12.508108 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:12.508063 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:12.836478 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:12.836373 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:12.894278 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:12.894243 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:14.252674 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:14.252635 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:14.351265 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:14.351228 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:14.416336 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:14.416306 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:14.622255 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:14.622199 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:16.732768 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:16.732728 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:16.832529 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:16.832498 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:17.429762 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:17.429724 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:17.497937 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:17.497904 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:17.914716 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:17.914665 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:23.140034 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:23.139926 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:23.205847 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:23.205816 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:26.546984 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:26.546946 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:26.743499 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:26.743463 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:26.794832 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:26.794793 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:28.550202 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.550159 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:28.645471 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.645438 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:28.680577 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.680550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:36:28.683019 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.682989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dda14d2a-dc6e-4531-bb06-0ab0a7b747e0-metrics-certs\") pod \"network-metrics-daemon-7zxrn\" (UID: \"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0\") " pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:36:28.751715 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.751678 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:28.850823 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.850778 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:28.863805 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.863779 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4n4f7"] Jun 11 23:36:28.876010 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.875986 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.880791 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.878855 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 23:36:28.880791 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.879184 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 23:36:28.880791 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.879380 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 23:36:28.880791 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.879643 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 23:36:28.880791 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.879991 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v2s2m\"" Jun 11 23:36:28.880791 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.880174 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 23:36:28.880791 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.880231 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 23:36:28.881291 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.881273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-metrics-client-ca\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.881327 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.881301 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-tls\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.881327 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.881320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.881401 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.881380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-sys\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.881488 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.881472 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-textfile\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.881527 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.881516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-wtmp\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.881571 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.881559 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-root\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.881609 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.881584 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-accelerators-collector-config\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.881641 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.881616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zsqg\" (UniqueName: \"kubernetes.io/projected/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-kube-api-access-7zsqg\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.897642 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.897620 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mx7t4\"" Jun 11 23:36:28.906135 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.906117 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zxrn" Jun 11 23:36:28.982946 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.982902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-textfile\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983089 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.982980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-wtmp\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983089 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983019 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-root\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983089 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983049 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-accelerators-collector-config\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983256 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983087 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zsqg\" (UniqueName: \"kubernetes.io/projected/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-kube-api-access-7zsqg\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983256 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983130 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-metrics-client-ca\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983256 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-tls\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983256 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983199 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983256 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983205 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-wtmp\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983256 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-sys\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983589 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983306 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-textfile\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983589 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983344 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-sys\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983589 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983357 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-root\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.983589 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:36:28.983461 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 23:36:28.983589 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:36:28.983526 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-tls podName:e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78 nodeName:}" failed. No retries permitted until 2026-06-11 23:36:29.48350805 +0000 UTC m=+253.206043898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-tls") pod "node-exporter-4n4f7" (UID: "e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78") : secret "node-exporter-tls" not found Jun 11 23:36:28.983979 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.983955 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-metrics-client-ca\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.984089 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.984067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-accelerators-collector-config\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.986555 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.986532 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:28.991926 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:28.991891 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zsqg\" (UniqueName: \"kubernetes.io/projected/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-kube-api-access-7zsqg\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:29.027966 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.027934 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7zxrn"] Jun 11 23:36:29.030688 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:36:29.030661 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda14d2a_dc6e_4531_bb06_0ab0a7b747e0.slice/crio-517e6f1961112a733664930819aa42c7b8f28042aed79ea3a010719eb70cbc7c WatchSource:0}: Error finding container 517e6f1961112a733664930819aa42c7b8f28042aed79ea3a010719eb70cbc7c: Status 404 returned error can't find the container with id 517e6f1961112a733664930819aa42c7b8f28042aed79ea3a010719eb70cbc7c Jun 11 23:36:29.141121 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.141043 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:29.243318 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.243276 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:29.298874 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.298827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:29.487678 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.487597 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-tls\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:29.490349 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.490324 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78-node-exporter-tls\") pod \"node-exporter-4n4f7\" (UID: \"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78\") " pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:29.572107 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.572070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7zxrn" event={"ID":"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0","Type":"ContainerStarted","Data":"517e6f1961112a733664930819aa42c7b8f28042aed79ea3a010719eb70cbc7c"} Jun 11 23:36:29.595830 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.595791 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:29.778948 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.778837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:29.788709 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.788678 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4n4f7" Jun 11 23:36:29.860980 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:29.860941 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:29.936697 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:36:29.936660 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38887b2_fbcd_4e8b_9a2f_e7e74eae0d78.slice/crio-b163ab8d0945f54ac6ec057c6d4cdfc76a5aa50990c56d95f2af298ce7d923c0 WatchSource:0}: Error finding container b163ab8d0945f54ac6ec057c6d4cdfc76a5aa50990c56d95f2af298ce7d923c0: Status 404 returned error can't find the container with id b163ab8d0945f54ac6ec057c6d4cdfc76a5aa50990c56d95f2af298ce7d923c0 Jun 11 23:36:30.183122 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:30.183086 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:30.577445 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:30.577394 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7zxrn" event={"ID":"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0","Type":"ContainerStarted","Data":"d28899b587fec78fe4aae68aead9c9cd5c65246db3b0efc044213aa4e6a252cd"} Jun 11 23:36:30.577910 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:30.577478 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7zxrn" event={"ID":"dda14d2a-dc6e-4531-bb06-0ab0a7b747e0","Type":"ContainerStarted","Data":"e52939886ee3fe7608487a7987da4069d79111bdaf9cf81d6387e2d58d641c23"} Jun 11 23:36:30.578589 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:30.578558 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4n4f7" event={"ID":"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78","Type":"ContainerStarted","Data":"b163ab8d0945f54ac6ec057c6d4cdfc76a5aa50990c56d95f2af298ce7d923c0"} Jun 11 23:36:30.595723 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:30.595677 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7zxrn" podStartSLOduration=252.673177638 podStartE2EDuration="4m13.595662932s" totalImagesPullingTime="922.485294ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:30.593750376 +0000 UTC m=+254.316286259" watchObservedRunningTime="2026-06-11 23:36:30.595662932 +0000 UTC m=+254.318198793" Jun 11 23:36:30.747605 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:30.747548 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:30.845547 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:30.845501 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:31.583293 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:31.583261 2558 generic.go:356] "Generic (PLEG): container finished" podID="e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78" containerID="b624ae3c63ac70c27e6247b7d4c61ffe4a01784f6f404b532db562fc01695bb4" exitCode=0 Jun 11 23:36:31.583760 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:31.583346 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4n4f7" event={"ID":"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78","Type":"ContainerDied","Data":"b624ae3c63ac70c27e6247b7d4c61ffe4a01784f6f404b532db562fc01695bb4"} Jun 11 23:36:31.747689 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:31.747650 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:31.814473 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:31.814399 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:32.137989 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:32.137956 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:32.589650 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:32.589561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4n4f7" event={"ID":"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78","Type":"ContainerStarted","Data":"2352df20008c46194cf81cd797c0c22dda6b6f3598579e849f53799eba42f1d1"} Jun 11 23:36:32.589650 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:32.589615 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4n4f7" event={"ID":"e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78","Type":"ContainerStarted","Data":"c614dced62ec73c4ed3c8b8828a23a98468a4c4884f366471a11cb2699b346ac"} Jun 11 23:36:32.610763 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:32.610708 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4n4f7" podStartSLOduration=3.668916146 podStartE2EDuration="4.610692138s" totalImagesPullingTime="868.685092ms" totalInitContainerRuntime="73.0909ms" isStatefulPod=true podCreationTimestamp="2026-06-11 23:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:32.610590598 +0000 UTC m=+256.333126460" watchObservedRunningTime="2026-06-11 23:36:32.610692138 +0000 UTC m=+256.333228027" Jun 11 23:36:32.642856 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:32.642810 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:33.586893 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:33.586857 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:33.649683 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:33.649640 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:33.915697 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:33.915659 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:35.028943 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:35.028909 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:36.740552 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:36.740513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:36.841943 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:36.841907 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:39.943735 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:39.943701 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:40.044180 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:40.044150 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:42.105403 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:42.105366 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:42.160097 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:42.160067 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:44.474489 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:44.474453 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:44.530033 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:44.529997 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:46.192215 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:46.192179 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:46.249065 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:46.249030 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:55.865814 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:55.865775 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:36:58.277307 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:36:58.277264 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" podUID="c57db9a9-04b8-4419-8333-e908c355cb5b" Jun 11 23:36:58.277307 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:36:58.277264 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-htfbs" podUID="51ab87a8-031d-453d-a44b-f10d222141fa" Jun 11 23:36:58.674309 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:58.674285 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:36:58.674490 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:36:58.674285 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htfbs" Jun 11 23:37:01.686031 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.685935 2558 generic.go:356] "Generic (PLEG): container finished" podID="11566a17-02e0-4a6c-a3fa-6dbd1f943b35" containerID="6f92af447632e551a3cf3ba6a5ae18b3ea70c981f8b1ad9107612b738ea761ad" exitCode=1 Jun 11 23:37:01.686031 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.686005 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" event={"ID":"11566a17-02e0-4a6c-a3fa-6dbd1f943b35","Type":"ContainerDied","Data":"6f92af447632e551a3cf3ba6a5ae18b3ea70c981f8b1ad9107612b738ea761ad"} Jun 11 23:37:01.686527 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.686071 2558 scope.go:117] "RemoveContainer" containerID="b87d0e5ebc102a167bbf86d16efeff9b5538312dae8e6f4d29df36de151edf6f" Jun 11 23:37:01.686527 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.686480 2558 scope.go:117] "RemoveContainer" containerID="6f92af447632e551a3cf3ba6a5ae18b3ea70c981f8b1ad9107612b738ea761ad" Jun 11 23:37:01.686747 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:37:01.686726 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6c4994b788-dpdrz_open-cluster-management-agent-addon(11566a17-02e0-4a6c-a3fa-6dbd1f943b35)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" podUID="11566a17-02e0-4a6c-a3fa-6dbd1f943b35" Jun 11 23:37:01.688028 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.688007 2558 generic.go:356] "Generic (PLEG): container finished" podID="b3ba3755-0756-47b5-a08c-fdfc07cf333e" containerID="86a208b118ec2c03c4aa75b1a17f6a35ada843566effc92bc9920ac993c32bea" exitCode=255 Jun 11 23:37:01.688100 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.688040 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" event={"ID":"b3ba3755-0756-47b5-a08c-fdfc07cf333e","Type":"ContainerDied","Data":"86a208b118ec2c03c4aa75b1a17f6a35ada843566effc92bc9920ac993c32bea"} Jun 11 23:37:01.688300 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.688288 2558 scope.go:117] "RemoveContainer" containerID="86a208b118ec2c03c4aa75b1a17f6a35ada843566effc92bc9920ac993c32bea" Jun 11 23:37:01.688473 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:37:01.688457 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-85ff9896d4-bxpsb_open-cluster-management-agent-addon(b3ba3755-0756-47b5-a08c-fdfc07cf333e)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" podUID="b3ba3755-0756-47b5-a08c-fdfc07cf333e" Jun 11 23:37:01.696219 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.696200 2558 scope.go:117] "RemoveContainer" containerID="48f0d109a7603a7ed24a64d0cd5a72d498194b96476366dbe2c54446fb1e86a1" Jun 11 23:37:01.746789 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.746756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:37:01.746995 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.746814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:37:01.749368 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.749330 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51ab87a8-031d-453d-a44b-f10d222141fa-metrics-tls\") pod \"dns-default-htfbs\" (UID: \"51ab87a8-031d-453d-a44b-f10d222141fa\") " pod="openshift-dns/dns-default-htfbs" Jun 11 23:37:01.749515 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.749382 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"image-registry-85f6fb5c6b-6ddx7\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:37:01.977732 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.977648 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krlkn\"" Jun 11 23:37:01.977877 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.977648 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7rvk7\"" Jun 11 23:37:01.985738 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.985701 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-htfbs" Jun 11 23:37:01.985879 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.985862 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:37:01.997229 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:01.997204 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" Jun 11 23:37:02.015645 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.015582 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" podUID="89d9f4b3-5496-4f2e-9aac-daa3387f6cc9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 23:37:02.036605 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.036573 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:37:02.127939 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.127903 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-htfbs"] Jun 11 23:37:02.131155 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:37:02.131125 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ab87a8_031d_453d_a44b_f10d222141fa.slice/crio-8de60f2d27bc31aa714990212e9c6404db44d339521c8ee0288d5a68cab3b63f WatchSource:0}: Error finding container 8de60f2d27bc31aa714990212e9c6404db44d339521c8ee0288d5a68cab3b63f: Status 404 returned error can't find the container with id 8de60f2d27bc31aa714990212e9c6404db44d339521c8ee0288d5a68cab3b63f Jun 11 23:37:02.150272 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.150249 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85f6fb5c6b-6ddx7"] Jun 11 23:37:02.152875 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:37:02.152845 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57db9a9_04b8_4419_8333_e908c355cb5b.slice/crio-dbc12c6c7f2521b16aed7b86ff7c353a6fae09456c282d728b7f86c9ec4735f0 WatchSource:0}: Error finding container dbc12c6c7f2521b16aed7b86ff7c353a6fae09456c282d728b7f86c9ec4735f0: Status 404 returned error can't find the container with id dbc12c6c7f2521b16aed7b86ff7c353a6fae09456c282d728b7f86c9ec4735f0 Jun 11 23:37:02.302842 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.302754 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:37:02.694609 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.694583 2558 scope.go:117] "RemoveContainer" containerID="86a208b118ec2c03c4aa75b1a17f6a35ada843566effc92bc9920ac993c32bea" Jun 11 23:37:02.695077 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:37:02.694770 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-85ff9896d4-bxpsb_open-cluster-management-agent-addon(b3ba3755-0756-47b5-a08c-fdfc07cf333e)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" podUID="b3ba3755-0756-47b5-a08c-fdfc07cf333e" Jun 11 23:37:02.696498 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.696475 2558 scope.go:117] "RemoveContainer" containerID="6f92af447632e551a3cf3ba6a5ae18b3ea70c981f8b1ad9107612b738ea761ad" Jun 11 23:37:02.696711 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:37:02.696686 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6c4994b788-dpdrz_open-cluster-management-agent-addon(11566a17-02e0-4a6c-a3fa-6dbd1f943b35)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" podUID="11566a17-02e0-4a6c-a3fa-6dbd1f943b35" Jun 11 23:37:02.699502 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.699481 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:37:02.699631 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.699531 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" event={"ID":"c57db9a9-04b8-4419-8333-e908c355cb5b","Type":"ContainerStarted","Data":"1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7"} Jun 11 23:37:02.699631 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.699555 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" event={"ID":"c57db9a9-04b8-4419-8333-e908c355cb5b","Type":"ContainerStarted","Data":"dbc12c6c7f2521b16aed7b86ff7c353a6fae09456c282d728b7f86c9ec4735f0"} Jun 11 23:37:02.699631 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.699574 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-htfbs" event={"ID":"51ab87a8-031d-453d-a44b-f10d222141fa","Type":"ContainerStarted","Data":"8de60f2d27bc31aa714990212e9c6404db44d339521c8ee0288d5a68cab3b63f"} Jun 11 23:37:02.728651 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:02.728591 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" podStartSLOduration=285.728569091 podStartE2EDuration="4m45.728569091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:37:02.727749516 +0000 UTC m=+286.450285380" watchObservedRunningTime="2026-06-11 23:37:02.728569091 +0000 UTC m=+286.451104955" Jun 11 23:37:03.703172 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:03.703138 2558 scope.go:117] "RemoveContainer" containerID="6f92af447632e551a3cf3ba6a5ae18b3ea70c981f8b1ad9107612b738ea761ad" Jun 11 23:37:03.703567 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:37:03.703293 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6c4994b788-dpdrz_open-cluster-management-agent-addon(11566a17-02e0-4a6c-a3fa-6dbd1f943b35)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" podUID="11566a17-02e0-4a6c-a3fa-6dbd1f943b35" Jun 11 23:37:04.707002 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:04.706963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-htfbs" event={"ID":"51ab87a8-031d-453d-a44b-f10d222141fa","Type":"ContainerStarted","Data":"16f949cb8cf99e90754ccae2e6f9932fef246fd86eeea1f0ea69fd62c035388c"} Jun 11 23:37:04.707383 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:04.707015 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-htfbs" event={"ID":"51ab87a8-031d-453d-a44b-f10d222141fa","Type":"ContainerStarted","Data":"28ddbdd8319ac7e8efa7464f8bdfdd28c148d66838b28147f677411d7dccf9db"} Jun 11 23:37:04.707383 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:04.707095 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-htfbs" Jun 11 23:37:04.726529 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:04.726485 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-htfbs" podStartSLOduration=251.698443435 podStartE2EDuration="4m13.726470018s" totalImagesPullingTime="2.028026583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:37:04.724910891 +0000 UTC m=+288.447446753" watchObservedRunningTime="2026-06-11 23:37:04.726470018 +0000 UTC m=+288.449005887" Jun 11 23:37:05.368235 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:05.368191 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:05.420110 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:05.420076 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:11.329865 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:11.329827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:11.384582 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:11.384541 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:12.014951 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:12.014914 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" podUID="89d9f4b3-5496-4f2e-9aac-daa3387f6cc9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 23:37:14.712799 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:14.712768 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-htfbs" Jun 11 23:37:14.914518 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:14.914480 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:14.966491 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:14.966379 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:15.695558 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:15.695526 2558 scope.go:117] "RemoveContainer" containerID="86a208b118ec2c03c4aa75b1a17f6a35ada843566effc92bc9920ac993c32bea" Jun 11 23:37:16.652591 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:16.652563 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:37:16.655558 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:16.655533 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 23:37:16.656087 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:16.656072 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:37:16.751444 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:16.751265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ff9896d4-bxpsb" event={"ID":"b3ba3755-0756-47b5-a08c-fdfc07cf333e","Type":"ContainerStarted","Data":"be2caeecca1a6a4f0d2f8b58d091d58eab66135075c751fddbda9639bbf04eb1"} Jun 11 23:37:17.253441 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:17.253396 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:17.311880 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:17.311842 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:17.694757 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:17.694724 2558 scope.go:117] "RemoveContainer" containerID="6f92af447632e551a3cf3ba6a5ae18b3ea70c981f8b1ad9107612b738ea761ad" Jun 11 23:37:17.756137 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:17.756110 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" event={"ID":"11566a17-02e0-4a6c-a3fa-6dbd1f943b35","Type":"ContainerStarted","Data":"0a65de13adac7db86fb2842306456fe8134ac14c434d5f312d726f6ef6484866"} Jun 11 23:37:17.756391 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:17.756366 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:37:17.757762 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:17.757737 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" podUID="11566a17-02e0-4a6c-a3fa-6dbd1f943b35" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 11 23:37:18.118394 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:18.118356 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:18.760779 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:18.760750 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c4994b788-dpdrz" Jun 11 23:37:20.307340 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:20.307305 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:20.358059 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:20.358024 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:21.990667 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:21.990631 2558 patch_prober.go:28] interesting pod/image-registry-85f6fb5c6b-6ddx7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:37:21.991034 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:21.990682 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" podUID="c57db9a9-04b8-4419-8333-e908c355cb5b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:37:22.014512 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:22.014470 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" podUID="89d9f4b3-5496-4f2e-9aac-daa3387f6cc9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 23:37:22.014667 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:22.014542 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" Jun 11 23:37:22.015033 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:22.015000 2558 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"ed388de17054172c4bedbc7ef374ab42227ee7a9ea0ab8bb4aa2de4b38c7e71f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 23:37:22.015107 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:22.015051 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" podUID="89d9f4b3-5496-4f2e-9aac-daa3387f6cc9" containerName="service-proxy" containerID="cri-o://ed388de17054172c4bedbc7ef374ab42227ee7a9ea0ab8bb4aa2de4b38c7e71f" gracePeriod=30 Jun 11 23:37:22.773789 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:22.773752 2558 generic.go:356] "Generic (PLEG): container finished" podID="89d9f4b3-5496-4f2e-9aac-daa3387f6cc9" containerID="ed388de17054172c4bedbc7ef374ab42227ee7a9ea0ab8bb4aa2de4b38c7e71f" exitCode=2 Jun 11 23:37:22.773981 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:22.773820 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" event={"ID":"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9","Type":"ContainerDied","Data":"ed388de17054172c4bedbc7ef374ab42227ee7a9ea0ab8bb4aa2de4b38c7e71f"} Jun 11 23:37:22.773981 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:22.773878 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695f47b76c-vzwk7" event={"ID":"89d9f4b3-5496-4f2e-9aac-daa3387f6cc9","Type":"ContainerStarted","Data":"8563734ea797640b4ccb0a034a1a595513607cba27664d77c5723f308d15c700"} Jun 11 23:37:23.083176 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:23.083087 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:23.707955 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:23.707928 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:37:24.044294 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:24.044206 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:24.142328 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:24.142289 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:24.394861 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:24.394807 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:24.495366 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:24.495330 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:24.593057 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:24.593026 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:29.424617 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:29.424578 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:29.525645 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:29.525605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:32.830681 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:32.830640 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:32.935731 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:32.935698 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:34.027073 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:34.027042 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85f6fb5c6b-6ddx7"] Jun 11 23:37:34.099110 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:34.099068 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:34.155139 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:34.155105 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:34.252244 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:34.252208 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:34.304005 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:34.303911 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:41.331339 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:41.331304 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:41.384307 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:41.384270 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:41.846588 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:41.846555 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:41.899609 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:41.899577 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:42.446540 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:42.446501 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:42.547904 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:42.547869 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:42.595890 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:42.595865 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:48.014224 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:48.014184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:48.215248 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:48.215211 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:56.328955 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:56.328910 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:56.383261 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:56.383226 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:57.957700 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:57.957666 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:58.009949 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:58.009921 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:37:59.052194 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:37:59.052157 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" podUID="c57db9a9-04b8-4419-8333-e908c355cb5b" containerName="registry" containerID="cri-o://1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7" gracePeriod=30 Jun 11 23:38:00.293561 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.293536 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:38:00.351141 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.351109 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-image-registry-private-configuration\") pod \"c57db9a9-04b8-4419-8333-e908c355cb5b\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " Jun 11 23:38:00.351316 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.351151 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df7k7\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-kube-api-access-df7k7\") pod \"c57db9a9-04b8-4419-8333-e908c355cb5b\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " Jun 11 23:38:00.351316 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.351186 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c57db9a9-04b8-4419-8333-e908c355cb5b-ca-trust-extracted\") pod \"c57db9a9-04b8-4419-8333-e908c355cb5b\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " Jun 11 23:38:00.351316 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.351217 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") pod \"c57db9a9-04b8-4419-8333-e908c355cb5b\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " Jun 11 23:38:00.351316 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.351239 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-bound-sa-token\") pod \"c57db9a9-04b8-4419-8333-e908c355cb5b\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " Jun 11 23:38:00.351316 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.351292 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-certificates\") pod \"c57db9a9-04b8-4419-8333-e908c355cb5b\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " Jun 11 23:38:00.351613 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.351324 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-trusted-ca\") pod \"c57db9a9-04b8-4419-8333-e908c355cb5b\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " Jun 11 23:38:00.351613 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.351352 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-installation-pull-secrets\") pod \"c57db9a9-04b8-4419-8333-e908c355cb5b\" (UID: \"c57db9a9-04b8-4419-8333-e908c355cb5b\") " Jun 11 23:38:00.352284 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.352223 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c57db9a9-04b8-4419-8333-e908c355cb5b" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:38:00.352284 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.352260 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c57db9a9-04b8-4419-8333-e908c355cb5b" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:38:00.354543 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.354499 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c57db9a9-04b8-4419-8333-e908c355cb5b" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:38:00.354683 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.354657 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-kube-api-access-df7k7" (OuterVolumeSpecName: "kube-api-access-df7k7") pod "c57db9a9-04b8-4419-8333-e908c355cb5b" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b"). InnerVolumeSpecName "kube-api-access-df7k7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:38:00.354750 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.354682 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c57db9a9-04b8-4419-8333-e908c355cb5b" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:38:00.354750 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.354706 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c57db9a9-04b8-4419-8333-e908c355cb5b" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:38:00.354750 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.354724 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c57db9a9-04b8-4419-8333-e908c355cb5b" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:38:00.363021 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.362969 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c57db9a9-04b8-4419-8333-e908c355cb5b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c57db9a9-04b8-4419-8333-e908c355cb5b" (UID: "c57db9a9-04b8-4419-8333-e908c355cb5b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:38:00.451798 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.451757 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-tls\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:38:00.451798 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.451790 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-bound-sa-token\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:38:00.451798 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.451802 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-registry-certificates\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:38:00.452031 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.451813 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c57db9a9-04b8-4419-8333-e908c355cb5b-trusted-ca\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:38:00.452031 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.451824 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-installation-pull-secrets\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:38:00.452031 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.451840 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c57db9a9-04b8-4419-8333-e908c355cb5b-image-registry-private-configuration\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:38:00.452031 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.451852 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df7k7\" (UniqueName: \"kubernetes.io/projected/c57db9a9-04b8-4419-8333-e908c355cb5b-kube-api-access-df7k7\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:38:00.452031 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.451864 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c57db9a9-04b8-4419-8333-e908c355cb5b-ca-trust-extracted\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:38:00.899896 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.899855 2558 generic.go:356] "Generic (PLEG): container finished" podID="c57db9a9-04b8-4419-8333-e908c355cb5b" containerID="1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7" exitCode=0 Jun 11 23:38:00.900094 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.899918 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" Jun 11 23:38:00.900094 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.899943 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" event={"ID":"c57db9a9-04b8-4419-8333-e908c355cb5b","Type":"ContainerDied","Data":"1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7"} Jun 11 23:38:00.900094 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.900013 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f6fb5c6b-6ddx7" event={"ID":"c57db9a9-04b8-4419-8333-e908c355cb5b","Type":"ContainerDied","Data":"dbc12c6c7f2521b16aed7b86ff7c353a6fae09456c282d728b7f86c9ec4735f0"} Jun 11 23:38:00.900094 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.900032 2558 scope.go:117] "RemoveContainer" containerID="1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7" Jun 11 23:38:00.908212 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.908198 2558 scope.go:117] "RemoveContainer" containerID="1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7" Jun 11 23:38:00.908530 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:38:00.908500 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7\": container with ID starting with 1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7 not found: ID does not exist" containerID="1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7" Jun 11 23:38:00.908631 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.908540 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7"} err="failed to get container status \"1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7\": rpc error: code = NotFound desc = could not find container \"1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7\": container with ID starting with 1559b7defd82223f170cff3ba495963ccd500cdfaae29bc8ad9218460a5428c7 not found: ID does not exist" Jun 11 23:38:00.916863 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.916839 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85f6fb5c6b-6ddx7"] Jun 11 23:38:00.919910 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:00.919881 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85f6fb5c6b-6ddx7"] Jun 11 23:38:02.698815 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:02.698781 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c57db9a9-04b8-4419-8333-e908c355cb5b" path="/var/lib/kubelet/pods/c57db9a9-04b8-4419-8333-e908c355cb5b/volumes" Jun 11 23:38:03.221171 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:03.221141 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:03.278991 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:03.278955 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:03.972878 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:03.972844 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:04.064730 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:04.064670 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:04.567882 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:04.567846 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:04.619504 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:04.619474 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:14.409857 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:14.409811 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:14.508706 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:14.508671 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:14.573985 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:14.573942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:19.643336 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:19.643298 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:19.697283 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:19.697252 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:26.334210 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:26.334175 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:26.436609 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:26.436574 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:40.803979 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:40.803936 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:38:46.073281 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:38:46.073238 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:12.444963 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:12.444919 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:12.542845 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:12.542809 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:31.053614 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:31.053526 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:33.962302 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:33.962265 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:34.785580 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:34.785517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:35.746718 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:35.746685 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:35.846119 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:35.846081 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:37.557697 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:37.557649 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:37.657494 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:37.657461 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:39.298002 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:39.297961 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:39.398819 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:39.398784 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:40.063389 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:40.063350 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:40.171767 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:40.171737 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:42.219090 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.219047 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw"] Jun 11 23:39:42.219612 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.219354 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57db9a9-04b8-4419-8333-e908c355cb5b" containerName="registry" Jun 11 23:39:42.219612 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.219372 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57db9a9-04b8-4419-8333-e908c355cb5b" containerName="registry" Jun 11 23:39:42.219612 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.219462 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57db9a9-04b8-4419-8333-e908c355cb5b" containerName="registry" Jun 11 23:39:42.222201 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.222180 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" Jun 11 23:39:42.224649 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.224623 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9x6qc\"" Jun 11 23:39:42.224649 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.224641 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 23:39:42.225529 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.225514 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 23:39:42.231638 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.231615 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw"] Jun 11 23:39:42.260942 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.260904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe328089-f72e-427d-9041-88901694c54d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wn9jw\" (UID: \"fe328089-f72e-427d-9041-88901694c54d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" Jun 11 23:39:42.261130 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.260973 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwlnh\" (UniqueName: \"kubernetes.io/projected/fe328089-f72e-427d-9041-88901694c54d-kube-api-access-wwlnh\") pod \"cert-manager-webhook-7dc76cbb94-wn9jw\" (UID: \"fe328089-f72e-427d-9041-88901694c54d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" Jun 11 23:39:42.361874 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.361835 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe328089-f72e-427d-9041-88901694c54d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wn9jw\" (UID: \"fe328089-f72e-427d-9041-88901694c54d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" Jun 11 23:39:42.361996 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.361898 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwlnh\" (UniqueName: \"kubernetes.io/projected/fe328089-f72e-427d-9041-88901694c54d-kube-api-access-wwlnh\") pod \"cert-manager-webhook-7dc76cbb94-wn9jw\" (UID: \"fe328089-f72e-427d-9041-88901694c54d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" Jun 11 23:39:42.369781 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.369746 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe328089-f72e-427d-9041-88901694c54d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wn9jw\" (UID: \"fe328089-f72e-427d-9041-88901694c54d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" Jun 11 23:39:42.369897 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.369862 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwlnh\" (UniqueName: \"kubernetes.io/projected/fe328089-f72e-427d-9041-88901694c54d-kube-api-access-wwlnh\") pod \"cert-manager-webhook-7dc76cbb94-wn9jw\" (UID: \"fe328089-f72e-427d-9041-88901694c54d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" Jun 11 23:39:42.531555 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.531411 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" Jun 11 23:39:42.606352 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.606317 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:42.666018 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.665988 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw"] Jun 11 23:39:42.668281 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:39:42.668252 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe328089_f72e_427d_9041_88901694c54d.slice/crio-ca41bbe96bc0aa2e86dcad915f5e465eca0fda34996603c78c6b0373f45b6084 WatchSource:0}: Error finding container ca41bbe96bc0aa2e86dcad915f5e465eca0fda34996603c78c6b0373f45b6084: Status 404 returned error can't find the container with id ca41bbe96bc0aa2e86dcad915f5e465eca0fda34996603c78c6b0373f45b6084 Jun 11 23:39:42.670158 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:42.670137 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:39:43.198811 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:43.198770 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:43.236179 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:43.236151 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" event={"ID":"fe328089-f72e-427d-9041-88901694c54d","Type":"ContainerStarted","Data":"ca41bbe96bc0aa2e86dcad915f5e465eca0fda34996603c78c6b0373f45b6084"} Jun 11 23:39:44.544820 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:44.544780 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:44.600348 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:44.600311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:46.249022 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:46.248923 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" event={"ID":"fe328089-f72e-427d-9041-88901694c54d","Type":"ContainerStarted","Data":"4ed9f725c9ec937cd32d9bd4409640fe04d4d1d987a4815745aef0a82eb365cb"} Jun 11 23:39:46.249022 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:46.248997 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" Jun 11 23:39:46.266330 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:46.266278 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" podStartSLOduration=0.970907902 podStartE2EDuration="4.266260882s" totalImagesPullingTime="3.29535298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:39:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:46.264938216 +0000 UTC m=+449.987474078" watchObservedRunningTime="2026-06-11 23:39:46.266260882 +0000 UTC m=+449.988796741" Jun 11 23:39:47.711478 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:47.711446 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:47.833697 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:47.833662 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:51.007017 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:51.006979 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:52.218527 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:52.218481 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:52.255255 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:52.255225 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wn9jw" Jun 11 23:39:52.318595 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:52.318560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:59.482321 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:59.482278 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:39:59.583614 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:39:59.583576 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:01.175756 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:01.175722 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:13.501392 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.501354 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:13.607299 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.607267 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx"] Jun 11 23:40:13.610185 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.610170 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.616209 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.615975 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 23:40:13.617547 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.617527 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 23:40:13.617646 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.617589 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:40:13.617646 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.617613 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 23:40:13.617829 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.617816 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tswwz\"" Jun 11 23:40:13.618001 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.617987 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 23:40:13.632856 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.632815 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:13.633515 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.633490 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx"] Jun 11 23:40:13.699864 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.699829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhqqd\" (UniqueName: \"kubernetes.io/projected/25327e5b-e1b3-443d-afd6-064d92023e9e-kube-api-access-zhqqd\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.700087 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.699886 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25327e5b-e1b3-443d-afd6-064d92023e9e-cert\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.700087 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.699938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/25327e5b-e1b3-443d-afd6-064d92023e9e-metrics-cert\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.700087 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.699969 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/25327e5b-e1b3-443d-afd6-064d92023e9e-manager-config\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.800803 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.800713 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/25327e5b-e1b3-443d-afd6-064d92023e9e-manager-config\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.800803 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.800755 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhqqd\" (UniqueName: \"kubernetes.io/projected/25327e5b-e1b3-443d-afd6-064d92023e9e-kube-api-access-zhqqd\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.800803 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.800797 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25327e5b-e1b3-443d-afd6-064d92023e9e-cert\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.801038 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.800936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/25327e5b-e1b3-443d-afd6-064d92023e9e-metrics-cert\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.801348 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.801329 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/25327e5b-e1b3-443d-afd6-064d92023e9e-manager-config\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.803436 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.803391 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25327e5b-e1b3-443d-afd6-064d92023e9e-cert\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.803547 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.803472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/25327e5b-e1b3-443d-afd6-064d92023e9e-metrics-cert\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.815888 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.815856 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhqqd\" (UniqueName: \"kubernetes.io/projected/25327e5b-e1b3-443d-afd6-064d92023e9e-kube-api-access-zhqqd\") pod \"lws-controller-manager-65f5df65d6-nfhpx\" (UID: \"25327e5b-e1b3-443d-afd6-064d92023e9e\") " pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:13.918605 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:13.918576 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:14.005512 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:14.005460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:14.067880 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:14.067789 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx"] Jun 11 23:40:14.071512 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:40:14.071485 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25327e5b_e1b3_443d_afd6_064d92023e9e.slice/crio-a7055c094d3d07725b4298c55b30af42034fc03bf462444199df5ac774aaa536 WatchSource:0}: Error finding container a7055c094d3d07725b4298c55b30af42034fc03bf462444199df5ac774aaa536: Status 404 returned error can't find the container with id a7055c094d3d07725b4298c55b30af42034fc03bf462444199df5ac774aaa536 Jun 11 23:40:14.112840 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:14.112810 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:14.344745 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:14.344714 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" event={"ID":"25327e5b-e1b3-443d-afd6-064d92023e9e","Type":"ContainerStarted","Data":"a7055c094d3d07725b4298c55b30af42034fc03bf462444199df5ac774aaa536"} Jun 11 23:40:14.582767 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:14.582717 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:14.677293 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:14.677196 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:14.853228 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:14.853160 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:14.954227 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:14.954139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:15.013713 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.013665 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj"] Jun 11 23:40:15.017363 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.017134 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.020368 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.020302 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 23:40:15.020523 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.020383 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wwdx\"" Jun 11 23:40:15.020811 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.020792 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 23:40:15.020886 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.020829 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 23:40:15.021401 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.021378 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 23:40:15.034299 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.034167 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj"] Jun 11 23:40:15.111108 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.111070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e26b1427-59c3-4c15-b2ef-f461db52e737-manifests\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.111108 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.111108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e26b1427-59c3-4c15-b2ef-f461db52e737-tmp\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.111351 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.111135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e26b1427-59c3-4c15-b2ef-f461db52e737-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.111351 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.111227 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e26b1427-59c3-4c15-b2ef-f461db52e737-webhook-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.111351 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.111282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrsxn\" (UniqueName: \"kubernetes.io/projected/e26b1427-59c3-4c15-b2ef-f461db52e737-kube-api-access-hrsxn\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.168578 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.168543 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:15.212724 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.212635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e26b1427-59c3-4c15-b2ef-f461db52e737-manifests\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.212724 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.212683 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e26b1427-59c3-4c15-b2ef-f461db52e737-tmp\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.212724 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.212713 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e26b1427-59c3-4c15-b2ef-f461db52e737-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.213007 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.212751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e26b1427-59c3-4c15-b2ef-f461db52e737-webhook-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.213007 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.212918 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrsxn\" (UniqueName: \"kubernetes.io/projected/e26b1427-59c3-4c15-b2ef-f461db52e737-kube-api-access-hrsxn\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.213113 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.213087 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e26b1427-59c3-4c15-b2ef-f461db52e737-manifests\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.215504 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.215449 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e26b1427-59c3-4c15-b2ef-f461db52e737-tmp\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.215653 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.215565 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e26b1427-59c3-4c15-b2ef-f461db52e737-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.215736 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.215715 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e26b1427-59c3-4c15-b2ef-f461db52e737-webhook-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.221437 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.221403 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrsxn\" (UniqueName: \"kubernetes.io/projected/e26b1427-59c3-4c15-b2ef-f461db52e737-kube-api-access-hrsxn\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-qffwj\" (UID: \"e26b1427-59c3-4c15-b2ef-f461db52e737\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.267884 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.267840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:15.337932 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.337825 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:15.368979 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.368937 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:15.440546 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.440513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:15.492992 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.492897 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj"] Jun 11 23:40:15.514726 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.514691 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:15.622374 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.622335 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:15.716662 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:15.716622 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:16.483618 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:40:16.483576 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26b1427_59c3_4c15_b2ef_f461db52e737.slice/crio-161dab1760361c9cf186056d76deaab4333dfc898443f783304d72d28d8c741b WatchSource:0}: Error finding container 161dab1760361c9cf186056d76deaab4333dfc898443f783304d72d28d8c741b: Status 404 returned error can't find the container with id 161dab1760361c9cf186056d76deaab4333dfc898443f783304d72d28d8c741b Jun 11 23:40:17.358849 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:17.358810 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" event={"ID":"25327e5b-e1b3-443d-afd6-064d92023e9e","Type":"ContainerStarted","Data":"647502427aac5871b714fbbe1d670f0b81ce3f4c7a6bcf0c73cff945e737e7ab"} Jun 11 23:40:17.359312 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:17.358941 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:17.360533 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:17.360503 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" event={"ID":"e26b1427-59c3-4c15-b2ef-f461db52e737","Type":"ContainerStarted","Data":"161dab1760361c9cf186056d76deaab4333dfc898443f783304d72d28d8c741b"} Jun 11 23:40:17.384249 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:17.384190 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" podStartSLOduration=1.9135623449999999 podStartE2EDuration="4.38416768s" totalImagesPullingTime="2.470605335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:40:17.383325543 +0000 UTC m=+481.105861404" watchObservedRunningTime="2026-06-11 23:40:17.38416768 +0000 UTC m=+481.106703540" Jun 11 23:40:20.374589 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:20.374554 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" event={"ID":"e26b1427-59c3-4c15-b2ef-f461db52e737","Type":"ContainerStarted","Data":"1f39e38c79c3485f3694c8d88f768bf8f1bfc91538ef16bf247fcfef53dabc0e"} Jun 11 23:40:21.379713 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:21.379671 2558 generic.go:356] "Generic (PLEG): container finished" podID="e26b1427-59c3-4c15-b2ef-f461db52e737" containerID="1f39e38c79c3485f3694c8d88f768bf8f1bfc91538ef16bf247fcfef53dabc0e" exitCode=0 Jun 11 23:40:21.380157 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:21.379761 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" event={"ID":"e26b1427-59c3-4c15-b2ef-f461db52e737","Type":"ContainerDied","Data":"1f39e38c79c3485f3694c8d88f768bf8f1bfc91538ef16bf247fcfef53dabc0e"} Jun 11 23:40:22.385466 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:22.385408 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" event={"ID":"e26b1427-59c3-4c15-b2ef-f461db52e737","Type":"ContainerStarted","Data":"4b9fd06ab5d478cfe9011a7916ed1844f8c2c8b72b5a121c32e57f6b3bbd42b3"} Jun 11 23:40:22.385880 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:22.385547 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:22.408474 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:22.408400 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" podStartSLOduration=4.272168268 podStartE2EDuration="8.408377773s" totalImagesPullingTime="3.162167713s" totalInitContainerRuntime="974.041792ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:40:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:40:22.406503493 +0000 UTC m=+486.129039358" watchObservedRunningTime="2026-06-11 23:40:22.408377773 +0000 UTC m=+486.130913636" Jun 11 23:40:25.717401 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:25.717357 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:28.365723 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:28.365694 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65f5df65d6-nfhpx" Jun 11 23:40:33.392575 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:33.392543 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-qffwj" Jun 11 23:40:34.852917 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:34.852877 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:34.965393 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:34.965353 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:35.174741 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:35.174651 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:35.264691 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:35.264661 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:35.379151 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:35.379116 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:35.477755 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:35.477663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:35.696797 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:35.696762 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:35.783174 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:35.783081 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:35.878557 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:35.878526 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:36.227363 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:36.227326 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:36.385318 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:36.385287 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:36.565651 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:36.565555 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:36.888532 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:36.888502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:46.087581 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:46.087540 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:46.184017 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:46.183990 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:46.303467 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:46.303402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:46.446781 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:46.446741 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:47.374679 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:47.374641 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:47.492267 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:47.492229 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:47.593252 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:47.593211 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:53.140724 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:53.140642 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:53.242682 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:53.242637 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:54.248049 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:54.248015 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:54.363664 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:54.363631 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:55.121770 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:55.121722 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:55.385132 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:55.385034 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:40:55.685210 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:40:55.685116 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:05.540960 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:05.540920 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:05.631628 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:05.631590 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:06.001296 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:06.001268 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:06.058851 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:06.058820 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:06.163975 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:06.163941 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:09.657802 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:09.657766 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:09.755076 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:09.755042 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:09.908727 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:09.908647 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p"] Jun 11 23:41:09.910667 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:09.910649 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:09.913060 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:09.913031 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 23:41:09.913180 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:09.913079 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 23:41:09.913180 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:09.913141 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 23:41:09.913180 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:09.913144 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9t52w\"" Jun 11 23:41:09.922598 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:09.922573 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p"] Jun 11 23:41:09.931818 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:09.931789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:10.030434 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.030391 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.030607 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.030461 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.030607 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.030481 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30851afc-5572-4a22-8694-5430ce554def-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.030607 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.030499 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30851afc-5572-4a22-8694-5430ce554def-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.030607 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.030526 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.030607 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.030582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30851afc-5572-4a22-8694-5430ce554def-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.030773 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.030648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.030773 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.030674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.030773 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.030733 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxlxb\" (UniqueName: \"kubernetes.io/projected/30851afc-5572-4a22-8694-5430ce554def-kube-api-access-qxlxb\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.096901 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.096861 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:10.131268 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.131405 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131277 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.131405 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30851afc-5572-4a22-8694-5430ce554def-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.131405 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131330 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30851afc-5572-4a22-8694-5430ce554def-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.131405 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131368 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.131405 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131396 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30851afc-5572-4a22-8694-5430ce554def-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.131674 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.131674 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.131674 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxlxb\" (UniqueName: \"kubernetes.io/projected/30851afc-5572-4a22-8694-5430ce554def-kube-api-access-qxlxb\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.131804 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131721 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.131876 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131854 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.132010 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.131990 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.132088 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.132072 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30851afc-5572-4a22-8694-5430ce554def-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.132139 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.132081 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.134043 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.134026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30851afc-5572-4a22-8694-5430ce554def-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.134217 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.134197 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30851afc-5572-4a22-8694-5430ce554def-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.139388 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.139344 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30851afc-5572-4a22-8694-5430ce554def-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.140876 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.140858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxlxb\" (UniqueName: \"kubernetes.io/projected/30851afc-5572-4a22-8694-5430ce554def-kube-api-access-qxlxb\") pod \"data-science-gateway-data-science-gateway-class-5b556588bck9z2p\" (UID: \"30851afc-5572-4a22-8694-5430ce554def\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.220981 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.220889 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:10.325906 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.325869 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:10.354147 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.354124 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p"] Jun 11 23:41:10.356730 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:41:10.356704 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30851afc_5572_4a22_8694_5430ce554def.slice/crio-ea983325c957340f54bf7fbd15c14c74ea1f75e49b664f33ff3dbcfa5c3b6b19 WatchSource:0}: Error finding container ea983325c957340f54bf7fbd15c14c74ea1f75e49b664f33ff3dbcfa5c3b6b19: Status 404 returned error can't find the container with id ea983325c957340f54bf7fbd15c14c74ea1f75e49b664f33ff3dbcfa5c3b6b19 Jun 11 23:41:10.547367 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.547272 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8569bc4bf6-jphnd"] Jun 11 23:41:10.549974 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.549954 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" Jun 11 23:41:10.551741 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.551712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" event={"ID":"30851afc-5572-4a22-8694-5430ce554def","Type":"ContainerStarted","Data":"ea983325c957340f54bf7fbd15c14c74ea1f75e49b664f33ff3dbcfa5c3b6b19"} Jun 11 23:41:10.552717 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.552694 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 23:41:10.553172 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.553153 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k2g6m\"" Jun 11 23:41:10.562690 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.562667 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8569bc4bf6-jphnd"] Jun 11 23:41:10.612057 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.612027 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:10.636068 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.636027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86jwp\" (UniqueName: \"kubernetes.io/projected/c3002c7f-4f99-4e69-8ee5-6681a16029ff-kube-api-access-86jwp\") pod \"dashboard-redirect-8569bc4bf6-jphnd\" (UID: \"c3002c7f-4f99-4e69-8ee5-6681a16029ff\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" Jun 11 23:41:10.636068 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.636069 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c3002c7f-4f99-4e69-8ee5-6681a16029ff-redirect-config\") pod \"dashboard-redirect-8569bc4bf6-jphnd\" (UID: \"c3002c7f-4f99-4e69-8ee5-6681a16029ff\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" Jun 11 23:41:10.737473 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.737400 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86jwp\" (UniqueName: \"kubernetes.io/projected/c3002c7f-4f99-4e69-8ee5-6681a16029ff-kube-api-access-86jwp\") pod \"dashboard-redirect-8569bc4bf6-jphnd\" (UID: \"c3002c7f-4f99-4e69-8ee5-6681a16029ff\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" Jun 11 23:41:10.737473 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.737470 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c3002c7f-4f99-4e69-8ee5-6681a16029ff-redirect-config\") pod \"dashboard-redirect-8569bc4bf6-jphnd\" (UID: \"c3002c7f-4f99-4e69-8ee5-6681a16029ff\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" Jun 11 23:41:10.738180 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.738161 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c3002c7f-4f99-4e69-8ee5-6681a16029ff-redirect-config\") pod \"dashboard-redirect-8569bc4bf6-jphnd\" (UID: \"c3002c7f-4f99-4e69-8ee5-6681a16029ff\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" Jun 11 23:41:10.745961 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.745938 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86jwp\" (UniqueName: \"kubernetes.io/projected/c3002c7f-4f99-4e69-8ee5-6681a16029ff-kube-api-access-86jwp\") pod \"dashboard-redirect-8569bc4bf6-jphnd\" (UID: \"c3002c7f-4f99-4e69-8ee5-6681a16029ff\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" Jun 11 23:41:10.860818 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.860786 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" Jun 11 23:41:10.989797 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:10.989771 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8569bc4bf6-jphnd"] Jun 11 23:41:10.992000 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:41:10.991974 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3002c7f_4f99_4e69_8ee5_6681a16029ff.slice/crio-d30201a902f818fcab0ed37ce58df910dc095ea71ec933afeb17232f73b99de2 WatchSource:0}: Error finding container d30201a902f818fcab0ed37ce58df910dc095ea71ec933afeb17232f73b99de2: Status 404 returned error can't find the container with id d30201a902f818fcab0ed37ce58df910dc095ea71ec933afeb17232f73b99de2 Jun 11 23:41:11.558517 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:11.558478 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" event={"ID":"c3002c7f-4f99-4e69-8ee5-6681a16029ff","Type":"ContainerStarted","Data":"d30201a902f818fcab0ed37ce58df910dc095ea71ec933afeb17232f73b99de2"} Jun 11 23:41:13.756248 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:13.756206 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:41:13.756545 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:13.756300 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:41:13.756545 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:13.756331 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:41:14.572142 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:14.572098 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" event={"ID":"c3002c7f-4f99-4e69-8ee5-6681a16029ff","Type":"ContainerStarted","Data":"06f656143b35099edbc28947040988e88739055fb9f082a83b357c640974421f"} Jun 11 23:41:14.573528 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:14.573505 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" event={"ID":"30851afc-5572-4a22-8694-5430ce554def","Type":"ContainerStarted","Data":"ee3317cff581c604306a48916fd4513012b91d8d42f338f554730291d6be7b82"} Jun 11 23:41:14.589032 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:14.588985 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8569bc4bf6-jphnd" podStartSLOduration=1.832070194 podStartE2EDuration="4.588972756s" totalImagesPullingTime="2.756902562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:41:14.587216743 +0000 UTC m=+538.309752608" watchObservedRunningTime="2026-06-11 23:41:14.588972756 +0000 UTC m=+538.311508652" Jun 11 23:41:14.608525 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:14.608472 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" podStartSLOduration=2.211351852 podStartE2EDuration="5.608454391s" totalImagesPullingTime="3.397102539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:41:14.607886912 +0000 UTC m=+538.330422795" watchObservedRunningTime="2026-06-11 23:41:14.608454391 +0000 UTC m=+538.330990254" Jun 11 23:41:15.221408 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:15.221370 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:15.225967 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:15.225942 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:15.576994 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:15.576899 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:15.577805 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:15.577783 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bck9z2p" Jun 11 23:41:16.033235 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:16.033194 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:16.084646 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:16.084603 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:36.487914 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.487872 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:36.581519 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.581477 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:36.595314 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.595280 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5v44z"] Jun 11 23:41:36.598979 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.598953 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5v44z" Jun 11 23:41:36.601609 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.601580 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:41:36.602493 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.602472 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:41:36.602611 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.602514 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gnjh7\"" Jun 11 23:41:36.608819 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.608793 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5v44z"] Jun 11 23:41:36.646113 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.646079 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:36.737597 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.737560 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85zw8\" (UniqueName: \"kubernetes.io/projected/67cf0675-41d3-4030-be30-7a086e666434-kube-api-access-85zw8\") pod \"kuadrant-operator-catalog-5v44z\" (UID: \"67cf0675-41d3-4030-be30-7a086e666434\") " pod="kuadrant-system/kuadrant-operator-catalog-5v44z" Jun 11 23:41:36.839005 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.838902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85zw8\" (UniqueName: \"kubernetes.io/projected/67cf0675-41d3-4030-be30-7a086e666434-kube-api-access-85zw8\") pod \"kuadrant-operator-catalog-5v44z\" (UID: \"67cf0675-41d3-4030-be30-7a086e666434\") " pod="kuadrant-system/kuadrant-operator-catalog-5v44z" Jun 11 23:41:36.847201 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.847163 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85zw8\" (UniqueName: \"kubernetes.io/projected/67cf0675-41d3-4030-be30-7a086e666434-kube-api-access-85zw8\") pod \"kuadrant-operator-catalog-5v44z\" (UID: \"67cf0675-41d3-4030-be30-7a086e666434\") " pod="kuadrant-system/kuadrant-operator-catalog-5v44z" Jun 11 23:41:36.908808 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.908761 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5v44z" Jun 11 23:41:36.964077 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:36.964041 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5v44z"] Jun 11 23:41:37.049989 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.049957 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5v44z"] Jun 11 23:41:37.053279 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:41:37.053247 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67cf0675_41d3_4030_be30_7a086e666434.slice/crio-0acdfcf53a59dd284bd698cf60ff210a118be116d59b6fe9a650b297bd61fc16 WatchSource:0}: Error finding container 0acdfcf53a59dd284bd698cf60ff210a118be116d59b6fe9a650b297bd61fc16: Status 404 returned error can't find the container with id 0acdfcf53a59dd284bd698cf60ff210a118be116d59b6fe9a650b297bd61fc16 Jun 11 23:41:37.170137 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.170107 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6w4xx"] Jun 11 23:41:37.174285 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.174265 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" Jun 11 23:41:37.181742 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.181590 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6w4xx"] Jun 11 23:41:37.343855 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.343814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7sg7\" (UniqueName: \"kubernetes.io/projected/d7a3c7f2-292f-4e93-a84c-fa4eba225e14-kube-api-access-k7sg7\") pod \"kuadrant-operator-catalog-6w4xx\" (UID: \"d7a3c7f2-292f-4e93-a84c-fa4eba225e14\") " pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" Jun 11 23:41:37.445257 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.445174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7sg7\" (UniqueName: \"kubernetes.io/projected/d7a3c7f2-292f-4e93-a84c-fa4eba225e14-kube-api-access-k7sg7\") pod \"kuadrant-operator-catalog-6w4xx\" (UID: \"d7a3c7f2-292f-4e93-a84c-fa4eba225e14\") " pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" Jun 11 23:41:37.454023 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.453992 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7sg7\" (UniqueName: \"kubernetes.io/projected/d7a3c7f2-292f-4e93-a84c-fa4eba225e14-kube-api-access-k7sg7\") pod \"kuadrant-operator-catalog-6w4xx\" (UID: \"d7a3c7f2-292f-4e93-a84c-fa4eba225e14\") " pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" Jun 11 23:41:37.484663 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.484626 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" Jun 11 23:41:37.641386 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.641356 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6w4xx"] Jun 11 23:41:37.648381 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:41:37.648355 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a3c7f2_292f_4e93_a84c_fa4eba225e14.slice/crio-f2da16b684306b47e71e3ae1cb1e6da81bf6583cd6685db4777fce2ffd63eba4 WatchSource:0}: Error finding container f2da16b684306b47e71e3ae1cb1e6da81bf6583cd6685db4777fce2ffd63eba4: Status 404 returned error can't find the container with id f2da16b684306b47e71e3ae1cb1e6da81bf6583cd6685db4777fce2ffd63eba4 Jun 11 23:41:37.657274 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.657249 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" event={"ID":"d7a3c7f2-292f-4e93-a84c-fa4eba225e14","Type":"ContainerStarted","Data":"f2da16b684306b47e71e3ae1cb1e6da81bf6583cd6685db4777fce2ffd63eba4"} Jun 11 23:41:37.658274 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:37.658244 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5v44z" event={"ID":"67cf0675-41d3-4030-be30-7a086e666434","Type":"ContainerStarted","Data":"0acdfcf53a59dd284bd698cf60ff210a118be116d59b6fe9a650b297bd61fc16"} Jun 11 23:41:39.669005 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:39.668967 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" event={"ID":"d7a3c7f2-292f-4e93-a84c-fa4eba225e14","Type":"ContainerStarted","Data":"dfaca15f15c7279b78baf4da90011e5c8c6bc1b82656b615bf71548f1615d384"} Jun 11 23:41:39.670395 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:39.670365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5v44z" event={"ID":"67cf0675-41d3-4030-be30-7a086e666434","Type":"ContainerStarted","Data":"98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4"} Jun 11 23:41:39.670527 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:39.670405 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5v44z" podUID="67cf0675-41d3-4030-be30-7a086e666434" containerName="registry-server" containerID="cri-o://98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4" gracePeriod=2 Jun 11 23:41:39.684285 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:39.684241 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" podStartSLOduration=1.15564976 podStartE2EDuration="2.684225269s" totalImagesPullingTime="1.528575509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:41:39.683196655 +0000 UTC m=+563.405732543" watchObservedRunningTime="2026-06-11 23:41:39.684225269 +0000 UTC m=+563.406761109" Jun 11 23:41:39.697881 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:39.697831 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5v44z" podStartSLOduration=1.5769552409999998 podStartE2EDuration="3.697814261s" totalImagesPullingTime="2.12085902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:41:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:41:39.69662008 +0000 UTC m=+563.419155959" watchObservedRunningTime="2026-06-11 23:41:39.697814261 +0000 UTC m=+563.420350123" Jun 11 23:41:39.918402 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:39.918376 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5v44z" Jun 11 23:41:40.067741 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.067641 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85zw8\" (UniqueName: \"kubernetes.io/projected/67cf0675-41d3-4030-be30-7a086e666434-kube-api-access-85zw8\") pod \"67cf0675-41d3-4030-be30-7a086e666434\" (UID: \"67cf0675-41d3-4030-be30-7a086e666434\") " Jun 11 23:41:40.070004 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.069979 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67cf0675-41d3-4030-be30-7a086e666434-kube-api-access-85zw8" (OuterVolumeSpecName: "kube-api-access-85zw8") pod "67cf0675-41d3-4030-be30-7a086e666434" (UID: "67cf0675-41d3-4030-be30-7a086e666434"). InnerVolumeSpecName "kube-api-access-85zw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:41:40.168605 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.168566 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85zw8\" (UniqueName: \"kubernetes.io/projected/67cf0675-41d3-4030-be30-7a086e666434-kube-api-access-85zw8\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:41:40.675364 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.675327 2558 generic.go:356] "Generic (PLEG): container finished" podID="67cf0675-41d3-4030-be30-7a086e666434" containerID="98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4" exitCode=0 Jun 11 23:41:40.675838 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.675368 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5v44z" Jun 11 23:41:40.675838 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.675412 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5v44z" event={"ID":"67cf0675-41d3-4030-be30-7a086e666434","Type":"ContainerDied","Data":"98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4"} Jun 11 23:41:40.675838 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.675484 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5v44z" event={"ID":"67cf0675-41d3-4030-be30-7a086e666434","Type":"ContainerDied","Data":"0acdfcf53a59dd284bd698cf60ff210a118be116d59b6fe9a650b297bd61fc16"} Jun 11 23:41:40.675838 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.675505 2558 scope.go:117] "RemoveContainer" containerID="98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4" Jun 11 23:41:40.684747 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.684729 2558 scope.go:117] "RemoveContainer" containerID="98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4" Jun 11 23:41:40.685002 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:41:40.684984 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4\": container with ID starting with 98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4 not found: ID does not exist" containerID="98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4" Jun 11 23:41:40.685063 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.685014 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4"} err="failed to get container status \"98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4\": rpc error: code = NotFound desc = could not find container \"98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4\": container with ID starting with 98ad0de23d2f1820b4957c4d844c64bd50abb8ab4632a68719c2f30092032dc4 not found: ID does not exist" Jun 11 23:41:40.699052 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.699016 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5v44z"] Jun 11 23:41:40.699052 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:40.699056 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5v44z"] Jun 11 23:41:42.699097 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:42.699062 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67cf0675-41d3-4030-be30-7a086e666434" path="/var/lib/kubelet/pods/67cf0675-41d3-4030-be30-7a086e666434/volumes" Jun 11 23:41:47.485626 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:47.485587 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" Jun 11 23:41:47.486126 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:47.485659 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" Jun 11 23:41:47.508713 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:47.508653 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" Jun 11 23:41:47.724819 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:47.724788 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6w4xx" Jun 11 23:41:55.182820 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:55.182770 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:55.284264 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:55.284229 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:57.329965 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:57.329922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:41:57.381801 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:41:57.381755 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:05.973941 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:05.973908 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:08.590686 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.590654 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq"] Jun 11 23:42:08.591083 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.590930 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67cf0675-41d3-4030-be30-7a086e666434" containerName="registry-server" Jun 11 23:42:08.591083 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.590940 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="67cf0675-41d3-4030-be30-7a086e666434" containerName="registry-server" Jun 11 23:42:08.591083 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.590999 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="67cf0675-41d3-4030-be30-7a086e666434" containerName="registry-server" Jun 11 23:42:08.598668 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.598649 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq" Jun 11 23:42:08.601046 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.601022 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 23:42:08.601270 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.601254 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-h8vsp\"" Jun 11 23:42:08.610020 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.610000 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq"] Jun 11 23:42:08.652928 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.652892 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr5th\" (UniqueName: \"kubernetes.io/projected/2f94d0ec-369a-463b-8d93-bacd7ef149a8-kube-api-access-qr5th\") pod \"dns-operator-controller-manager-864dd78c4c-hl6lq\" (UID: \"2f94d0ec-369a-463b-8d93-bacd7ef149a8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq" Jun 11 23:42:08.754293 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.754242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr5th\" (UniqueName: \"kubernetes.io/projected/2f94d0ec-369a-463b-8d93-bacd7ef149a8-kube-api-access-qr5th\") pod \"dns-operator-controller-manager-864dd78c4c-hl6lq\" (UID: \"2f94d0ec-369a-463b-8d93-bacd7ef149a8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq" Jun 11 23:42:08.764526 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.764493 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr5th\" (UniqueName: \"kubernetes.io/projected/2f94d0ec-369a-463b-8d93-bacd7ef149a8-kube-api-access-qr5th\") pod \"dns-operator-controller-manager-864dd78c4c-hl6lq\" (UID: \"2f94d0ec-369a-463b-8d93-bacd7ef149a8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq" Jun 11 23:42:08.908650 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:08.908620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq" Jun 11 23:42:09.052024 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:09.051990 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq"] Jun 11 23:42:09.052404 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:42:09.052373 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f94d0ec_369a_463b_8d93_bacd7ef149a8.slice/crio-52565f870fd36d6ba0648bb1965a363a490225e3ac84d837dbb21c4b8f62ae05 WatchSource:0}: Error finding container 52565f870fd36d6ba0648bb1965a363a490225e3ac84d837dbb21c4b8f62ae05: Status 404 returned error can't find the container with id 52565f870fd36d6ba0648bb1965a363a490225e3ac84d837dbb21c4b8f62ae05 Jun 11 23:42:09.562652 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:09.562613 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:09.788617 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:09.788587 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq" event={"ID":"2f94d0ec-369a-463b-8d93-bacd7ef149a8","Type":"ContainerStarted","Data":"52565f870fd36d6ba0648bb1965a363a490225e3ac84d837dbb21c4b8f62ae05"} Jun 11 23:42:11.797708 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:11.797676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq" event={"ID":"2f94d0ec-369a-463b-8d93-bacd7ef149a8","Type":"ContainerStarted","Data":"2aa10dc8a699c7bb496047559515207e4f42d79a4168eb3fb2e8db7f7cda07a5"} Jun 11 23:42:11.798128 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:11.797814 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq" Jun 11 23:42:11.815749 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:11.815702 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq" podStartSLOduration=1.794337213 podStartE2EDuration="3.815687726s" totalImagesPullingTime="2.021350513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:11.815024846 +0000 UTC m=+595.537560728" watchObservedRunningTime="2026-06-11 23:42:11.815687726 +0000 UTC m=+595.538223588" Jun 11 23:42:12.595088 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:12.595051 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:13.961324 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:13.961289 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5"] Jun 11 23:42:13.965429 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:13.965401 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:13.969156 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:13.969136 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8xj6z\"" Jun 11 23:42:13.994887 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:13.994857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e968ee6-e711-40f7-b65a-e7f142e437b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" (UID: \"4e968ee6-e711-40f7-b65a-e7f142e437b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:13.995074 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:13.994901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhnf6\" (UniqueName: \"kubernetes.io/projected/4e968ee6-e711-40f7-b65a-e7f142e437b1-kube-api-access-jhnf6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" (UID: \"4e968ee6-e711-40f7-b65a-e7f142e437b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:14.015947 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.015910 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5"] Jun 11 23:42:14.095903 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.095868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhnf6\" (UniqueName: \"kubernetes.io/projected/4e968ee6-e711-40f7-b65a-e7f142e437b1-kube-api-access-jhnf6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" (UID: \"4e968ee6-e711-40f7-b65a-e7f142e437b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:14.096079 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.095937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e968ee6-e711-40f7-b65a-e7f142e437b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" (UID: \"4e968ee6-e711-40f7-b65a-e7f142e437b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:14.096285 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.096266 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e968ee6-e711-40f7-b65a-e7f142e437b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" (UID: \"4e968ee6-e711-40f7-b65a-e7f142e437b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:14.104789 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.104758 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:14.119295 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.119261 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhnf6\" (UniqueName: \"kubernetes.io/projected/4e968ee6-e711-40f7-b65a-e7f142e437b1-kube-api-access-jhnf6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" (UID: \"4e968ee6-e711-40f7-b65a-e7f142e437b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:14.275641 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.275540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:14.374588 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.374548 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:14.413371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.413336 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5"] Jun 11 23:42:14.417908 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:42:14.417880 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e968ee6_e711_40f7_b65a_e7f142e437b1.slice/crio-a17e4591684b51f1f529b2687fd9bedd912d127c15893515754c9ece890ad30d WatchSource:0}: Error finding container a17e4591684b51f1f529b2687fd9bedd912d127c15893515754c9ece890ad30d: Status 404 returned error can't find the container with id a17e4591684b51f1f529b2687fd9bedd912d127c15893515754c9ece890ad30d Jun 11 23:42:14.810231 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.810196 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" event={"ID":"4e968ee6-e711-40f7-b65a-e7f142e437b1","Type":"ContainerStarted","Data":"a17e4591684b51f1f529b2687fd9bedd912d127c15893515754c9ece890ad30d"} Jun 11 23:42:14.957697 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:14.957658 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:16.682813 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:16.682781 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:42:16.683225 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:16.682870 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:42:17.464490 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:17.464406 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:17.559811 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:17.559772 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:18.358376 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:18.358323 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:20.209933 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:20.209821 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:21.776632 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:21.776593 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:21.841181 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:21.841136 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" event={"ID":"4e968ee6-e711-40f7-b65a-e7f142e437b1","Type":"ContainerStarted","Data":"dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98"} Jun 11 23:42:21.841374 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:21.841290 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:21.860156 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:21.860099 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" podStartSLOduration=2.124333163 podStartE2EDuration="8.860080699s" totalImagesPullingTime="6.735747536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:21.858913243 +0000 UTC m=+605.581449139" watchObservedRunningTime="2026-06-11 23:42:21.860080699 +0000 UTC m=+605.582616561" Jun 11 23:42:21.863474 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:21.863443 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:22.805076 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:22.805046 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hl6lq" Jun 11 23:42:24.000272 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.000239 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq"] Jun 11 23:42:24.003599 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.003581 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.005809 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.005788 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5q9ls\"" Jun 11 23:42:24.005928 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.005886 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 23:42:24.006071 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.006056 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 23:42:24.014934 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.014908 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq"] Jun 11 23:42:24.015149 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.015129 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:24.074829 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.074789 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2308acd7-21b7-4dba-8dcd-59497d5583f4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kxqdq\" (UID: \"2308acd7-21b7-4dba-8dcd-59497d5583f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.074829 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.074824 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2308acd7-21b7-4dba-8dcd-59497d5583f4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kxqdq\" (UID: \"2308acd7-21b7-4dba-8dcd-59497d5583f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.075031 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.074884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdz2n\" (UniqueName: \"kubernetes.io/projected/2308acd7-21b7-4dba-8dcd-59497d5583f4-kube-api-access-hdz2n\") pod \"kuadrant-console-plugin-66b5774985-kxqdq\" (UID: \"2308acd7-21b7-4dba-8dcd-59497d5583f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.175469 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.175392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2308acd7-21b7-4dba-8dcd-59497d5583f4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kxqdq\" (UID: \"2308acd7-21b7-4dba-8dcd-59497d5583f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.175469 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.175473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2308acd7-21b7-4dba-8dcd-59497d5583f4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kxqdq\" (UID: \"2308acd7-21b7-4dba-8dcd-59497d5583f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.175726 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.175512 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdz2n\" (UniqueName: \"kubernetes.io/projected/2308acd7-21b7-4dba-8dcd-59497d5583f4-kube-api-access-hdz2n\") pod \"kuadrant-console-plugin-66b5774985-kxqdq\" (UID: \"2308acd7-21b7-4dba-8dcd-59497d5583f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.175726 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:24.175559 2558 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 23:42:24.175726 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:24.175637 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2308acd7-21b7-4dba-8dcd-59497d5583f4-plugin-serving-cert podName:2308acd7-21b7-4dba-8dcd-59497d5583f4 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:24.675615573 +0000 UTC m=+608.398151426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/2308acd7-21b7-4dba-8dcd-59497d5583f4-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-kxqdq" (UID: "2308acd7-21b7-4dba-8dcd-59497d5583f4") : secret "plugin-serving-cert" not found Jun 11 23:42:24.176185 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.176162 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2308acd7-21b7-4dba-8dcd-59497d5583f4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kxqdq\" (UID: \"2308acd7-21b7-4dba-8dcd-59497d5583f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.185122 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.185095 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdz2n\" (UniqueName: \"kubernetes.io/projected/2308acd7-21b7-4dba-8dcd-59497d5583f4-kube-api-access-hdz2n\") pod \"kuadrant-console-plugin-66b5774985-kxqdq\" (UID: \"2308acd7-21b7-4dba-8dcd-59497d5583f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.365488 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.365449 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:24.679947 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.679865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2308acd7-21b7-4dba-8dcd-59497d5583f4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kxqdq\" (UID: \"2308acd7-21b7-4dba-8dcd-59497d5583f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.682473 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.682451 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2308acd7-21b7-4dba-8dcd-59497d5583f4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kxqdq\" (UID: \"2308acd7-21b7-4dba-8dcd-59497d5583f4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:24.912223 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:24.912187 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" Jun 11 23:42:25.040803 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:25.040777 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq"] Jun 11 23:42:25.043213 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:42:25.043181 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2308acd7_21b7_4dba_8dcd_59497d5583f4.slice/crio-d8998d504d2a778c8f7243957d08d86815895f575d7264046985ef8fbf664ab9 WatchSource:0}: Error finding container d8998d504d2a778c8f7243957d08d86815895f575d7264046985ef8fbf664ab9: Status 404 returned error can't find the container with id d8998d504d2a778c8f7243957d08d86815895f575d7264046985ef8fbf664ab9 Jun 11 23:42:25.360623 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:25.360581 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:25.461232 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:25.461196 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:25.859967 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:25.859925 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" event={"ID":"2308acd7-21b7-4dba-8dcd-59497d5583f4","Type":"ContainerStarted","Data":"d8998d504d2a778c8f7243957d08d86815895f575d7264046985ef8fbf664ab9"} Jun 11 23:42:32.848877 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:32.848849 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:34.424865 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.424828 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2"] Jun 11 23:42:34.435385 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.435342 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:34.455467 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.455400 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2"] Jun 11 23:42:34.568243 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.568201 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45452ad5-4a69-4e39-bab1-f0704951d819-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" (UID: \"45452ad5-4a69-4e39-bab1-f0704951d819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:34.568431 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.568333 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mkt\" (UniqueName: \"kubernetes.io/projected/45452ad5-4a69-4e39-bab1-f0704951d819-kube-api-access-82mkt\") pod \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" (UID: \"45452ad5-4a69-4e39-bab1-f0704951d819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:34.615959 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.615926 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2"] Jun 11 23:42:34.616221 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:34.616200 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-82mkt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" podUID="45452ad5-4a69-4e39-bab1-f0704951d819" Jun 11 23:42:34.623767 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.623736 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2"] Jun 11 23:42:34.641371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.641336 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5"] Jun 11 23:42:34.641729 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.641581 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" containerName="manager" containerID="cri-o://dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98" gracePeriod=2 Jun 11 23:42:34.646490 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.646463 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj"] Jun 11 23:42:34.657442 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:34.655750 2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4e968ee6-e711-40f7-b65a-e7f142e437b1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\": pods \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:34.657442 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.656478 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5"] Jun 11 23:42:34.657442 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.656936 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" Jun 11 23:42:34.667452 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.667400 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj"] Jun 11 23:42:34.668889 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.668860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45452ad5-4a69-4e39-bab1-f0704951d819-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" (UID: \"45452ad5-4a69-4e39-bab1-f0704951d819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:34.669027 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.668972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mkt\" (UniqueName: \"kubernetes.io/projected/45452ad5-4a69-4e39-bab1-f0704951d819-kube-api-access-82mkt\") pod \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" (UID: \"45452ad5-4a69-4e39-bab1-f0704951d819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:34.669291 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.669265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45452ad5-4a69-4e39-bab1-f0704951d819-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" (UID: \"45452ad5-4a69-4e39-bab1-f0704951d819\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:34.677263 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:34.677199 2558 projected.go:196] Error preparing data for projected volume kube-api-access-82mkt for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-49qv2" not found Jun 11 23:42:34.677530 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:34.677509 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45452ad5-4a69-4e39-bab1-f0704951d819-kube-api-access-82mkt podName:45452ad5-4a69-4e39-bab1-f0704951d819 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:35.177485068 +0000 UTC m=+618.900020920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-82mkt" (UniqueName: "kubernetes.io/projected/45452ad5-4a69-4e39-bab1-f0704951d819-kube-api-access-82mkt") pod "kuadrant-operator-controller-manager-55467d9f7-49qv2" (UID: "45452ad5-4a69-4e39-bab1-f0704951d819") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-49qv2" not found Jun 11 23:42:34.683072 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.683038 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49"] Jun 11 23:42:34.683452 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.683398 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" containerName="manager" Jun 11 23:42:34.683452 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.683444 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" containerName="manager" Jun 11 23:42:34.683591 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.683542 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" containerName="manager" Jun 11 23:42:34.685746 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:34.685711 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:34.686915 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.686892 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:34.688148 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.688124 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:34.690369 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:34.690341 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:34.715143 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.714481 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj"] Jun 11 23:42:34.716381 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.716356 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49"] Jun 11 23:42:34.722438 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:34.722395 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-kxklq], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-kxklq]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" podUID="cb0ca11b-7e46-4833-896c-c524e200ae84" Jun 11 23:42:34.769807 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.769758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxklq\" (UniqueName: \"kubernetes.io/projected/cb0ca11b-7e46-4833-896c-c524e200ae84-kube-api-access-kxklq\") pod \"kuadrant-operator-controller-manager-55467d9f7-lllcj\" (UID: \"cb0ca11b-7e46-4833-896c-c524e200ae84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" Jun 11 23:42:34.770010 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.769859 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt2xs\" (UniqueName: \"kubernetes.io/projected/5bcd0d2a-5908-4022-bbd8-a584d05cb386-kube-api-access-tt2xs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsv49\" (UID: \"5bcd0d2a-5908-4022-bbd8-a584d05cb386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:34.770010 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.769991 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb0ca11b-7e46-4833-896c-c524e200ae84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lllcj\" (UID: \"cb0ca11b-7e46-4833-896c-c524e200ae84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" Jun 11 23:42:34.770129 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.770035 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bcd0d2a-5908-4022-bbd8-a584d05cb386-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsv49\" (UID: \"5bcd0d2a-5908-4022-bbd8-a584d05cb386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:34.858562 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.858526 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:34.871150 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.871123 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxklq\" (UniqueName: \"kubernetes.io/projected/cb0ca11b-7e46-4833-896c-c524e200ae84-kube-api-access-kxklq\") pod \"kuadrant-operator-controller-manager-55467d9f7-lllcj\" (UID: \"cb0ca11b-7e46-4833-896c-c524e200ae84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" Jun 11 23:42:34.871321 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.871179 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt2xs\" (UniqueName: \"kubernetes.io/projected/5bcd0d2a-5908-4022-bbd8-a584d05cb386-kube-api-access-tt2xs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsv49\" (UID: \"5bcd0d2a-5908-4022-bbd8-a584d05cb386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:34.871321 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.871225 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb0ca11b-7e46-4833-896c-c524e200ae84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lllcj\" (UID: \"cb0ca11b-7e46-4833-896c-c524e200ae84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" Jun 11 23:42:34.871490 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.871471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bcd0d2a-5908-4022-bbd8-a584d05cb386-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsv49\" (UID: \"5bcd0d2a-5908-4022-bbd8-a584d05cb386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:34.871716 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.871690 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb0ca11b-7e46-4833-896c-c524e200ae84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lllcj\" (UID: \"cb0ca11b-7e46-4833-896c-c524e200ae84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" Jun 11 23:42:34.871805 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.871791 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bcd0d2a-5908-4022-bbd8-a584d05cb386-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsv49\" (UID: \"5bcd0d2a-5908-4022-bbd8-a584d05cb386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:34.899597 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.899572 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt2xs\" (UniqueName: \"kubernetes.io/projected/5bcd0d2a-5908-4022-bbd8-a584d05cb386-kube-api-access-tt2xs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gsv49\" (UID: \"5bcd0d2a-5908-4022-bbd8-a584d05cb386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:34.899759 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.899594 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxklq\" (UniqueName: \"kubernetes.io/projected/cb0ca11b-7e46-4833-896c-c524e200ae84-kube-api-access-kxklq\") pod \"kuadrant-operator-controller-manager-55467d9f7-lllcj\" (UID: \"cb0ca11b-7e46-4833-896c-c524e200ae84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" Jun 11 23:42:34.903407 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.903373 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:34.903561 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.903373 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" Jun 11 23:42:34.928821 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.928740 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:34.930920 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.930897 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" Jun 11 23:42:34.942529 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:34.942489 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="45452ad5-4a69-4e39-bab1-f0704951d819" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:34.972648 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.972615 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb0ca11b-7e46-4833-896c-c524e200ae84-extensions-socket-volume\") pod \"cb0ca11b-7e46-4833-896c-c524e200ae84\" (UID: \"cb0ca11b-7e46-4833-896c-c524e200ae84\") " Jun 11 23:42:34.972819 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.972681 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45452ad5-4a69-4e39-bab1-f0704951d819-extensions-socket-volume\") pod \"45452ad5-4a69-4e39-bab1-f0704951d819\" (UID: \"45452ad5-4a69-4e39-bab1-f0704951d819\") " Jun 11 23:42:34.972819 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.972723 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxklq\" (UniqueName: \"kubernetes.io/projected/cb0ca11b-7e46-4833-896c-c524e200ae84-kube-api-access-kxklq\") pod \"cb0ca11b-7e46-4833-896c-c524e200ae84\" (UID: \"cb0ca11b-7e46-4833-896c-c524e200ae84\") " Jun 11 23:42:34.972929 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.972902 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82mkt\" (UniqueName: \"kubernetes.io/projected/45452ad5-4a69-4e39-bab1-f0704951d819-kube-api-access-82mkt\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:42:34.972985 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.972934 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb0ca11b-7e46-4833-896c-c524e200ae84-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb0ca11b-7e46-4833-896c-c524e200ae84" (UID: "cb0ca11b-7e46-4833-896c-c524e200ae84"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:42:34.973039 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.973015 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45452ad5-4a69-4e39-bab1-f0704951d819-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "45452ad5-4a69-4e39-bab1-f0704951d819" (UID: "45452ad5-4a69-4e39-bab1-f0704951d819"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:42:34.975099 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:34.975073 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0ca11b-7e46-4833-896c-c524e200ae84-kube-api-access-kxklq" (OuterVolumeSpecName: "kube-api-access-kxklq") pod "cb0ca11b-7e46-4833-896c-c524e200ae84" (UID: "cb0ca11b-7e46-4833-896c-c524e200ae84"). InnerVolumeSpecName "kube-api-access-kxklq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:42:35.030680 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:35.030643 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:35.031768 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:35.031735 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:35.073995 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:35.073960 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb0ca11b-7e46-4833-896c-c524e200ae84-extensions-socket-volume\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:42:35.073995 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:35.073993 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45452ad5-4a69-4e39-bab1-f0704951d819-extensions-socket-volume\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:42:35.073995 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:35.074004 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxklq\" (UniqueName: \"kubernetes.io/projected/cb0ca11b-7e46-4833-896c-c524e200ae84-kube-api-access-kxklq\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:42:35.908464 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:35.908432 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj" Jun 11 23:42:35.908889 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:35.908437 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:35.910723 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:35.910687 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="45452ad5-4a69-4e39-bab1-f0704951d819" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:35.916726 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:35.916696 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="45452ad5-4a69-4e39-bab1-f0704951d819" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:35.919997 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:35.919966 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="45452ad5-4a69-4e39-bab1-f0704951d819" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:35.950209 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:35.950172 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj"] Jun 11 23:42:35.956463 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:35.956397 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="45452ad5-4a69-4e39-bab1-f0704951d819" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:35.957495 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:35.956799 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lllcj"] Jun 11 23:42:36.699237 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:36.699192 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-49qv2\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="45452ad5-4a69-4e39-bab1-f0704951d819" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-49qv2" Jun 11 23:42:36.701191 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:36.701166 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45452ad5-4a69-4e39-bab1-f0704951d819" path="/var/lib/kubelet/pods/45452ad5-4a69-4e39-bab1-f0704951d819/volumes" Jun 11 23:42:36.701447 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:36.701434 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0ca11b-7e46-4833-896c-c524e200ae84" path="/var/lib/kubelet/pods/cb0ca11b-7e46-4833-896c-c524e200ae84/volumes" Jun 11 23:42:37.583770 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:37.583720 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:37.687684 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:37.687645 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:40.175197 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:40.175155 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:40.279200 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:40.279160 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:43.981863 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:43.981814 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:44.080894 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:44.080859 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:47.586688 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.586663 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:47.590533 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:47.590502 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:47.607041 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.607014 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49"] Jun 11 23:42:47.608236 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:42:47.608208 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bcd0d2a_5908_4022_bbd8_a584d05cb386.slice/crio-35e27dea520333545b56e4a3d3ce482b2a07bcc99e0d26c5780d71c5c7ea5007 WatchSource:0}: Error finding container 35e27dea520333545b56e4a3d3ce482b2a07bcc99e0d26c5780d71c5c7ea5007: Status 404 returned error can't find the container with id 35e27dea520333545b56e4a3d3ce482b2a07bcc99e0d26c5780d71c5c7ea5007 Jun 11 23:42:47.681765 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.681738 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhnf6\" (UniqueName: \"kubernetes.io/projected/4e968ee6-e711-40f7-b65a-e7f142e437b1-kube-api-access-jhnf6\") pod \"4e968ee6-e711-40f7-b65a-e7f142e437b1\" (UID: \"4e968ee6-e711-40f7-b65a-e7f142e437b1\") " Jun 11 23:42:47.681903 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.681792 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e968ee6-e711-40f7-b65a-e7f142e437b1-extensions-socket-volume\") pod \"4e968ee6-e711-40f7-b65a-e7f142e437b1\" (UID: \"4e968ee6-e711-40f7-b65a-e7f142e437b1\") " Jun 11 23:42:47.682258 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.682230 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e968ee6-e711-40f7-b65a-e7f142e437b1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4e968ee6-e711-40f7-b65a-e7f142e437b1" (UID: "4e968ee6-e711-40f7-b65a-e7f142e437b1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:42:47.683892 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.683862 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e968ee6-e711-40f7-b65a-e7f142e437b1-kube-api-access-jhnf6" (OuterVolumeSpecName: "kube-api-access-jhnf6") pod "4e968ee6-e711-40f7-b65a-e7f142e437b1" (UID: "4e968ee6-e711-40f7-b65a-e7f142e437b1"). InnerVolumeSpecName "kube-api-access-jhnf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:42:47.782687 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.782589 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhnf6\" (UniqueName: \"kubernetes.io/projected/4e968ee6-e711-40f7-b65a-e7f142e437b1-kube-api-access-jhnf6\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:42:47.782687 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.782628 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e968ee6-e711-40f7-b65a-e7f142e437b1-extensions-socket-volume\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:42:47.972066 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.972025 2558 generic.go:356] "Generic (PLEG): container finished" podID="4e968ee6-e711-40f7-b65a-e7f142e437b1" containerID="dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98" exitCode=0 Jun 11 23:42:47.972243 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.972074 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:47.972243 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.972119 2558 scope.go:117] "RemoveContainer" containerID="dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98" Jun 11 23:42:47.973770 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.973731 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" event={"ID":"2308acd7-21b7-4dba-8dcd-59497d5583f4","Type":"ContainerStarted","Data":"841dfb1eb5f2f20bc1951dd00cdc49a0c9e021602c2fa166f2e5ba8cb6200f1f"} Jun 11 23:42:47.974485 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:47.974454 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:47.975482 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.975453 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" event={"ID":"5bcd0d2a-5908-4022-bbd8-a584d05cb386","Type":"ContainerStarted","Data":"2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92"} Jun 11 23:42:47.975567 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.975503 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" event={"ID":"5bcd0d2a-5908-4022-bbd8-a584d05cb386","Type":"ContainerStarted","Data":"35e27dea520333545b56e4a3d3ce482b2a07bcc99e0d26c5780d71c5c7ea5007"} Jun 11 23:42:47.975617 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.975592 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:47.976372 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:47.976346 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:47.981712 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.981696 2558 scope.go:117] "RemoveContainer" containerID="dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98" Jun 11 23:42:47.981981 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:47.981963 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98\": container with ID starting with dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98 not found: ID does not exist" containerID="dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98" Jun 11 23:42:47.982028 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.981989 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98"} err="failed to get container status \"dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98\": rpc error: code = NotFound desc = could not find container \"dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98\": container with ID starting with dcbe585b24908879c150036fa818a6f0c72e3449c939cd52297c1f08a0226e98 not found: ID does not exist" Jun 11 23:42:47.992833 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:47.992793 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kxqdq" podStartSLOduration=2.496012641 podStartE2EDuration="24.9927803s" totalImagesPullingTime="22.496767659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:47.992192834 +0000 UTC m=+631.714728697" watchObservedRunningTime="2026-06-11 23:42:47.9927803 +0000 UTC m=+631.715316161" Jun 11 23:42:47.994169 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:47.994148 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mrzl5\" is forbidden: User \"system:node:ip-10-0-143-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-183.ec2.internal' and this object" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mrzl5" Jun 11 23:42:48.020559 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:48.020501 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" podStartSLOduration=14.020478954 podStartE2EDuration="14.020478954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:48.017874865 +0000 UTC m=+631.740410744" watchObservedRunningTime="2026-06-11 23:42:48.020478954 +0000 UTC m=+631.743014816" Jun 11 23:42:48.699595 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:48.699514 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e968ee6-e711-40f7-b65a-e7f142e437b1" path="/var/lib/kubelet/pods/4e968ee6-e711-40f7-b65a-e7f142e437b1/volumes" Jun 11 23:42:51.962134 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:51.962092 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49"] Jun 11 23:42:51.962551 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:51.962297 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" podUID="5bcd0d2a-5908-4022-bbd8-a584d05cb386" containerName="manager" containerID="cri-o://2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92" gracePeriod=10 Jun 11 23:42:52.209981 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:52.209958 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:52.321440 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:52.321316 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt2xs\" (UniqueName: \"kubernetes.io/projected/5bcd0d2a-5908-4022-bbd8-a584d05cb386-kube-api-access-tt2xs\") pod \"5bcd0d2a-5908-4022-bbd8-a584d05cb386\" (UID: \"5bcd0d2a-5908-4022-bbd8-a584d05cb386\") " Jun 11 23:42:52.321440 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:52.321383 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bcd0d2a-5908-4022-bbd8-a584d05cb386-extensions-socket-volume\") pod \"5bcd0d2a-5908-4022-bbd8-a584d05cb386\" (UID: \"5bcd0d2a-5908-4022-bbd8-a584d05cb386\") " Jun 11 23:42:52.321823 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:52.321793 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bcd0d2a-5908-4022-bbd8-a584d05cb386-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5bcd0d2a-5908-4022-bbd8-a584d05cb386" (UID: "5bcd0d2a-5908-4022-bbd8-a584d05cb386"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:42:52.323588 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:52.323565 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bcd0d2a-5908-4022-bbd8-a584d05cb386-kube-api-access-tt2xs" (OuterVolumeSpecName: "kube-api-access-tt2xs") pod "5bcd0d2a-5908-4022-bbd8-a584d05cb386" (UID: "5bcd0d2a-5908-4022-bbd8-a584d05cb386"). InnerVolumeSpecName "kube-api-access-tt2xs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:42:52.422464 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:52.422397 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt2xs\" (UniqueName: \"kubernetes.io/projected/5bcd0d2a-5908-4022-bbd8-a584d05cb386-kube-api-access-tt2xs\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:42:52.422464 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:52.422458 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bcd0d2a-5908-4022-bbd8-a584d05cb386-extensions-socket-volume\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:42:53.000621 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:53.000528 2558 generic.go:356] "Generic (PLEG): container finished" podID="5bcd0d2a-5908-4022-bbd8-a584d05cb386" containerID="2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92" exitCode=0 Jun 11 23:42:53.000621 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:53.000574 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" Jun 11 23:42:53.001061 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:53.000576 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" event={"ID":"5bcd0d2a-5908-4022-bbd8-a584d05cb386","Type":"ContainerDied","Data":"2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92"} Jun 11 23:42:53.001061 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:53.000712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49" event={"ID":"5bcd0d2a-5908-4022-bbd8-a584d05cb386","Type":"ContainerDied","Data":"35e27dea520333545b56e4a3d3ce482b2a07bcc99e0d26c5780d71c5c7ea5007"} Jun 11 23:42:53.001061 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:53.000741 2558 scope.go:117] "RemoveContainer" containerID="2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92" Jun 11 23:42:53.009325 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:53.009299 2558 scope.go:117] "RemoveContainer" containerID="2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92" Jun 11 23:42:53.009654 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:42:53.009636 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92\": container with ID starting with 2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92 not found: ID does not exist" containerID="2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92" Jun 11 23:42:53.009725 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:53.009663 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92"} err="failed to get container status \"2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92\": rpc error: code = NotFound desc = could not find container \"2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92\": container with ID starting with 2c3d2478c2c65f879a92a079a193ef607c982292a32e390685b3a65247b40a92 not found: ID does not exist" Jun 11 23:42:53.019705 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:53.019678 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49"] Jun 11 23:42:53.021733 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:53.021711 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gsv49"] Jun 11 23:42:54.699773 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:54.699742 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bcd0d2a-5908-4022-bbd8-a584d05cb386" path="/var/lib/kubelet/pods/5bcd0d2a-5908-4022-bbd8-a584d05cb386/volumes" Jun 11 23:42:56.575077 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:56.575031 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:56.626484 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:56.626454 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:57.177655 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:57.177619 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:42:57.277166 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:42:57.277132 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:01.975486 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:01.975453 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:02.075504 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:02.075472 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:03.850848 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:03.850799 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:03.959520 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:03.959486 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:08.323620 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.323574 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t"] Jun 11 23:43:08.323976 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.323858 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bcd0d2a-5908-4022-bbd8-a584d05cb386" containerName="manager" Jun 11 23:43:08.323976 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.323869 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bcd0d2a-5908-4022-bbd8-a584d05cb386" containerName="manager" Jun 11 23:43:08.323976 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.323929 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bcd0d2a-5908-4022-bbd8-a584d05cb386" containerName="manager" Jun 11 23:43:08.342251 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.342223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.345171 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.345152 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8xvnp\"" Jun 11 23:43:08.363890 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.363862 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t"] Jun 11 23:43:08.382928 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.382896 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:08.462369 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.462331 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40a48b03-0390-403c-b6a9-8c28da67faff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.462369 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.462370 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.462584 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.462392 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.462584 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.462437 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.462584 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.462467 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.462584 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.462532 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40a48b03-0390-403c-b6a9-8c28da67faff-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.462584 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.462561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkcww\" (UniqueName: \"kubernetes.io/projected/40a48b03-0390-403c-b6a9-8c28da67faff-kube-api-access-dkcww\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.462768 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.462605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.462768 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.462640 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40a48b03-0390-403c-b6a9-8c28da67faff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.469586 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.469558 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:08.563785 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.563751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.563958 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.563790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.563958 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.563836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.563958 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.563859 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40a48b03-0390-403c-b6a9-8c28da67faff-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.563958 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.563879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkcww\" (UniqueName: \"kubernetes.io/projected/40a48b03-0390-403c-b6a9-8c28da67faff-kube-api-access-dkcww\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.563958 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.563930 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.564179 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.563969 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40a48b03-0390-403c-b6a9-8c28da67faff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.564179 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.564034 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40a48b03-0390-403c-b6a9-8c28da67faff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.564179 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.564063 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.564325 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.564202 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.564437 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.564397 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.564493 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.564457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.564587 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.564572 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.564764 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.564745 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40a48b03-0390-403c-b6a9-8c28da67faff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.566518 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.566500 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40a48b03-0390-403c-b6a9-8c28da67faff-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.566801 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.566784 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40a48b03-0390-403c-b6a9-8c28da67faff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.573020 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.572991 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40a48b03-0390-403c-b6a9-8c28da67faff-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.573227 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.573199 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkcww\" (UniqueName: \"kubernetes.io/projected/40a48b03-0390-403c-b6a9-8c28da67faff-kube-api-access-dkcww\") pod \"maas-default-gateway-openshift-default-8559cd5744-5tr7t\" (UID: \"40a48b03-0390-403c-b6a9-8c28da67faff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.652121 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.652092 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:08.805833 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.805804 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t"] Jun 11 23:43:08.807770 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:43:08.807737 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a48b03_0390_403c_b6a9_8c28da67faff.slice/crio-f39d760459689acf04283148c23f709d1dfdcafdba174fdd5e879d7e33947353 WatchSource:0}: Error finding container f39d760459689acf04283148c23f709d1dfdcafdba174fdd5e879d7e33947353: Status 404 returned error can't find the container with id f39d760459689acf04283148c23f709d1dfdcafdba174fdd5e879d7e33947353 Jun 11 23:43:08.809821 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.809782 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:43:08.809895 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.809870 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:43:08.809932 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:08.809908 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:43:09.070105 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:09.070023 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" event={"ID":"40a48b03-0390-403c-b6a9-8c28da67faff","Type":"ContainerStarted","Data":"ee9095f1f31f48e15e4da85815d7d8be5b9e1a598eec6382d5d0b8789771ad2b"} Jun 11 23:43:09.070105 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:09.070073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" event={"ID":"40a48b03-0390-403c-b6a9-8c28da67faff","Type":"ContainerStarted","Data":"f39d760459689acf04283148c23f709d1dfdcafdba174fdd5e879d7e33947353"} Jun 11 23:43:09.088709 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:09.088647 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" podStartSLOduration=1.088631216 podStartE2EDuration="1.088631216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:09.087030973 +0000 UTC m=+652.809566854" watchObservedRunningTime="2026-06-11 23:43:09.088631216 +0000 UTC m=+652.811167149" Jun 11 23:43:09.652604 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:09.652566 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:09.657066 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:09.657042 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:10.073898 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.073808 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:10.074868 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.074846 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:10.075702 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.075684 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:43:10.085167 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.085140 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d2d7q"] Jun 11 23:43:10.109205 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.109162 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d2d7q"] Jun 11 23:43:10.109375 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.109314 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:10.111883 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.111856 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 23:43:10.178333 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.178281 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7658l\" (UniqueName: \"kubernetes.io/projected/b04c2d86-c3b7-43ec-82ff-4de26592c23f-kube-api-access-7658l\") pod \"limitador-limitador-64c94fd64f-d2d7q\" (UID: \"b04c2d86-c3b7-43ec-82ff-4de26592c23f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:10.178565 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.178449 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b04c2d86-c3b7-43ec-82ff-4de26592c23f-config-file\") pod \"limitador-limitador-64c94fd64f-d2d7q\" (UID: \"b04c2d86-c3b7-43ec-82ff-4de26592c23f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:10.179931 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.179910 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d2d7q"] Jun 11 23:43:10.184152 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.184129 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:10.279619 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.279583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b04c2d86-c3b7-43ec-82ff-4de26592c23f-config-file\") pod \"limitador-limitador-64c94fd64f-d2d7q\" (UID: \"b04c2d86-c3b7-43ec-82ff-4de26592c23f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:10.279824 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.279645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7658l\" (UniqueName: \"kubernetes.io/projected/b04c2d86-c3b7-43ec-82ff-4de26592c23f-kube-api-access-7658l\") pod \"limitador-limitador-64c94fd64f-d2d7q\" (UID: \"b04c2d86-c3b7-43ec-82ff-4de26592c23f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:10.280837 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.280811 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b04c2d86-c3b7-43ec-82ff-4de26592c23f-config-file\") pod \"limitador-limitador-64c94fd64f-d2d7q\" (UID: \"b04c2d86-c3b7-43ec-82ff-4de26592c23f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:10.285339 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.285300 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:10.288127 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.288095 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7658l\" (UniqueName: \"kubernetes.io/projected/b04c2d86-c3b7-43ec-82ff-4de26592c23f-kube-api-access-7658l\") pod \"limitador-limitador-64c94fd64f-d2d7q\" (UID: \"b04c2d86-c3b7-43ec-82ff-4de26592c23f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:10.420956 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.420920 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:10.565407 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.565297 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d2d7q"] Jun 11 23:43:10.567445 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:43:10.567394 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04c2d86_c3b7_43ec_82ff_4de26592c23f.slice/crio-e74500a9de1743d1e2efdbf8cbf4feae53cfd65c6715284afd4e2120c0c0872d WatchSource:0}: Error finding container e74500a9de1743d1e2efdbf8cbf4feae53cfd65c6715284afd4e2120c0c0872d: Status 404 returned error can't find the container with id e74500a9de1743d1e2efdbf8cbf4feae53cfd65c6715284afd4e2120c0c0872d Jun 11 23:43:10.890976 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.890940 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-grmnz"] Jun 11 23:43:10.937898 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.937861 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:10.971579 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.971545 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-grmnz"] Jun 11 23:43:10.971734 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.971644 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-grmnz" Jun 11 23:43:10.973984 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.973969 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hvqtb\"" Jun 11 23:43:10.986248 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.986217 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjjx5\" (UniqueName: \"kubernetes.io/projected/d0c8e118-ad2c-432f-b7d4-bf308e689984-kube-api-access-qjjx5\") pod \"authorino-58cd955675-grmnz\" (UID: \"d0c8e118-ad2c-432f-b7d4-bf308e689984\") " pod="kuadrant-system/authorino-58cd955675-grmnz" Jun 11 23:43:10.995411 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:10.995373 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:11.080493 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.080462 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" event={"ID":"b04c2d86-c3b7-43ec-82ff-4de26592c23f","Type":"ContainerStarted","Data":"e74500a9de1743d1e2efdbf8cbf4feae53cfd65c6715284afd4e2120c0c0872d"} Jun 11 23:43:11.087139 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.087118 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjx5\" (UniqueName: \"kubernetes.io/projected/d0c8e118-ad2c-432f-b7d4-bf308e689984-kube-api-access-qjjx5\") pod \"authorino-58cd955675-grmnz\" (UID: \"d0c8e118-ad2c-432f-b7d4-bf308e689984\") " pod="kuadrant-system/authorino-58cd955675-grmnz" Jun 11 23:43:11.096994 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.096973 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjjx5\" (UniqueName: \"kubernetes.io/projected/d0c8e118-ad2c-432f-b7d4-bf308e689984-kube-api-access-qjjx5\") pod \"authorino-58cd955675-grmnz\" (UID: \"d0c8e118-ad2c-432f-b7d4-bf308e689984\") " pod="kuadrant-system/authorino-58cd955675-grmnz" Jun 11 23:43:11.231902 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.231824 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-n97ns"] Jun 11 23:43:11.246585 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.246551 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n97ns"] Jun 11 23:43:11.246746 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.246643 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n97ns" Jun 11 23:43:11.281440 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.281392 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-grmnz" Jun 11 23:43:11.288928 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.288892 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2g7t\" (UniqueName: \"kubernetes.io/projected/2b2a60d7-ec1e-40d3-930c-2d8426213c51-kube-api-access-r2g7t\") pod \"authorino-75d556bd77-n97ns\" (UID: \"2b2a60d7-ec1e-40d3-930c-2d8426213c51\") " pod="kuadrant-system/authorino-75d556bd77-n97ns" Jun 11 23:43:11.390457 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.389966 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2g7t\" (UniqueName: \"kubernetes.io/projected/2b2a60d7-ec1e-40d3-930c-2d8426213c51-kube-api-access-r2g7t\") pod \"authorino-75d556bd77-n97ns\" (UID: \"2b2a60d7-ec1e-40d3-930c-2d8426213c51\") " pod="kuadrant-system/authorino-75d556bd77-n97ns" Jun 11 23:43:11.399385 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.399357 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2g7t\" (UniqueName: \"kubernetes.io/projected/2b2a60d7-ec1e-40d3-930c-2d8426213c51-kube-api-access-r2g7t\") pod \"authorino-75d556bd77-n97ns\" (UID: \"2b2a60d7-ec1e-40d3-930c-2d8426213c51\") " pod="kuadrant-system/authorino-75d556bd77-n97ns" Jun 11 23:43:11.461534 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.461220 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-grmnz"] Jun 11 23:43:11.464857 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:43:11.464822 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0c8e118_ad2c_432f_b7d4_bf308e689984.slice/crio-c98c6bf2510875ef81780a7b0cbc8a0556100d53513923eb40930fcb84b4410d WatchSource:0}: Error finding container c98c6bf2510875ef81780a7b0cbc8a0556100d53513923eb40930fcb84b4410d: Status 404 returned error can't find the container with id c98c6bf2510875ef81780a7b0cbc8a0556100d53513923eb40930fcb84b4410d Jun 11 23:43:11.557612 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.557529 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n97ns" Jun 11 23:43:11.744297 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:11.744274 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n97ns"] Jun 11 23:43:11.747178 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:43:11.747142 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b2a60d7_ec1e_40d3_930c_2d8426213c51.slice/crio-81ad822a6694e7aea295be8f547c7264df83bf0bac2f95e74d5baa130c6d8bea WatchSource:0}: Error finding container 81ad822a6694e7aea295be8f547c7264df83bf0bac2f95e74d5baa130c6d8bea: Status 404 returned error can't find the container with id 81ad822a6694e7aea295be8f547c7264df83bf0bac2f95e74d5baa130c6d8bea Jun 11 23:43:12.086079 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:12.086043 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-grmnz" event={"ID":"d0c8e118-ad2c-432f-b7d4-bf308e689984","Type":"ContainerStarted","Data":"c98c6bf2510875ef81780a7b0cbc8a0556100d53513923eb40930fcb84b4410d"} Jun 11 23:43:12.087207 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:12.087185 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n97ns" event={"ID":"2b2a60d7-ec1e-40d3-930c-2d8426213c51","Type":"ContainerStarted","Data":"81ad822a6694e7aea295be8f547c7264df83bf0bac2f95e74d5baa130c6d8bea"} Jun 11 23:43:18.122099 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:18.122055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" event={"ID":"b04c2d86-c3b7-43ec-82ff-4de26592c23f","Type":"ContainerStarted","Data":"7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc"} Jun 11 23:43:18.122628 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:18.122154 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:18.123518 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:18.123494 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-grmnz" event={"ID":"d0c8e118-ad2c-432f-b7d4-bf308e689984","Type":"ContainerStarted","Data":"228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5"} Jun 11 23:43:18.124913 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:18.124891 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n97ns" event={"ID":"2b2a60d7-ec1e-40d3-930c-2d8426213c51","Type":"ContainerStarted","Data":"a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc"} Jun 11 23:43:18.139015 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:18.138954 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" podStartSLOduration=1.473350215 podStartE2EDuration="8.138939104s" totalImagesPullingTime="6.665588889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:18.137649333 +0000 UTC m=+661.860185194" watchObservedRunningTime="2026-06-11 23:43:18.138939104 +0000 UTC m=+661.861474965" Jun 11 23:43:18.153963 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:18.153910 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-n97ns" podStartSLOduration=1.448211608 podStartE2EDuration="7.153892313s" totalImagesPullingTime="5.705680705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:18.152437013 +0000 UTC m=+661.874972868" watchObservedRunningTime="2026-06-11 23:43:18.153892313 +0000 UTC m=+661.876428176" Jun 11 23:43:18.167945 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:18.167891 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-grmnz" podStartSLOduration=2.170511796 podStartE2EDuration="8.167879183s" totalImagesPullingTime="5.997367387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:18.165885415 +0000 UTC m=+661.888421290" watchObservedRunningTime="2026-06-11 23:43:18.167879183 +0000 UTC m=+661.890415044" Jun 11 23:43:18.193464 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:18.193403 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-grmnz"] Jun 11 23:43:20.132564 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:20.132529 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-grmnz" podUID="d0c8e118-ad2c-432f-b7d4-bf308e689984" containerName="authorino" containerID="cri-o://228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5" gracePeriod=30 Jun 11 23:43:20.401776 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:20.401753 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-grmnz" Jun 11 23:43:20.475005 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:20.474971 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjjx5\" (UniqueName: \"kubernetes.io/projected/d0c8e118-ad2c-432f-b7d4-bf308e689984-kube-api-access-qjjx5\") pod \"d0c8e118-ad2c-432f-b7d4-bf308e689984\" (UID: \"d0c8e118-ad2c-432f-b7d4-bf308e689984\") " Jun 11 23:43:20.477249 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:20.477216 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0c8e118-ad2c-432f-b7d4-bf308e689984-kube-api-access-qjjx5" (OuterVolumeSpecName: "kube-api-access-qjjx5") pod "d0c8e118-ad2c-432f-b7d4-bf308e689984" (UID: "d0c8e118-ad2c-432f-b7d4-bf308e689984"). InnerVolumeSpecName "kube-api-access-qjjx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:43:20.576280 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:20.576245 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjjx5\" (UniqueName: \"kubernetes.io/projected/d0c8e118-ad2c-432f-b7d4-bf308e689984-kube-api-access-qjjx5\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:43:21.137514 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:21.137475 2558 generic.go:356] "Generic (PLEG): container finished" podID="d0c8e118-ad2c-432f-b7d4-bf308e689984" containerID="228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5" exitCode=0 Jun 11 23:43:21.137514 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:21.137513 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-grmnz" Jun 11 23:43:21.137956 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:21.137561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-grmnz" event={"ID":"d0c8e118-ad2c-432f-b7d4-bf308e689984","Type":"ContainerDied","Data":"228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5"} Jun 11 23:43:21.137956 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:21.137601 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-grmnz" event={"ID":"d0c8e118-ad2c-432f-b7d4-bf308e689984","Type":"ContainerDied","Data":"c98c6bf2510875ef81780a7b0cbc8a0556100d53513923eb40930fcb84b4410d"} Jun 11 23:43:21.137956 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:21.137618 2558 scope.go:117] "RemoveContainer" containerID="228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5" Jun 11 23:43:21.145856 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:21.145837 2558 scope.go:117] "RemoveContainer" containerID="228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5" Jun 11 23:43:21.146142 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:43:21.146125 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5\": container with ID starting with 228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5 not found: ID does not exist" containerID="228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5" Jun 11 23:43:21.146200 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:21.146151 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5"} err="failed to get container status \"228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5\": rpc error: code = NotFound desc = could not find container \"228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5\": container with ID starting with 228f28dbcfe533101676e2793796af1bb03f851a182d48834715c1e70ddac2b5 not found: ID does not exist" Jun 11 23:43:21.156171 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:21.156139 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-grmnz"] Jun 11 23:43:21.159733 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:21.159712 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-grmnz"] Jun 11 23:43:22.700257 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:22.700219 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0c8e118-ad2c-432f-b7d4-bf308e689984" path="/var/lib/kubelet/pods/d0c8e118-ad2c-432f-b7d4-bf308e689984/volumes" Jun 11 23:43:24.927165 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:24.927126 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d2d7q"] Jun 11 23:43:24.927635 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:24.927300 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" podUID="b04c2d86-c3b7-43ec-82ff-4de26592c23f" containerName="limitador" containerID="cri-o://7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc" gracePeriod=30 Jun 11 23:43:24.929384 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:24.929358 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:25.484880 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:25.484855 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:25.517539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:25.517464 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b04c2d86-c3b7-43ec-82ff-4de26592c23f-config-file\") pod \"b04c2d86-c3b7-43ec-82ff-4de26592c23f\" (UID: \"b04c2d86-c3b7-43ec-82ff-4de26592c23f\") " Jun 11 23:43:25.517539 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:25.517523 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7658l\" (UniqueName: \"kubernetes.io/projected/b04c2d86-c3b7-43ec-82ff-4de26592c23f-kube-api-access-7658l\") pod \"b04c2d86-c3b7-43ec-82ff-4de26592c23f\" (UID: \"b04c2d86-c3b7-43ec-82ff-4de26592c23f\") " Jun 11 23:43:25.517927 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:25.517899 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b04c2d86-c3b7-43ec-82ff-4de26592c23f-config-file" (OuterVolumeSpecName: "config-file") pod "b04c2d86-c3b7-43ec-82ff-4de26592c23f" (UID: "b04c2d86-c3b7-43ec-82ff-4de26592c23f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:43:25.519774 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:25.519754 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b04c2d86-c3b7-43ec-82ff-4de26592c23f-kube-api-access-7658l" (OuterVolumeSpecName: "kube-api-access-7658l") pod "b04c2d86-c3b7-43ec-82ff-4de26592c23f" (UID: "b04c2d86-c3b7-43ec-82ff-4de26592c23f"). InnerVolumeSpecName "kube-api-access-7658l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:43:25.618177 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:25.618139 2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b04c2d86-c3b7-43ec-82ff-4de26592c23f-config-file\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:43:25.618177 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:25.618173 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7658l\" (UniqueName: \"kubernetes.io/projected/b04c2d86-c3b7-43ec-82ff-4de26592c23f-kube-api-access-7658l\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:43:26.162171 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.162137 2558 generic.go:356] "Generic (PLEG): container finished" podID="b04c2d86-c3b7-43ec-82ff-4de26592c23f" containerID="7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc" exitCode=0 Jun 11 23:43:26.162600 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.162186 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" Jun 11 23:43:26.162600 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.162223 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" event={"ID":"b04c2d86-c3b7-43ec-82ff-4de26592c23f","Type":"ContainerDied","Data":"7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc"} Jun 11 23:43:26.162600 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.162272 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d2d7q" event={"ID":"b04c2d86-c3b7-43ec-82ff-4de26592c23f","Type":"ContainerDied","Data":"e74500a9de1743d1e2efdbf8cbf4feae53cfd65c6715284afd4e2120c0c0872d"} Jun 11 23:43:26.162600 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.162294 2558 scope.go:117] "RemoveContainer" containerID="7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc" Jun 11 23:43:26.170486 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.170467 2558 scope.go:117] "RemoveContainer" containerID="7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc" Jun 11 23:43:26.170741 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:43:26.170723 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc\": container with ID starting with 7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc not found: ID does not exist" containerID="7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc" Jun 11 23:43:26.170781 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.170750 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc"} err="failed to get container status \"7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc\": rpc error: code = NotFound desc = could not find container \"7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc\": container with ID starting with 7c384619b4d37deb0af260b60e7ebc92bd8f42e2de27e13856c5f81d75f6ebdc not found: ID does not exist" Jun 11 23:43:26.181958 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.181898 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d2d7q"] Jun 11 23:43:26.184358 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.184334 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d2d7q"] Jun 11 23:43:26.498069 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.497987 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-t5xvx"] Jun 11 23:43:26.498289 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.498274 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0c8e118-ad2c-432f-b7d4-bf308e689984" containerName="authorino" Jun 11 23:43:26.498289 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.498289 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0c8e118-ad2c-432f-b7d4-bf308e689984" containerName="authorino" Jun 11 23:43:26.498439 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.498311 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04c2d86-c3b7-43ec-82ff-4de26592c23f" containerName="limitador" Jun 11 23:43:26.498439 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.498316 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04c2d86-c3b7-43ec-82ff-4de26592c23f" containerName="limitador" Jun 11 23:43:26.498439 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.498365 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04c2d86-c3b7-43ec-82ff-4de26592c23f" containerName="limitador" Jun 11 23:43:26.498439 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.498373 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0c8e118-ad2c-432f-b7d4-bf308e689984" containerName="authorino" Jun 11 23:43:26.500672 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.500653 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-t5xvx" Jun 11 23:43:26.503059 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.503042 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 23:43:26.511666 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.511644 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-t5xvx"] Jun 11 23:43:26.538439 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.538374 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:26.626006 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.625968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7xr\" (UniqueName: \"kubernetes.io/projected/8d08a47a-bd87-447b-bd5e-0d1fae56fffc-kube-api-access-jj7xr\") pod \"postgres-69fb4594cf-t5xvx\" (UID: \"8d08a47a-bd87-447b-bd5e-0d1fae56fffc\") " pod="opendatahub/postgres-69fb4594cf-t5xvx" Jun 11 23:43:26.626184 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.626097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8d08a47a-bd87-447b-bd5e-0d1fae56fffc-data\") pod \"postgres-69fb4594cf-t5xvx\" (UID: \"8d08a47a-bd87-447b-bd5e-0d1fae56fffc\") " pod="opendatahub/postgres-69fb4594cf-t5xvx" Jun 11 23:43:26.704555 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.704514 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b04c2d86-c3b7-43ec-82ff-4de26592c23f" path="/var/lib/kubelet/pods/b04c2d86-c3b7-43ec-82ff-4de26592c23f/volumes" Jun 11 23:43:26.727266 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.727233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7xr\" (UniqueName: \"kubernetes.io/projected/8d08a47a-bd87-447b-bd5e-0d1fae56fffc-kube-api-access-jj7xr\") pod \"postgres-69fb4594cf-t5xvx\" (UID: \"8d08a47a-bd87-447b-bd5e-0d1fae56fffc\") " pod="opendatahub/postgres-69fb4594cf-t5xvx" Jun 11 23:43:26.727478 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.727302 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8d08a47a-bd87-447b-bd5e-0d1fae56fffc-data\") pod \"postgres-69fb4594cf-t5xvx\" (UID: \"8d08a47a-bd87-447b-bd5e-0d1fae56fffc\") " pod="opendatahub/postgres-69fb4594cf-t5xvx" Jun 11 23:43:26.727643 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.727624 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8d08a47a-bd87-447b-bd5e-0d1fae56fffc-data\") pod \"postgres-69fb4594cf-t5xvx\" (UID: \"8d08a47a-bd87-447b-bd5e-0d1fae56fffc\") " pod="opendatahub/postgres-69fb4594cf-t5xvx" Jun 11 23:43:26.735937 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.735915 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7xr\" (UniqueName: \"kubernetes.io/projected/8d08a47a-bd87-447b-bd5e-0d1fae56fffc-kube-api-access-jj7xr\") pod \"postgres-69fb4594cf-t5xvx\" (UID: \"8d08a47a-bd87-447b-bd5e-0d1fae56fffc\") " pod="opendatahub/postgres-69fb4594cf-t5xvx" Jun 11 23:43:26.811794 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.811703 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-t5xvx" Jun 11 23:43:26.943280 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:26.943253 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-t5xvx"] Jun 11 23:43:26.945724 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:43:26.945694 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d08a47a_bd87_447b_bd5e_0d1fae56fffc.slice/crio-190f8350cebd60e31c31f2cf03bfc14276fdd0167bf4b9973890b9a030c55668 WatchSource:0}: Error finding container 190f8350cebd60e31c31f2cf03bfc14276fdd0167bf4b9973890b9a030c55668: Status 404 returned error can't find the container with id 190f8350cebd60e31c31f2cf03bfc14276fdd0167bf4b9973890b9a030c55668 Jun 11 23:43:27.167717 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:27.167682 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-t5xvx" event={"ID":"8d08a47a-bd87-447b-bd5e-0d1fae56fffc","Type":"ContainerStarted","Data":"190f8350cebd60e31c31f2cf03bfc14276fdd0167bf4b9973890b9a030c55668"} Jun 11 23:43:30.181280 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:30.181245 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-t5xvx" event={"ID":"8d08a47a-bd87-447b-bd5e-0d1fae56fffc","Type":"ContainerStarted","Data":"9611a686b9ebe942dafdfeb1a914f24ff870d85bb1199acd30a06a23c2174f6e"} Jun 11 23:43:30.181681 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:30.181370 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-t5xvx" Jun 11 23:43:30.196046 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:30.195996 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-t5xvx" podStartSLOduration=2.014529585 podStartE2EDuration="4.195978412s" totalImagesPullingTime="2.181448827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:30.195370042 +0000 UTC m=+673.917905927" watchObservedRunningTime="2026-06-11 23:43:30.195978412 +0000 UTC m=+673.918514275" Jun 11 23:43:36.219237 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:36.219205 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-t5xvx" Jun 11 23:43:36.550562 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:36.550465 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:36.642096 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:36.642057 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:36.855676 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:36.855638 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:43:45.183938 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.183901 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-jcvpl"] Jun 11 23:43:45.200562 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.200527 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-jcvpl"] Jun 11 23:43:45.200736 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.200664 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-jcvpl" Jun 11 23:43:45.203305 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.203283 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 23:43:45.203449 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.203358 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 23:43:45.204236 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.204221 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-zcbd6\"" Jun 11 23:43:45.294584 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.294538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr27m\" (UniqueName: \"kubernetes.io/projected/a70e61a9-5fbf-4f2a-9a42-b572a6e5ae94-kube-api-access-zr27m\") pod \"keycloak-operator-d67dbbb48-jcvpl\" (UID: \"a70e61a9-5fbf-4f2a-9a42-b572a6e5ae94\") " pod="keycloak-system/keycloak-operator-d67dbbb48-jcvpl" Jun 11 23:43:45.395654 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.395615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr27m\" (UniqueName: \"kubernetes.io/projected/a70e61a9-5fbf-4f2a-9a42-b572a6e5ae94-kube-api-access-zr27m\") pod \"keycloak-operator-d67dbbb48-jcvpl\" (UID: \"a70e61a9-5fbf-4f2a-9a42-b572a6e5ae94\") " pod="keycloak-system/keycloak-operator-d67dbbb48-jcvpl" Jun 11 23:43:45.409862 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.409833 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr27m\" (UniqueName: \"kubernetes.io/projected/a70e61a9-5fbf-4f2a-9a42-b572a6e5ae94-kube-api-access-zr27m\") pod \"keycloak-operator-d67dbbb48-jcvpl\" (UID: \"a70e61a9-5fbf-4f2a-9a42-b572a6e5ae94\") " pod="keycloak-system/keycloak-operator-d67dbbb48-jcvpl" Jun 11 23:43:45.511171 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.511090 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-jcvpl" Jun 11 23:43:45.673787 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:45.673761 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-jcvpl"] Jun 11 23:43:45.676493 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:43:45.676465 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70e61a9_5fbf_4f2a_9a42_b572a6e5ae94.slice/crio-3d31643b89ed6b4767c84dc2d0f096d6aa7901e3e2a38ceaa37c6dfe50440df8 WatchSource:0}: Error finding container 3d31643b89ed6b4767c84dc2d0f096d6aa7901e3e2a38ceaa37c6dfe50440df8: Status 404 returned error can't find the container with id 3d31643b89ed6b4767c84dc2d0f096d6aa7901e3e2a38ceaa37c6dfe50440df8 Jun 11 23:43:46.250115 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:46.250079 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-jcvpl" event={"ID":"a70e61a9-5fbf-4f2a-9a42-b572a6e5ae94","Type":"ContainerStarted","Data":"3d31643b89ed6b4767c84dc2d0f096d6aa7901e3e2a38ceaa37c6dfe50440df8"} Jun 11 23:43:52.284674 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:52.284642 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-jcvpl" event={"ID":"a70e61a9-5fbf-4f2a-9a42-b572a6e5ae94","Type":"ContainerStarted","Data":"44ad674b79e02b2af5c6af20bea5cf181a18e107cbe2f0d67def4d898e744ddd"} Jun 11 23:43:52.300511 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:43:52.300456 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-jcvpl" podStartSLOduration=1.690057232 podStartE2EDuration="7.300411931s" totalImagesPullingTime="5.610354699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:52.299837143 +0000 UTC m=+696.022373006" watchObservedRunningTime="2026-06-11 23:43:52.300411931 +0000 UTC m=+696.022947793" Jun 11 23:44:00.280473 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:00.280435 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:00.377343 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:00.377308 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:04.726726 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:04.726696 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:25.099130 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:25.099093 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:29.789809 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:29.789771 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:30.024778 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.024743 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87m8v"] Jun 11 23:44:30.027038 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.027020 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87m8v" Jun 11 23:44:30.034881 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.034857 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87m8v"] Jun 11 23:44:30.153763 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.153728 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:30.185926 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.185889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk99t\" (UniqueName: \"kubernetes.io/projected/b594deed-4b0b-4259-ad31-4c80c3e70591-kube-api-access-lk99t\") pod \"authorino-5d4b67c446-87m8v\" (UID: \"b594deed-4b0b-4259-ad31-4c80c3e70591\") " pod="kuadrant-system/authorino-5d4b67c446-87m8v" Jun 11 23:44:30.239346 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.239316 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87m8v"] Jun 11 23:44:30.239598 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:44:30.239579 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lk99t], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-87m8v" podUID="b594deed-4b0b-4259-ad31-4c80c3e70591" Jun 11 23:44:30.262899 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.262846 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c4bcf49b9-5st6h"] Jun 11 23:44:30.265076 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.265061 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4bcf49b9-5st6h" Jun 11 23:44:30.273322 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.273287 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c4bcf49b9-5st6h"] Jun 11 23:44:30.286601 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.286562 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk99t\" (UniqueName: \"kubernetes.io/projected/b594deed-4b0b-4259-ad31-4c80c3e70591-kube-api-access-lk99t\") pod \"authorino-5d4b67c446-87m8v\" (UID: \"b594deed-4b0b-4259-ad31-4c80c3e70591\") " pod="kuadrant-system/authorino-5d4b67c446-87m8v" Jun 11 23:44:30.295513 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.295482 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk99t\" (UniqueName: \"kubernetes.io/projected/b594deed-4b0b-4259-ad31-4c80c3e70591-kube-api-access-lk99t\") pod \"authorino-5d4b67c446-87m8v\" (UID: \"b594deed-4b0b-4259-ad31-4c80c3e70591\") " pod="kuadrant-system/authorino-5d4b67c446-87m8v" Jun 11 23:44:30.387953 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.387903 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j568q\" (UniqueName: \"kubernetes.io/projected/52df60f1-b4b1-4c3b-bf06-8b838692c2e8-kube-api-access-j568q\") pod \"authorino-6c4bcf49b9-5st6h\" (UID: \"52df60f1-b4b1-4c3b-bf06-8b838692c2e8\") " pod="kuadrant-system/authorino-6c4bcf49b9-5st6h" Jun 11 23:44:30.445855 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.445772 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c4bcf49b9-5st6h"] Jun 11 23:44:30.446037 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:44:30.446020 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-j568q], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6c4bcf49b9-5st6h" podUID="52df60f1-b4b1-4c3b-bf06-8b838692c2e8" Jun 11 23:44:30.451363 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.451339 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87m8v" Jun 11 23:44:30.451501 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.451339 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4bcf49b9-5st6h" Jun 11 23:44:30.457771 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.457744 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87m8v" Jun 11 23:44:30.460542 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.460525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4bcf49b9-5st6h" Jun 11 23:44:30.476342 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.474281 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bb7478c7c-zmkrk"] Jun 11 23:44:30.477674 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.477652 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" Jun 11 23:44:30.480155 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.480131 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 23:44:30.484715 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.484680 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bb7478c7c-zmkrk"] Jun 11 23:44:30.488594 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.488573 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j568q\" (UniqueName: \"kubernetes.io/projected/52df60f1-b4b1-4c3b-bf06-8b838692c2e8-kube-api-access-j568q\") pod \"authorino-6c4bcf49b9-5st6h\" (UID: \"52df60f1-b4b1-4c3b-bf06-8b838692c2e8\") " pod="kuadrant-system/authorino-6c4bcf49b9-5st6h" Jun 11 23:44:30.497189 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.497170 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j568q\" (UniqueName: \"kubernetes.io/projected/52df60f1-b4b1-4c3b-bf06-8b838692c2e8-kube-api-access-j568q\") pod \"authorino-6c4bcf49b9-5st6h\" (UID: \"52df60f1-b4b1-4c3b-bf06-8b838692c2e8\") " pod="kuadrant-system/authorino-6c4bcf49b9-5st6h" Jun 11 23:44:30.588944 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.588893 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j568q\" (UniqueName: \"kubernetes.io/projected/52df60f1-b4b1-4c3b-bf06-8b838692c2e8-kube-api-access-j568q\") pod \"52df60f1-b4b1-4c3b-bf06-8b838692c2e8\" (UID: \"52df60f1-b4b1-4c3b-bf06-8b838692c2e8\") " Jun 11 23:44:30.589132 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.589039 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk99t\" (UniqueName: \"kubernetes.io/projected/b594deed-4b0b-4259-ad31-4c80c3e70591-kube-api-access-lk99t\") pod \"b594deed-4b0b-4259-ad31-4c80c3e70591\" (UID: \"b594deed-4b0b-4259-ad31-4c80c3e70591\") " Jun 11 23:44:30.589179 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.589151 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6eab3f4-f749-436a-b376-a4deb461a0bd-tls-cert\") pod \"authorino-7bb7478c7c-zmkrk\" (UID: \"d6eab3f4-f749-436a-b376-a4deb461a0bd\") " pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" Jun 11 23:44:30.589222 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.589187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4ffk\" (UniqueName: \"kubernetes.io/projected/d6eab3f4-f749-436a-b376-a4deb461a0bd-kube-api-access-r4ffk\") pod \"authorino-7bb7478c7c-zmkrk\" (UID: \"d6eab3f4-f749-436a-b376-a4deb461a0bd\") " pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" Jun 11 23:44:30.591269 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.591235 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52df60f1-b4b1-4c3b-bf06-8b838692c2e8-kube-api-access-j568q" (OuterVolumeSpecName: "kube-api-access-j568q") pod "52df60f1-b4b1-4c3b-bf06-8b838692c2e8" (UID: "52df60f1-b4b1-4c3b-bf06-8b838692c2e8"). InnerVolumeSpecName "kube-api-access-j568q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:44:30.591389 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.591267 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b594deed-4b0b-4259-ad31-4c80c3e70591-kube-api-access-lk99t" (OuterVolumeSpecName: "kube-api-access-lk99t") pod "b594deed-4b0b-4259-ad31-4c80c3e70591" (UID: "b594deed-4b0b-4259-ad31-4c80c3e70591"). InnerVolumeSpecName "kube-api-access-lk99t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:44:30.690618 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.690573 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6eab3f4-f749-436a-b376-a4deb461a0bd-tls-cert\") pod \"authorino-7bb7478c7c-zmkrk\" (UID: \"d6eab3f4-f749-436a-b376-a4deb461a0bd\") " pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" Jun 11 23:44:30.690618 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.690616 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4ffk\" (UniqueName: \"kubernetes.io/projected/d6eab3f4-f749-436a-b376-a4deb461a0bd-kube-api-access-r4ffk\") pod \"authorino-7bb7478c7c-zmkrk\" (UID: \"d6eab3f4-f749-436a-b376-a4deb461a0bd\") " pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" Jun 11 23:44:30.690816 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.690683 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j568q\" (UniqueName: \"kubernetes.io/projected/52df60f1-b4b1-4c3b-bf06-8b838692c2e8-kube-api-access-j568q\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:44:30.690816 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.690694 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk99t\" (UniqueName: \"kubernetes.io/projected/b594deed-4b0b-4259-ad31-4c80c3e70591-kube-api-access-lk99t\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:44:30.693347 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.693320 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6eab3f4-f749-436a-b376-a4deb461a0bd-tls-cert\") pod \"authorino-7bb7478c7c-zmkrk\" (UID: \"d6eab3f4-f749-436a-b376-a4deb461a0bd\") " pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" Jun 11 23:44:30.703222 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.703158 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4ffk\" (UniqueName: \"kubernetes.io/projected/d6eab3f4-f749-436a-b376-a4deb461a0bd-kube-api-access-r4ffk\") pod \"authorino-7bb7478c7c-zmkrk\" (UID: \"d6eab3f4-f749-436a-b376-a4deb461a0bd\") " pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" Jun 11 23:44:30.788169 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.788126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" Jun 11 23:44:30.914991 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:30.914964 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bb7478c7c-zmkrk"] Jun 11 23:44:30.917112 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:44:30.917088 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6eab3f4_f749_436a_b376_a4deb461a0bd.slice/crio-45bd14ee3e1f861fe38cd7236251c855ab9f4aecb6a50f53e4fd1240bf2c5ad3 WatchSource:0}: Error finding container 45bd14ee3e1f861fe38cd7236251c855ab9f4aecb6a50f53e4fd1240bf2c5ad3: Status 404 returned error can't find the container with id 45bd14ee3e1f861fe38cd7236251c855ab9f4aecb6a50f53e4fd1240bf2c5ad3 Jun 11 23:44:31.456841 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.456806 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" event={"ID":"d6eab3f4-f749-436a-b376-a4deb461a0bd","Type":"ContainerStarted","Data":"638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb"} Jun 11 23:44:31.457000 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.456846 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4bcf49b9-5st6h" Jun 11 23:44:31.457000 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.456850 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" event={"ID":"d6eab3f4-f749-436a-b376-a4deb461a0bd","Type":"ContainerStarted","Data":"45bd14ee3e1f861fe38cd7236251c855ab9f4aecb6a50f53e4fd1240bf2c5ad3"} Jun 11 23:44:31.457076 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.457010 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87m8v" Jun 11 23:44:31.478535 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.478429 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" podStartSLOduration=1.18833088 podStartE2EDuration="1.478397047s" totalImagesPullingTime="290.066167ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:44:31.476474565 +0000 UTC m=+735.199010427" watchObservedRunningTime="2026-06-11 23:44:31.478397047 +0000 UTC m=+735.200932909" Jun 11 23:44:31.501142 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.501114 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87m8v"] Jun 11 23:44:31.507254 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.507227 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n97ns"] Jun 11 23:44:31.507481 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.507455 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-n97ns" podUID="2b2a60d7-ec1e-40d3-930c-2d8426213c51" containerName="authorino" containerID="cri-o://a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc" gracePeriod=30 Jun 11 23:44:31.508804 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.508773 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87m8v"] Jun 11 23:44:31.533080 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.533050 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c4bcf49b9-5st6h"] Jun 11 23:44:31.541855 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.541827 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c4bcf49b9-5st6h"] Jun 11 23:44:31.748479 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.748455 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n97ns" Jun 11 23:44:31.900342 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.900309 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2g7t\" (UniqueName: \"kubernetes.io/projected/2b2a60d7-ec1e-40d3-930c-2d8426213c51-kube-api-access-r2g7t\") pod \"2b2a60d7-ec1e-40d3-930c-2d8426213c51\" (UID: \"2b2a60d7-ec1e-40d3-930c-2d8426213c51\") " Jun 11 23:44:31.902569 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:31.902537 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b2a60d7-ec1e-40d3-930c-2d8426213c51-kube-api-access-r2g7t" (OuterVolumeSpecName: "kube-api-access-r2g7t") pod "2b2a60d7-ec1e-40d3-930c-2d8426213c51" (UID: "2b2a60d7-ec1e-40d3-930c-2d8426213c51"). InnerVolumeSpecName "kube-api-access-r2g7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:44:32.001651 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.001569 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2g7t\" (UniqueName: \"kubernetes.io/projected/2b2a60d7-ec1e-40d3-930c-2d8426213c51-kube-api-access-r2g7t\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:44:32.462197 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.462164 2558 generic.go:356] "Generic (PLEG): container finished" podID="2b2a60d7-ec1e-40d3-930c-2d8426213c51" containerID="a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc" exitCode=0 Jun 11 23:44:32.462360 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.462203 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n97ns" Jun 11 23:44:32.462360 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.462253 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n97ns" event={"ID":"2b2a60d7-ec1e-40d3-930c-2d8426213c51","Type":"ContainerDied","Data":"a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc"} Jun 11 23:44:32.462360 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.462290 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n97ns" event={"ID":"2b2a60d7-ec1e-40d3-930c-2d8426213c51","Type":"ContainerDied","Data":"81ad822a6694e7aea295be8f547c7264df83bf0bac2f95e74d5baa130c6d8bea"} Jun 11 23:44:32.462360 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.462307 2558 scope.go:117] "RemoveContainer" containerID="a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc" Jun 11 23:44:32.471080 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.471061 2558 scope.go:117] "RemoveContainer" containerID="a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc" Jun 11 23:44:32.471346 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:44:32.471321 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc\": container with ID starting with a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc not found: ID does not exist" containerID="a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc" Jun 11 23:44:32.471399 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.471354 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc"} err="failed to get container status \"a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc\": rpc error: code = NotFound desc = could not find container \"a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc\": container with ID starting with a1d846844489e0ef765213ba9806335af237365d06de6a817d4b65a45b1039fc not found: ID does not exist" Jun 11 23:44:32.481980 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.481916 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n97ns"] Jun 11 23:44:32.485664 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.485642 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n97ns"] Jun 11 23:44:32.700181 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.700147 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b2a60d7-ec1e-40d3-930c-2d8426213c51" path="/var/lib/kubelet/pods/2b2a60d7-ec1e-40d3-930c-2d8426213c51/volumes" Jun 11 23:44:32.700499 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.700484 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52df60f1-b4b1-4c3b-bf06-8b838692c2e8" path="/var/lib/kubelet/pods/52df60f1-b4b1-4c3b-bf06-8b838692c2e8/volumes" Jun 11 23:44:32.700682 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:32.700671 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b594deed-4b0b-4259-ad31-4c80c3e70591" path="/var/lib/kubelet/pods/b594deed-4b0b-4259-ad31-4c80c3e70591/volumes" Jun 11 23:44:35.121793 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.121755 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:35.212097 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.212064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:35.212931 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.212911 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c76c569d4-bzb98"] Jun 11 23:44:35.213253 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.213235 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b2a60d7-ec1e-40d3-930c-2d8426213c51" containerName="authorino" Jun 11 23:44:35.213253 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.213252 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b2a60d7-ec1e-40d3-930c-2d8426213c51" containerName="authorino" Jun 11 23:44:35.213400 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.213306 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b2a60d7-ec1e-40d3-930c-2d8426213c51" containerName="authorino" Jun 11 23:44:35.215757 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.215739 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:35.218372 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.218349 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 23:44:35.218372 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.218365 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 23:44:35.218550 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.218399 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lmbdl\"" Jun 11 23:44:35.224365 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.224343 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c76c569d4-bzb98"] Jun 11 23:44:35.288639 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.288608 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:35.330514 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.330478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln8r2\" (UniqueName: \"kubernetes.io/projected/0cdde0cc-d401-412f-8496-39885ed6aad0-kube-api-access-ln8r2\") pod \"maas-controller-6c76c569d4-bzb98\" (UID: \"0cdde0cc-d401-412f-8496-39885ed6aad0\") " pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:35.330670 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.330546 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cdde0cc-d401-412f-8496-39885ed6aad0-webhook-cert\") pod \"maas-controller-6c76c569d4-bzb98\" (UID: \"0cdde0cc-d401-412f-8496-39885ed6aad0\") " pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:35.385701 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.385603 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:35.431963 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.431929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln8r2\" (UniqueName: \"kubernetes.io/projected/0cdde0cc-d401-412f-8496-39885ed6aad0-kube-api-access-ln8r2\") pod \"maas-controller-6c76c569d4-bzb98\" (UID: \"0cdde0cc-d401-412f-8496-39885ed6aad0\") " pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:35.432166 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.432000 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cdde0cc-d401-412f-8496-39885ed6aad0-webhook-cert\") pod \"maas-controller-6c76c569d4-bzb98\" (UID: \"0cdde0cc-d401-412f-8496-39885ed6aad0\") " pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:35.434478 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.434457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cdde0cc-d401-412f-8496-39885ed6aad0-webhook-cert\") pod \"maas-controller-6c76c569d4-bzb98\" (UID: \"0cdde0cc-d401-412f-8496-39885ed6aad0\") " pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:35.440018 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.439997 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln8r2\" (UniqueName: \"kubernetes.io/projected/0cdde0cc-d401-412f-8496-39885ed6aad0-kube-api-access-ln8r2\") pod \"maas-controller-6c76c569d4-bzb98\" (UID: \"0cdde0cc-d401-412f-8496-39885ed6aad0\") " pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:35.527052 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.527015 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:35.658779 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:35.658694 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c76c569d4-bzb98"] Jun 11 23:44:35.661313 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:44:35.661289 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdde0cc_d401_412f_8496_39885ed6aad0.slice/crio-0c4500496a6f54c8c1818e814543acbd09ac8c22257f2e312fba4dba55683921 WatchSource:0}: Error finding container 0c4500496a6f54c8c1818e814543acbd09ac8c22257f2e312fba4dba55683921: Status 404 returned error can't find the container with id 0c4500496a6f54c8c1818e814543acbd09ac8c22257f2e312fba4dba55683921 Jun 11 23:44:36.481717 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:36.481681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c76c569d4-bzb98" event={"ID":"0cdde0cc-d401-412f-8496-39885ed6aad0","Type":"ContainerStarted","Data":"0c4500496a6f54c8c1818e814543acbd09ac8c22257f2e312fba4dba55683921"} Jun 11 23:44:37.943166 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:37.943124 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:38.042549 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:38.042457 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:44:38.493899 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:38.493850 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c76c569d4-bzb98" event={"ID":"0cdde0cc-d401-412f-8496-39885ed6aad0","Type":"ContainerStarted","Data":"dd72f26d02f86f806f115a4092ffb53640cf01c0d8a0b67401f1ed2dd41516c5"} Jun 11 23:44:38.494100 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:38.493929 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:38.520068 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:38.520016 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c76c569d4-bzb98" podStartSLOduration=1.428658979 podStartE2EDuration="3.520001489s" totalImagesPullingTime="2.09134251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:44:38.519023274 +0000 UTC m=+742.241559167" watchObservedRunningTime="2026-06-11 23:44:38.520001489 +0000 UTC m=+742.242537351" Jun 11 23:44:49.415309 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.415269 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c76c569d4-bzb98"] Jun 11 23:44:49.415969 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.415565 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6c76c569d4-bzb98" podUID="0cdde0cc-d401-412f-8496-39885ed6aad0" containerName="manager" containerID="cri-o://dd72f26d02f86f806f115a4092ffb53640cf01c0d8a0b67401f1ed2dd41516c5" gracePeriod=30 Jun 11 23:44:49.423917 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.423892 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:49.542732 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.542703 2558 generic.go:356] "Generic (PLEG): container finished" podID="0cdde0cc-d401-412f-8496-39885ed6aad0" containerID="dd72f26d02f86f806f115a4092ffb53640cf01c0d8a0b67401f1ed2dd41516c5" exitCode=0 Jun 11 23:44:49.542879 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.542773 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c76c569d4-bzb98" event={"ID":"0cdde0cc-d401-412f-8496-39885ed6aad0","Type":"ContainerDied","Data":"dd72f26d02f86f806f115a4092ffb53640cf01c0d8a0b67401f1ed2dd41516c5"} Jun 11 23:44:49.661707 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.661677 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:49.745487 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.745389 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln8r2\" (UniqueName: \"kubernetes.io/projected/0cdde0cc-d401-412f-8496-39885ed6aad0-kube-api-access-ln8r2\") pod \"0cdde0cc-d401-412f-8496-39885ed6aad0\" (UID: \"0cdde0cc-d401-412f-8496-39885ed6aad0\") " Jun 11 23:44:49.745487 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.745460 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cdde0cc-d401-412f-8496-39885ed6aad0-webhook-cert\") pod \"0cdde0cc-d401-412f-8496-39885ed6aad0\" (UID: \"0cdde0cc-d401-412f-8496-39885ed6aad0\") " Jun 11 23:44:49.747715 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.747684 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cdde0cc-d401-412f-8496-39885ed6aad0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0cdde0cc-d401-412f-8496-39885ed6aad0" (UID: "0cdde0cc-d401-412f-8496-39885ed6aad0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:44:49.747796 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.747692 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cdde0cc-d401-412f-8496-39885ed6aad0-kube-api-access-ln8r2" (OuterVolumeSpecName: "kube-api-access-ln8r2") pod "0cdde0cc-d401-412f-8496-39885ed6aad0" (UID: "0cdde0cc-d401-412f-8496-39885ed6aad0"). InnerVolumeSpecName "kube-api-access-ln8r2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:44:49.846105 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.846069 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln8r2\" (UniqueName: \"kubernetes.io/projected/0cdde0cc-d401-412f-8496-39885ed6aad0-kube-api-access-ln8r2\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:44:49.846105 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:49.846102 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cdde0cc-d401-412f-8496-39885ed6aad0-webhook-cert\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:44:50.549354 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:50.549315 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c76c569d4-bzb98" Jun 11 23:44:50.549850 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:50.549323 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c76c569d4-bzb98" event={"ID":"0cdde0cc-d401-412f-8496-39885ed6aad0","Type":"ContainerDied","Data":"0c4500496a6f54c8c1818e814543acbd09ac8c22257f2e312fba4dba55683921"} Jun 11 23:44:50.549850 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:50.549537 2558 scope.go:117] "RemoveContainer" containerID="dd72f26d02f86f806f115a4092ffb53640cf01c0d8a0b67401f1ed2dd41516c5" Jun 11 23:44:50.573189 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:50.573161 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c76c569d4-bzb98"] Jun 11 23:44:50.575991 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:50.575968 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c76c569d4-bzb98"] Jun 11 23:44:50.700004 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:44:50.699968 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cdde0cc-d401-412f-8496-39885ed6aad0" path="/var/lib/kubelet/pods/0cdde0cc-d401-412f-8496-39885ed6aad0/volumes" Jun 11 23:45:08.836127 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:08.836089 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:45:09.053538 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:09.053490 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:45:09.257306 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:09.257271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:45:09.344317 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:09.344276 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:45:17.671636 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:17.671600 2558 generic.go:356] "Generic (PLEG): container finished" podID="40a48b03-0390-403c-b6a9-8c28da67faff" containerID="ee9095f1f31f48e15e4da85815d7d8be5b9e1a598eec6382d5d0b8789771ad2b" exitCode=0 Jun 11 23:45:17.672047 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:17.671662 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" event={"ID":"40a48b03-0390-403c-b6a9-8c28da67faff","Type":"ContainerDied","Data":"ee9095f1f31f48e15e4da85815d7d8be5b9e1a598eec6382d5d0b8789771ad2b"} Jun 11 23:45:17.672097 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:17.672047 2558 scope.go:117] "RemoveContainer" containerID="ee9095f1f31f48e15e4da85815d7d8be5b9e1a598eec6382d5d0b8789771ad2b" Jun 11 23:45:17.672995 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:17.672963 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:45:17.673078 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:17.673035 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:45:17.673078 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:17.673068 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 23:45:18.679050 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:18.679013 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" event={"ID":"40a48b03-0390-403c-b6a9-8c28da67faff","Type":"ContainerStarted","Data":"a19197bf02b069dfc47025e990b69bc4c9d293a4ba166d18d253dcceb7ff0fa7"} Jun 11 23:45:19.652816 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:19.652775 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:45:19.653044 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:19.653016 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-5tr7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jun 11 23:45:19.653086 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:19.653058 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" podUID="40a48b03-0390-403c-b6a9-8c28da67faff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jun 11 23:45:20.652786 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:20.652743 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-5tr7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jun 11 23:45:20.653283 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:20.652807 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" podUID="40a48b03-0390-403c-b6a9-8c28da67faff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jun 11 23:45:21.653318 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:21.653272 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-5tr7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body= Jun 11 23:45:21.653850 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:21.653366 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" podUID="40a48b03-0390-403c-b6a9-8c28da67faff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" Jun 11 23:45:22.657027 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:22.656997 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:45:22.657445 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:22.657276 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:45:22.657948 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:22.657932 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-5tr7t" Jun 11 23:45:57.902565 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:57.902524 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b46d8f99c-b49bk"] Jun 11 23:45:57.903086 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:57.903004 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cdde0cc-d401-412f-8496-39885ed6aad0" containerName="manager" Jun 11 23:45:57.903086 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:57.903025 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cdde0cc-d401-412f-8496-39885ed6aad0" containerName="manager" Jun 11 23:45:57.903202 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:57.903094 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cdde0cc-d401-412f-8496-39885ed6aad0" containerName="manager" Jun 11 23:45:57.904947 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:57.904925 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:57.907199 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:57.907175 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 23:45:57.915030 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:57.915007 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b46d8f99c-b49bk"] Jun 11 23:45:58.022160 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.022117 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxb87\" (UniqueName: \"kubernetes.io/projected/a13ab56c-e653-410a-ad69-711caac819ed-kube-api-access-kxb87\") pod \"authorino-5b46d8f99c-b49bk\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:58.022336 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.022180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a13ab56c-e653-410a-ad69-711caac819ed-tls-cert\") pod \"authorino-5b46d8f99c-b49bk\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:58.022336 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.022200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a13ab56c-e653-410a-ad69-711caac819ed-oidc-ca\") pod \"authorino-5b46d8f99c-b49bk\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:58.122681 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.122640 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxb87\" (UniqueName: \"kubernetes.io/projected/a13ab56c-e653-410a-ad69-711caac819ed-kube-api-access-kxb87\") pod \"authorino-5b46d8f99c-b49bk\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:58.122859 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.122690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a13ab56c-e653-410a-ad69-711caac819ed-tls-cert\") pod \"authorino-5b46d8f99c-b49bk\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:58.122859 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.122714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a13ab56c-e653-410a-ad69-711caac819ed-oidc-ca\") pod \"authorino-5b46d8f99c-b49bk\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:58.123347 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.123329 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a13ab56c-e653-410a-ad69-711caac819ed-oidc-ca\") pod \"authorino-5b46d8f99c-b49bk\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:58.125340 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.125312 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a13ab56c-e653-410a-ad69-711caac819ed-tls-cert\") pod \"authorino-5b46d8f99c-b49bk\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:58.131640 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.131608 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxb87\" (UniqueName: \"kubernetes.io/projected/a13ab56c-e653-410a-ad69-711caac819ed-kube-api-access-kxb87\") pod \"authorino-5b46d8f99c-b49bk\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:58.213574 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.213493 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:45:58.343797 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.343775 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b46d8f99c-b49bk"] Jun 11 23:45:58.346089 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:45:58.346060 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda13ab56c_e653_410a_ad69_711caac819ed.slice/crio-6242c8a8a0c1ec7e262242be14b7324d98dc068dc35e0f2765f04c36985a7237 WatchSource:0}: Error finding container 6242c8a8a0c1ec7e262242be14b7324d98dc068dc35e0f2765f04c36985a7237: Status 404 returned error can't find the container with id 6242c8a8a0c1ec7e262242be14b7324d98dc068dc35e0f2765f04c36985a7237 Jun 11 23:45:58.347375 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.347358 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:45:58.844756 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.844721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b46d8f99c-b49bk" event={"ID":"a13ab56c-e653-410a-ad69-711caac819ed","Type":"ContainerStarted","Data":"3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0"} Jun 11 23:45:58.844935 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.844771 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b46d8f99c-b49bk" event={"ID":"a13ab56c-e653-410a-ad69-711caac819ed","Type":"ContainerStarted","Data":"6242c8a8a0c1ec7e262242be14b7324d98dc068dc35e0f2765f04c36985a7237"} Jun 11 23:45:58.859776 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.859720 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b46d8f99c-b49bk" podStartSLOduration=1.538143571 podStartE2EDuration="1.859697446s" totalImagesPullingTime="321.553875ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:45:58.859349006 +0000 UTC m=+822.581884869" watchObservedRunningTime="2026-06-11 23:45:58.859697446 +0000 UTC m=+822.582233309" Jun 11 23:45:58.886842 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.886801 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bb7478c7c-zmkrk"] Jun 11 23:45:58.887005 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:58.886974 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" podUID="d6eab3f4-f749-436a-b376-a4deb461a0bd" containerName="authorino" containerID="cri-o://638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb" gracePeriod=30 Jun 11 23:45:59.135232 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.135206 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" Jun 11 23:45:59.233137 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.233100 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6eab3f4-f749-436a-b376-a4deb461a0bd-tls-cert\") pod \"d6eab3f4-f749-436a-b376-a4deb461a0bd\" (UID: \"d6eab3f4-f749-436a-b376-a4deb461a0bd\") " Jun 11 23:45:59.233311 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.233162 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4ffk\" (UniqueName: \"kubernetes.io/projected/d6eab3f4-f749-436a-b376-a4deb461a0bd-kube-api-access-r4ffk\") pod \"d6eab3f4-f749-436a-b376-a4deb461a0bd\" (UID: \"d6eab3f4-f749-436a-b376-a4deb461a0bd\") " Jun 11 23:45:59.235434 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.235390 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6eab3f4-f749-436a-b376-a4deb461a0bd-kube-api-access-r4ffk" (OuterVolumeSpecName: "kube-api-access-r4ffk") pod "d6eab3f4-f749-436a-b376-a4deb461a0bd" (UID: "d6eab3f4-f749-436a-b376-a4deb461a0bd"). InnerVolumeSpecName "kube-api-access-r4ffk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:45:59.243114 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.243089 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6eab3f4-f749-436a-b376-a4deb461a0bd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d6eab3f4-f749-436a-b376-a4deb461a0bd" (UID: "d6eab3f4-f749-436a-b376-a4deb461a0bd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:45:59.334766 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.334675 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6eab3f4-f749-436a-b376-a4deb461a0bd-tls-cert\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:45:59.334766 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.334707 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4ffk\" (UniqueName: \"kubernetes.io/projected/d6eab3f4-f749-436a-b376-a4deb461a0bd-kube-api-access-r4ffk\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:45:59.511281 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.511244 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:45:59.618544 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.618516 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:45:59.851491 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.851455 2558 generic.go:356] "Generic (PLEG): container finished" podID="d6eab3f4-f749-436a-b376-a4deb461a0bd" containerID="638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb" exitCode=0 Jun 11 23:45:59.851656 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.851526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" event={"ID":"d6eab3f4-f749-436a-b376-a4deb461a0bd","Type":"ContainerDied","Data":"638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb"} Jun 11 23:45:59.851656 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.851565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" event={"ID":"d6eab3f4-f749-436a-b376-a4deb461a0bd","Type":"ContainerDied","Data":"45bd14ee3e1f861fe38cd7236251c855ab9f4aecb6a50f53e4fd1240bf2c5ad3"} Jun 11 23:45:59.851656 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.851582 2558 scope.go:117] "RemoveContainer" containerID="638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb" Jun 11 23:45:59.851656 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.851642 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bb7478c7c-zmkrk" Jun 11 23:45:59.860250 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.860235 2558 scope.go:117] "RemoveContainer" containerID="638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb" Jun 11 23:45:59.860540 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:45:59.860519 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb\": container with ID starting with 638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb not found: ID does not exist" containerID="638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb" Jun 11 23:45:59.860595 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.860548 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb"} err="failed to get container status \"638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb\": rpc error: code = NotFound desc = could not find container \"638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb\": container with ID starting with 638d60c26437f971c170434ff784020de2488c7b432a48613df8fc39323d8bfb not found: ID does not exist" Jun 11 23:45:59.871351 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.871298 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bb7478c7c-zmkrk"] Jun 11 23:45:59.875289 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:45:59.875267 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bb7478c7c-zmkrk"] Jun 11 23:46:00.699570 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:00.699541 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6eab3f4-f749-436a-b376-a4deb461a0bd" path="/var/lib/kubelet/pods/d6eab3f4-f749-436a-b376-a4deb461a0bd/volumes" Jun 11 23:46:03.809166 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:03.809123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:46:21.686842 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.686806 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw"] Jun 11 23:46:21.687234 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.687190 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6eab3f4-f749-436a-b376-a4deb461a0bd" containerName="authorino" Jun 11 23:46:21.687234 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.687207 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6eab3f4-f749-436a-b376-a4deb461a0bd" containerName="authorino" Jun 11 23:46:21.687304 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.687257 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6eab3f4-f749-436a-b376-a4deb461a0bd" containerName="authorino" Jun 11 23:46:21.690206 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.690189 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.692922 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.692901 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 23:46:21.692922 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.692913 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 23:46:21.693097 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.692913 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 23:46:21.693743 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.693724 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-29q9n\"" Jun 11 23:46:21.700891 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.700869 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw"] Jun 11 23:46:21.734659 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.734630 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:46:21.840478 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.840438 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t482\" (UniqueName: \"kubernetes.io/projected/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-kube-api-access-7t482\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.840652 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.840492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.840652 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.840567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.840652 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.840626 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.840758 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.840667 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.840758 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.840683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.941637 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.941545 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.941637 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.941591 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.941637 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.941627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.941898 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.941644 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.941898 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.941671 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t482\" (UniqueName: \"kubernetes.io/projected/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-kube-api-access-7t482\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.941898 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.941696 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.942040 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.941961 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.942040 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.942026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.942140 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.942088 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.944218 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.944186 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.944407 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.944389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:21.949686 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:21.949664 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t482\" (UniqueName: \"kubernetes.io/projected/b56c9ec4-ab71-4f7d-8981-782d611f6e9b-kube-api-access-7t482\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw\" (UID: \"b56c9ec4-ab71-4f7d-8981-782d611f6e9b\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:22.001722 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:22.001693 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:46:22.146491 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:22.146460 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw"] Jun 11 23:46:22.148246 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:46:22.148215 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56c9ec4_ab71_4f7d_8981_782d611f6e9b.slice/crio-933f2bc04789382a0a10e4d7966a699eb16dc195e55cc5b1bd6d409cad498a17 WatchSource:0}: Error finding container 933f2bc04789382a0a10e4d7966a699eb16dc195e55cc5b1bd6d409cad498a17: Status 404 returned error can't find the container with id 933f2bc04789382a0a10e4d7966a699eb16dc195e55cc5b1bd6d409cad498a17 Jun 11 23:46:22.955261 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:22.955214 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" event={"ID":"b56c9ec4-ab71-4f7d-8981-782d611f6e9b","Type":"ContainerStarted","Data":"933f2bc04789382a0a10e4d7966a699eb16dc195e55cc5b1bd6d409cad498a17"} Jun 11 23:46:26.980554 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:26.980509 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" event={"ID":"b56c9ec4-ab71-4f7d-8981-782d611f6e9b","Type":"ContainerStarted","Data":"7b00a9a8c7321d8509b85d9f278e90b2436389e056385c8a98f70a397d9b4e81"} Jun 11 23:46:27.328179 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:27.328093 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:46:43.932785 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:43.932745 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:46:59.601348 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.601311 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29"] Jun 11 23:46:59.604915 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.604894 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.607119 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.607084 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 23:46:59.614381 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.614355 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29"] Jun 11 23:46:59.632678 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.632641 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:46:59.673515 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.673480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.673657 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.673531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.673657 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.673606 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjjvg\" (UniqueName: \"kubernetes.io/projected/2e277808-0a71-43e2-9fd6-5348c9b56b80-kube-api-access-zjjvg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.673657 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.673638 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.673762 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.673694 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.673762 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.673723 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e277808-0a71-43e2-9fd6-5348c9b56b80-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.774649 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.774617 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.774915 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.774684 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.774915 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.774718 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e277808-0a71-43e2-9fd6-5348c9b56b80-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.774915 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.774743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.774915 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.774784 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.774915 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.774811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjvg\" (UniqueName: \"kubernetes.io/projected/2e277808-0a71-43e2-9fd6-5348c9b56b80-kube-api-access-zjjvg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.775542 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.775512 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.775841 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.775803 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.775977 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.775950 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.777964 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.777942 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e277808-0a71-43e2-9fd6-5348c9b56b80-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.778405 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.778377 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e277808-0a71-43e2-9fd6-5348c9b56b80-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.782119 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.782098 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjjvg\" (UniqueName: \"kubernetes.io/projected/2e277808-0a71-43e2-9fd6-5348c9b56b80-kube-api-access-zjjvg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29\" (UID: \"2e277808-0a71-43e2-9fd6-5348c9b56b80\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:46:59.916288 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:46:59.916184 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:47:00.048829 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:00.048799 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29"] Jun 11 23:47:00.050763 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:47:00.050733 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e277808_0a71_43e2_9fd6_5348c9b56b80.slice/crio-a214f755638df642a35febe95afc9f8776e1c8a910667853c94881c6ad2a6d06 WatchSource:0}: Error finding container a214f755638df642a35febe95afc9f8776e1c8a910667853c94881c6ad2a6d06: Status 404 returned error can't find the container with id a214f755638df642a35febe95afc9f8776e1c8a910667853c94881c6ad2a6d06 Jun 11 23:47:00.128378 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:00.128345 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" event={"ID":"2e277808-0a71-43e2-9fd6-5348c9b56b80","Type":"ContainerStarted","Data":"b5cd0a40984c249349abd127b1d05dc369dc705b0a70744cca76903fd30aea0e"} Jun 11 23:47:00.128557 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:00.128407 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" event={"ID":"2e277808-0a71-43e2-9fd6-5348c9b56b80","Type":"ContainerStarted","Data":"a214f755638df642a35febe95afc9f8776e1c8a910667853c94881c6ad2a6d06"} Jun 11 23:47:02.143764 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:02.143726 2558 generic.go:356] "Generic (PLEG): container finished" podID="2e277808-0a71-43e2-9fd6-5348c9b56b80" containerID="b5cd0a40984c249349abd127b1d05dc369dc705b0a70744cca76903fd30aea0e" exitCode=0 Jun 11 23:47:02.144222 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:02.143799 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" event={"ID":"2e277808-0a71-43e2-9fd6-5348c9b56b80","Type":"ContainerDied","Data":"b5cd0a40984c249349abd127b1d05dc369dc705b0a70744cca76903fd30aea0e"} Jun 11 23:47:04.154779 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:04.154746 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" event={"ID":"2e277808-0a71-43e2-9fd6-5348c9b56b80","Type":"ContainerStarted","Data":"18fbf05c79253921990bac214a25bc6e2745d312f848c234cf5f43de85c0768b"} Jun 11 23:47:04.174173 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:04.174116 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" podStartSLOduration=2.681362 podStartE2EDuration="5.174100016s" totalImagesPullingTime="1.033562704s" totalInitContainerRuntime="1.459175312s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:47:04.173829848 +0000 UTC m=+887.896365712" watchObservedRunningTime="2026-06-11 23:47:04.174100016 +0000 UTC m=+887.896635921" Jun 11 23:47:09.917105 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:09.917043 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:47:09.917652 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:09.917131 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:47:09.929999 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:09.929977 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:47:10.194039 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:10.193954 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29" Jun 11 23:47:13.698159 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.698122 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2"] Jun 11 23:47:13.702453 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.702435 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.704903 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.704877 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 23:47:13.712098 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.712076 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2"] Jun 11 23:47:13.720443 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.720396 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:47:13.798303 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.798266 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.798514 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.798319 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.798514 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.798402 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73305611-a0ef-4449-9957-f6b043c2a6f4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.798514 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.798476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tktfc\" (UniqueName: \"kubernetes.io/projected/73305611-a0ef-4449-9957-f6b043c2a6f4-kube-api-access-tktfc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.798514 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.798502 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.798659 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.798533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.899635 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.899593 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tktfc\" (UniqueName: \"kubernetes.io/projected/73305611-a0ef-4449-9957-f6b043c2a6f4-kube-api-access-tktfc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.899851 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.899644 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.899851 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.899688 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.899851 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.899714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.899851 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.899767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.899851 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.899817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73305611-a0ef-4449-9957-f6b043c2a6f4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.900338 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.900138 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.900338 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.900154 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.900338 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.900245 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.902250 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.902227 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73305611-a0ef-4449-9957-f6b043c2a6f4-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.902557 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.902537 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73305611-a0ef-4449-9957-f6b043c2a6f4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:13.906913 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:13.906895 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tktfc\" (UniqueName: \"kubernetes.io/projected/73305611-a0ef-4449-9957-f6b043c2a6f4-kube-api-access-tktfc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-495v2\" (UID: \"73305611-a0ef-4449-9957-f6b043c2a6f4\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:14.013385 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:14.013292 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:14.148470 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:14.148441 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2"] Jun 11 23:47:14.150472 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:47:14.150408 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73305611_a0ef_4449_9957_f6b043c2a6f4.slice/crio-7abaec4f19723767dd1cc1c1bba6a660c77e24846159d5f89ce1c897a90c31e2 WatchSource:0}: Error finding container 7abaec4f19723767dd1cc1c1bba6a660c77e24846159d5f89ce1c897a90c31e2: Status 404 returned error can't find the container with id 7abaec4f19723767dd1cc1c1bba6a660c77e24846159d5f89ce1c897a90c31e2 Jun 11 23:47:14.202101 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:14.202066 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" event={"ID":"73305611-a0ef-4449-9957-f6b043c2a6f4","Type":"ContainerStarted","Data":"7abaec4f19723767dd1cc1c1bba6a660c77e24846159d5f89ce1c897a90c31e2"} Jun 11 23:47:15.208724 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:15.208676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" event={"ID":"73305611-a0ef-4449-9957-f6b043c2a6f4","Type":"ContainerStarted","Data":"e6e71e3975bcbd20176ffff5ee3f061a3b9694d359534e11fbad30d40a10ec34"} Jun 11 23:47:16.215029 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:16.214994 2558 generic.go:356] "Generic (PLEG): container finished" podID="73305611-a0ef-4449-9957-f6b043c2a6f4" containerID="e6e71e3975bcbd20176ffff5ee3f061a3b9694d359534e11fbad30d40a10ec34" exitCode=0 Jun 11 23:47:16.215384 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:16.215075 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" event={"ID":"73305611-a0ef-4449-9957-f6b043c2a6f4","Type":"ContainerDied","Data":"e6e71e3975bcbd20176ffff5ee3f061a3b9694d359534e11fbad30d40a10ec34"} Jun 11 23:47:16.714673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:16.714637 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:47:16.714673 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:16.714655 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:47:17.221371 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:17.221337 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" event={"ID":"73305611-a0ef-4449-9957-f6b043c2a6f4","Type":"ContainerStarted","Data":"835e7888caafd865245a722d9bbf91fcf5aefe14ed0f5b046abb22353462e34a"} Jun 11 23:47:17.240737 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:17.240684 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" podStartSLOduration=2.7276304959999997 podStartE2EDuration="4.240652019s" totalImagesPullingTime="167.499976ms" totalInitContainerRuntime="1.345521547s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:47:17.239881898 +0000 UTC m=+900.962417786" watchObservedRunningTime="2026-06-11 23:47:17.240652019 +0000 UTC m=+900.963187880" Jun 11 23:47:22.617304 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:22.617263 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:47:24.013535 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:24.013500 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:24.014125 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:24.014106 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:24.038436 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:24.038386 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:24.263521 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:24.263493 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-495v2" Jun 11 23:47:40.185968 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:47:40.185930 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:48:14.477046 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:14.476953 2558 generic.go:356] "Generic (PLEG): container finished" podID="b56c9ec4-ab71-4f7d-8981-782d611f6e9b" containerID="7b00a9a8c7321d8509b85d9f278e90b2436389e056385c8a98f70a397d9b4e81" exitCode=0 Jun 11 23:48:14.477456 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:14.477035 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" event={"ID":"b56c9ec4-ab71-4f7d-8981-782d611f6e9b","Type":"ContainerDied","Data":"7b00a9a8c7321d8509b85d9f278e90b2436389e056385c8a98f70a397d9b4e81"} Jun 11 23:48:15.483435 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:15.483382 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" event={"ID":"b56c9ec4-ab71-4f7d-8981-782d611f6e9b","Type":"ContainerStarted","Data":"0da66568aaf42dba686fb1480846196498f0e3616151ae0d8ce60b25eb3d98f4"} Jun 11 23:48:15.502298 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:15.502238 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" podStartSLOduration=2.409332951 podStartE2EDuration="1m54.502220093s" totalImagesPullingTime="3.977646234s" totalInitContainerRuntime="1m48.115240908s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:46:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:48:15.501196634 +0000 UTC m=+959.223732496" watchObservedRunningTime="2026-06-11 23:48:15.502220093 +0000 UTC m=+959.224755985" Jun 11 23:48:22.002515 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:22.002478 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:48:22.003034 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:22.002539 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:48:22.015278 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:22.015254 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:48:22.525924 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:22.525887 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw" Jun 11 23:48:37.189029 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:37.188934 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:48:37.287749 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:37.287716 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:48:58.783712 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:48:58.783657 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:49:03.247670 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.247631 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76b977c7f6-xvf9m"] Jun 11 23:49:03.250910 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.250893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.259944 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.259916 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76b977c7f6-xvf9m"] Jun 11 23:49:03.260103 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.260079 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dbk8\" (UniqueName: \"kubernetes.io/projected/c9d4057c-60f3-4991-b21f-8bdef83b7394-kube-api-access-7dbk8\") pod \"authorino-76b977c7f6-xvf9m\" (UID: \"c9d4057c-60f3-4991-b21f-8bdef83b7394\") " pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.260183 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.260157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c9d4057c-60f3-4991-b21f-8bdef83b7394-oidc-ca\") pod \"authorino-76b977c7f6-xvf9m\" (UID: \"c9d4057c-60f3-4991-b21f-8bdef83b7394\") " pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.260292 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.260270 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9d4057c-60f3-4991-b21f-8bdef83b7394-tls-cert\") pod \"authorino-76b977c7f6-xvf9m\" (UID: \"c9d4057c-60f3-4991-b21f-8bdef83b7394\") " pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.360748 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.360706 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c9d4057c-60f3-4991-b21f-8bdef83b7394-oidc-ca\") pod \"authorino-76b977c7f6-xvf9m\" (UID: \"c9d4057c-60f3-4991-b21f-8bdef83b7394\") " pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.360920 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.360786 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9d4057c-60f3-4991-b21f-8bdef83b7394-tls-cert\") pod \"authorino-76b977c7f6-xvf9m\" (UID: \"c9d4057c-60f3-4991-b21f-8bdef83b7394\") " pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.360920 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.360831 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dbk8\" (UniqueName: \"kubernetes.io/projected/c9d4057c-60f3-4991-b21f-8bdef83b7394-kube-api-access-7dbk8\") pod \"authorino-76b977c7f6-xvf9m\" (UID: \"c9d4057c-60f3-4991-b21f-8bdef83b7394\") " pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.361525 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.361491 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c9d4057c-60f3-4991-b21f-8bdef83b7394-oidc-ca\") pod \"authorino-76b977c7f6-xvf9m\" (UID: \"c9d4057c-60f3-4991-b21f-8bdef83b7394\") " pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.363333 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.363304 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9d4057c-60f3-4991-b21f-8bdef83b7394-tls-cert\") pod \"authorino-76b977c7f6-xvf9m\" (UID: \"c9d4057c-60f3-4991-b21f-8bdef83b7394\") " pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.368496 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.368471 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dbk8\" (UniqueName: \"kubernetes.io/projected/c9d4057c-60f3-4991-b21f-8bdef83b7394-kube-api-access-7dbk8\") pod \"authorino-76b977c7f6-xvf9m\" (UID: \"c9d4057c-60f3-4991-b21f-8bdef83b7394\") " pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.561648 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.561560 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b977c7f6-xvf9m" Jun 11 23:49:03.692616 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:03.692581 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76b977c7f6-xvf9m"] Jun 11 23:49:03.695943 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:49:03.695916 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9d4057c_60f3_4991_b21f_8bdef83b7394.slice/crio-fcff7f1da73361626d64db0ee869d868d149b839f38dfe62118380ecba4aad66 WatchSource:0}: Error finding container fcff7f1da73361626d64db0ee869d868d149b839f38dfe62118380ecba4aad66: Status 404 returned error can't find the container with id fcff7f1da73361626d64db0ee869d868d149b839f38dfe62118380ecba4aad66 Jun 11 23:49:04.709947 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:04.709895 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b977c7f6-xvf9m" event={"ID":"c9d4057c-60f3-4991-b21f-8bdef83b7394","Type":"ContainerStarted","Data":"20d2e86eb61ae4e9fa63761a635840e773f433490641d8db6bb3904f9e0e2ce0"} Jun 11 23:49:04.709947 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:04.709940 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b977c7f6-xvf9m" event={"ID":"c9d4057c-60f3-4991-b21f-8bdef83b7394","Type":"ContainerStarted","Data":"fcff7f1da73361626d64db0ee869d868d149b839f38dfe62118380ecba4aad66"} Jun 11 23:49:04.728933 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:04.728882 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76b977c7f6-xvf9m" podStartSLOduration=1.253065453 podStartE2EDuration="1.728865187s" totalImagesPullingTime="475.799734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:49:04.727116448 +0000 UTC m=+1008.449652311" watchObservedRunningTime="2026-06-11 23:49:04.728865187 +0000 UTC m=+1008.451401052" Jun 11 23:49:04.757927 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:04.757890 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b46d8f99c-b49bk"] Jun 11 23:49:04.758149 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:04.758116 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b46d8f99c-b49bk" podUID="a13ab56c-e653-410a-ad69-711caac819ed" containerName="authorino" containerID="cri-o://3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0" gracePeriod=30 Jun 11 23:49:05.017579 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.017547 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:49:05.076095 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.076061 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a13ab56c-e653-410a-ad69-711caac819ed-oidc-ca\") pod \"a13ab56c-e653-410a-ad69-711caac819ed\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " Jun 11 23:49:05.076095 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.076108 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a13ab56c-e653-410a-ad69-711caac819ed-tls-cert\") pod \"a13ab56c-e653-410a-ad69-711caac819ed\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " Jun 11 23:49:05.076319 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.076150 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxb87\" (UniqueName: \"kubernetes.io/projected/a13ab56c-e653-410a-ad69-711caac819ed-kube-api-access-kxb87\") pod \"a13ab56c-e653-410a-ad69-711caac819ed\" (UID: \"a13ab56c-e653-410a-ad69-711caac819ed\") " Jun 11 23:49:05.078458 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.078399 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13ab56c-e653-410a-ad69-711caac819ed-kube-api-access-kxb87" (OuterVolumeSpecName: "kube-api-access-kxb87") pod "a13ab56c-e653-410a-ad69-711caac819ed" (UID: "a13ab56c-e653-410a-ad69-711caac819ed"). InnerVolumeSpecName "kube-api-access-kxb87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:49:05.081078 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.080993 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a13ab56c-e653-410a-ad69-711caac819ed-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "a13ab56c-e653-410a-ad69-711caac819ed" (UID: "a13ab56c-e653-410a-ad69-711caac819ed"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:49:05.085980 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.085950 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a13ab56c-e653-410a-ad69-711caac819ed-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a13ab56c-e653-410a-ad69-711caac819ed" (UID: "a13ab56c-e653-410a-ad69-711caac819ed"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:49:05.176757 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.176716 2558 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a13ab56c-e653-410a-ad69-711caac819ed-oidc-ca\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:49:05.176757 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.176745 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a13ab56c-e653-410a-ad69-711caac819ed-tls-cert\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:49:05.176757 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.176754 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxb87\" (UniqueName: \"kubernetes.io/projected/a13ab56c-e653-410a-ad69-711caac819ed-kube-api-access-kxb87\") on node \"ip-10-0-143-183.ec2.internal\" DevicePath \"\"" Jun 11 23:49:05.378828 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.378731 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:49:05.479268 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.479233 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:49:05.716723 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.716644 2558 generic.go:356] "Generic (PLEG): container finished" podID="a13ab56c-e653-410a-ad69-711caac819ed" containerID="3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0" exitCode=0 Jun 11 23:49:05.716723 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.716699 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b46d8f99c-b49bk" Jun 11 23:49:05.717196 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.716731 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b46d8f99c-b49bk" event={"ID":"a13ab56c-e653-410a-ad69-711caac819ed","Type":"ContainerDied","Data":"3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0"} Jun 11 23:49:05.717196 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.716771 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b46d8f99c-b49bk" event={"ID":"a13ab56c-e653-410a-ad69-711caac819ed","Type":"ContainerDied","Data":"6242c8a8a0c1ec7e262242be14b7324d98dc068dc35e0f2765f04c36985a7237"} Jun 11 23:49:05.717196 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.716788 2558 scope.go:117] "RemoveContainer" containerID="3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0" Jun 11 23:49:05.726056 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.726038 2558 scope.go:117] "RemoveContainer" containerID="3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0" Jun 11 23:49:05.726325 ip-10-0-143-183 kubenswrapper[2558]: E0611 23:49:05.726306 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0\": container with ID starting with 3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0 not found: ID does not exist" containerID="3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0" Jun 11 23:49:05.726447 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.726334 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0"} err="failed to get container status \"3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0\": rpc error: code = NotFound desc = could not find container \"3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0\": container with ID starting with 3561fa03cb4b638486747ea1e8f157761e33981b38cd4c7ab026c90a0a7748a0 not found: ID does not exist" Jun 11 23:49:05.740411 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.740387 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b46d8f99c-b49bk"] Jun 11 23:49:05.744676 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:05.744654 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b46d8f99c-b49bk"] Jun 11 23:49:06.490940 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:06.490892 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:49:06.589038 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:06.588989 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:49:06.701037 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:49:06.701007 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a13ab56c-e653-410a-ad69-711caac819ed" path="/var/lib/kubelet/pods/a13ab56c-e653-410a-ad69-711caac819ed/volumes" Jun 11 23:50:33.058704 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:33.058668 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:50:34.201602 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.201567 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:50:34.325190 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.325154 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79b64d6b4-gjbs6"] Jun 11 23:50:34.325502 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.325489 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13ab56c-e653-410a-ad69-711caac819ed" containerName="authorino" Jun 11 23:50:34.325502 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.325504 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13ab56c-e653-410a-ad69-711caac819ed" containerName="authorino" Jun 11 23:50:34.325607 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.325557 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a13ab56c-e653-410a-ad69-711caac819ed" containerName="authorino" Jun 11 23:50:34.328388 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.328372 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79b64d6b4-gjbs6" Jun 11 23:50:34.331995 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.331973 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 23:50:34.332081 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.332020 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 23:50:34.332081 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.332021 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lmbdl\"" Jun 11 23:50:34.338513 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.338490 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79b64d6b4-gjbs6"] Jun 11 23:50:34.367762 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.367726 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1a27304-fd8a-43b2-bb5e-45647099ec20-webhook-cert\") pod \"maas-controller-79b64d6b4-gjbs6\" (UID: \"a1a27304-fd8a-43b2-bb5e-45647099ec20\") " pod="opendatahub/maas-controller-79b64d6b4-gjbs6" Jun 11 23:50:34.367921 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.367796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8vc\" (UniqueName: \"kubernetes.io/projected/a1a27304-fd8a-43b2-bb5e-45647099ec20-kube-api-access-tx8vc\") pod \"maas-controller-79b64d6b4-gjbs6\" (UID: \"a1a27304-fd8a-43b2-bb5e-45647099ec20\") " pod="opendatahub/maas-controller-79b64d6b4-gjbs6" Jun 11 23:50:34.468601 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.468519 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8vc\" (UniqueName: \"kubernetes.io/projected/a1a27304-fd8a-43b2-bb5e-45647099ec20-kube-api-access-tx8vc\") pod \"maas-controller-79b64d6b4-gjbs6\" (UID: \"a1a27304-fd8a-43b2-bb5e-45647099ec20\") " pod="opendatahub/maas-controller-79b64d6b4-gjbs6" Jun 11 23:50:34.468601 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.468589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1a27304-fd8a-43b2-bb5e-45647099ec20-webhook-cert\") pod \"maas-controller-79b64d6b4-gjbs6\" (UID: \"a1a27304-fd8a-43b2-bb5e-45647099ec20\") " pod="opendatahub/maas-controller-79b64d6b4-gjbs6" Jun 11 23:50:34.471190 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.471154 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1a27304-fd8a-43b2-bb5e-45647099ec20-webhook-cert\") pod \"maas-controller-79b64d6b4-gjbs6\" (UID: \"a1a27304-fd8a-43b2-bb5e-45647099ec20\") " pod="opendatahub/maas-controller-79b64d6b4-gjbs6" Jun 11 23:50:34.476837 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.476803 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8vc\" (UniqueName: \"kubernetes.io/projected/a1a27304-fd8a-43b2-bb5e-45647099ec20-kube-api-access-tx8vc\") pod \"maas-controller-79b64d6b4-gjbs6\" (UID: \"a1a27304-fd8a-43b2-bb5e-45647099ec20\") " pod="opendatahub/maas-controller-79b64d6b4-gjbs6" Jun 11 23:50:34.638751 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.638704 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79b64d6b4-gjbs6" Jun 11 23:50:34.776204 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:34.776179 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79b64d6b4-gjbs6"] Jun 11 23:50:34.779009 ip-10-0-143-183 kubenswrapper[2558]: W0611 23:50:34.778981 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a27304_fd8a_43b2_bb5e_45647099ec20.slice/crio-5f55846881231e09ff5e804dabc0c021020bbbb11d7f83d6946f7293e80cb285 WatchSource:0}: Error finding container 5f55846881231e09ff5e804dabc0c021020bbbb11d7f83d6946f7293e80cb285: Status 404 returned error can't find the container with id 5f55846881231e09ff5e804dabc0c021020bbbb11d7f83d6946f7293e80cb285 Jun 11 23:50:35.112713 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:35.112676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79b64d6b4-gjbs6" event={"ID":"a1a27304-fd8a-43b2-bb5e-45647099ec20","Type":"ContainerStarted","Data":"5f55846881231e09ff5e804dabc0c021020bbbb11d7f83d6946f7293e80cb285"} Jun 11 23:50:36.119094 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:36.119057 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79b64d6b4-gjbs6" event={"ID":"a1a27304-fd8a-43b2-bb5e-45647099ec20","Type":"ContainerStarted","Data":"d604751820538160e524498112111e6201897a610d3b7fc5ee28cc0e310521c2"} Jun 11 23:50:36.119518 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:36.119200 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79b64d6b4-gjbs6" Jun 11 23:50:36.135845 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:36.135786 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79b64d6b4-gjbs6" podStartSLOduration=1.674425955 podStartE2EDuration="2.135768707s" totalImagesPullingTime="461.342752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:50:36.13553633 +0000 UTC m=+1099.858072208" watchObservedRunningTime="2026-06-11 23:50:36.135768707 +0000 UTC m=+1099.858304570" Jun 11 23:50:47.131347 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:50:47.131311 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79b64d6b4-gjbs6" Jun 11 23:51:14.710602 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:51:14.710560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:51:14.809921 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:51:14.809878 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:51:23.211404 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:51:23.211291 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:51:28.885659 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:51:28.885601 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:51:28.940862 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:51:28.940825 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:51:53.262109 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:51:53.262065 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:51:53.315550 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:51:53.315515 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:01.134836 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:01.134792 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:01.233379 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:01.233340 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:16.748142 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:16.748109 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:52:16.749719 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:16.749700 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:52:25.103211 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:25.103168 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:30.765753 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:30.765716 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:30.876229 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:30.876193 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:30.967467 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:30.967436 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:31.141462 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:31.141408 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:31.243582 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:31.243545 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:47.759323 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:47.759279 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:47.921895 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:47.921851 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:48.022982 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:48.022871 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:53.842744 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:53.842659 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:52:53.946895 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:52:53.946857 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:01.983824 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:01.983781 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:02.087497 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:02.087448 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:02.183240 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:02.183207 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:02.283878 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:02.283770 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:18.731168 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:18.731104 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:18.857962 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:18.857927 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:18.967326 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:18.967286 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:24.577369 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:24.577328 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:24.632142 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:24.632102 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:40.830941 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:40.830901 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:40.933310 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:40.933276 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:41.044632 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:41.044590 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:46.673482 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:46.673407 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:46.732285 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:46.732228 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:46.796140 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:46.796100 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:46.898935 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:46.898890 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:47.022467 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:47.022336 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:52.830274 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:52.830235 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:53:52.888809 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:53:52.888774 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:54:29.159495 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:54:29.159381 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:55:47.636279 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:55:47.636237 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:55:47.735691 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:55:47.735646 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:56:49.972867 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:56:49.972827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:56:50.074962 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:56:50.074927 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:57:16.773499 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:57:16.773467 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:57:16.776239 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:57:16.776218 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 11 23:59:01.678095 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:59:01.677978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 11 23:59:02.710322 ip-10-0-143-183 kubenswrapper[2558]: I0611 23:59:02.710263 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:02:16.801181 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:02:16.801145 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 12 00:02:16.804253 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:02:16.804231 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 12 00:04:35.750830 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:04:35.750784 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:05:33.635338 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:05:33.635297 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:05:33.736368 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:05:33.736324 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:07:16.831561 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:07:16.831527 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 12 00:07:16.834351 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:07:16.834335 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 12 00:08:02.533562 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:08:02.533475 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:08:02.620024 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:08:02.619984 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:09:46.420941 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:09:46.420858 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:10:25.005052 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:10:25.005016 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:10:28.344641 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:10:28.344582 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:10:52.622918 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:10:52.622875 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:05.690087 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:05.690047 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:07.354925 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:07.354882 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:07.459823 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:07.459790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:07.574675 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:07.574637 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:07.695918 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:07.695887 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:10.846213 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:10.846176 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:13.653709 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:13.653674 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:13.832439 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:13.832378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:13.934081 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:13.933996 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:15.507601 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:15.507565 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:20.035782 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:20.035743 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:20.137564 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:20.137531 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:20.296682 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:20.296595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:20.377446 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:20.377398 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:20.481527 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:20.481492 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:23.435837 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:23.435804 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:26.539336 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:26.539301 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:27.704942 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:27.704889 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:27.805463 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:27.805407 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:29.293653 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:29.293619 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:33.793676 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:33.793635 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:33.852252 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:33.852223 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:40.207888 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:40.207848 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76b977c7f6-xvf9m_c9d4057c-60f3-4991-b21f-8bdef83b7394/authorino/0.log" Jun 12 00:11:44.889534 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:44.889502 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8569bc4bf6-jphnd_c3002c7f-4f99-4e69-8ee5-6681a16029ff/nginx/0.log" Jun 12 00:11:45.536652 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:45.536619 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79b64d6b4-gjbs6_a1a27304-fd8a-43b2-bb5e-45647099ec20/manager/0.log" Jun 12 00:11:46.002068 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:46.002040 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585bb5b6dc-qffwj_e26b1427-59c3-4c15-b2ef-f461db52e737/copy-manifests/0.log" Jun 12 00:11:46.009139 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:46.009111 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585bb5b6dc-qffwj_e26b1427-59c3-4c15-b2ef-f461db52e737/manager/0.log" Jun 12 00:11:46.247020 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:46.246992 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-t5xvx_8d08a47a-bd87-447b-bd5e-0d1fae56fffc/postgres/0.log" Jun 12 00:11:46.544744 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:46.544706 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:47.544669 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:47.544629 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76b977c7f6-xvf9m_c9d4057c-60f3-4991-b21f-8bdef83b7394/authorino/0.log" Jun 12 00:11:47.783880 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:47.783852 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hl6lq_2f94d0ec-369a-463b-8d93-bacd7ef149a8/manager/0.log" Jun 12 00:11:47.892857 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:47.892824 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kxqdq_2308acd7-21b7-4dba-8dcd-59497d5583f4/kuadrant-console-plugin/0.log" Jun 12 00:11:48.006810 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:48.006780 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6w4xx_d7a3c7f2-292f-4e93-a84c-fa4eba225e14/registry-server/0.log" Jun 12 00:11:48.738284 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:48.738247 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bck9z2p_30851afc-5572-4a22-8694-5430ce554def/istio-proxy/0.log" Jun 12 00:11:49.214154 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:49.214119 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5tr7t_40a48b03-0390-403c-b6a9-8c28da67faff/istio-proxy/1.log" Jun 12 00:11:49.919679 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:49.919647 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw_b56c9ec4-ab71-4f7d-8981-782d611f6e9b/storage-initializer/0.log" Jun 12 00:11:49.934162 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:49.934136 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-gnkdw_b56c9ec4-ab71-4f7d-8981-782d611f6e9b/main/0.log" Jun 12 00:11:50.294396 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:50.294318 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29_2e277808-0a71-43e2-9fd6-5348c9b56b80/storage-initializer/0.log" Jun 12 00:11:50.303579 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:50.303555 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvgr29_2e277808-0a71-43e2-9fd6-5348c9b56b80/main/0.log" Jun 12 00:11:50.416013 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:50.415978 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-495v2_73305611-a0ef-4449-9957-f6b043c2a6f4/storage-initializer/0.log" Jun 12 00:11:50.423908 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:50.423885 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-495v2_73305611-a0ef-4449-9957-f6b043c2a6f4/main/0.log" Jun 12 00:11:54.522334 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:54.522303 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:54.625601 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:54.625568 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" limit=1024 Jun 12 00:11:57.564609 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:57.564575 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qngnd_f1aa934a-1027-41b7-bfbf-9eeb2bfddce1/global-pull-secret-syncer/0.log" Jun 12 00:11:57.620037 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:57.620006 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-crjvj_9c8cbaaf-e2cd-4364-9a9a-ac388dca0991/konnectivity-agent/0.log" Jun 12 00:11:57.758265 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:11:57.758235 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-183.ec2.internal_1c5239f57b02f406b49d6cca729c0e25/haproxy/0.log" Jun 12 00:12:02.774931 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:02.774898 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76b977c7f6-xvf9m_c9d4057c-60f3-4991-b21f-8bdef83b7394/authorino/0.log" Jun 12 00:12:02.851226 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:02.851189 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hl6lq_2f94d0ec-369a-463b-8d93-bacd7ef149a8/manager/0.log" Jun 12 00:12:02.879061 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:02.879032 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kxqdq_2308acd7-21b7-4dba-8dcd-59497d5583f4/kuadrant-console-plugin/0.log" Jun 12 00:12:02.917723 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:02.917689 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6w4xx_d7a3c7f2-292f-4e93-a84c-fa4eba225e14/registry-server/0.log" Jun 12 00:12:05.081720 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:05.081688 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4n4f7_e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78/node-exporter/0.log" Jun 12 00:12:05.111319 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:05.111285 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4n4f7_e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78/kube-rbac-proxy/0.log" Jun 12 00:12:05.135980 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:05.135952 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4n4f7_e38887b2-fbcd-4e8b-9a2f-e7e74eae0d78/init-textfile/0.log" Jun 12 00:12:09.908376 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:09.908331 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs"] Jun 12 00:12:09.911693 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:09.911676 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:09.914400 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:09.914376 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wlr6r\"/\"kube-root-ca.crt\"" Jun 12 00:12:09.914560 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:09.914383 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wlr6r\"/\"openshift-service-ca.crt\"" Jun 12 00:12:09.915236 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:09.915221 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wlr6r\"/\"default-dockercfg-mldf6\"" Jun 12 00:12:09.922824 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:09.922796 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs"] Jun 12 00:12:10.030715 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.030676 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-sys\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.030917 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.030735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf6fj\" (UniqueName: \"kubernetes.io/projected/eccca64a-c163-408e-8ac9-356664102a95-kube-api-access-vf6fj\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.030917 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.030815 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-lib-modules\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.030917 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.030877 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-podres\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.030917 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.030904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-proc\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.131737 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.131692 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-sys\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.131737 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.131739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf6fj\" (UniqueName: \"kubernetes.io/projected/eccca64a-c163-408e-8ac9-356664102a95-kube-api-access-vf6fj\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.132037 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.131766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-lib-modules\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.132037 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.131806 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-podres\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.132037 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.131833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-proc\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.132037 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.131851 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-sys\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.132037 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.131919 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-proc\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.132037 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.131966 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-lib-modules\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.132037 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.131971 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eccca64a-c163-408e-8ac9-356664102a95-podres\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.140178 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.140146 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf6fj\" (UniqueName: \"kubernetes.io/projected/eccca64a-c163-408e-8ac9-356664102a95-kube-api-access-vf6fj\") pod \"perf-node-gather-daemonset-drrbs\" (UID: \"eccca64a-c163-408e-8ac9-356664102a95\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.223837 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.223746 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:10.385285 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.385259 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs"] Jun 12 00:12:10.386969 ip-10-0-143-183 kubenswrapper[2558]: W0612 00:12:10.386939 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeccca64a_c163_408e_8ac9_356664102a95.slice/crio-cc7e9d9798d8c51e4a1a07760091ca71e4d98f3f1a7310192a0111ea156cc0a9 WatchSource:0}: Error finding container cc7e9d9798d8c51e4a1a07760091ca71e4d98f3f1a7310192a0111ea156cc0a9: Status 404 returned error can't find the container with id cc7e9d9798d8c51e4a1a07760091ca71e4d98f3f1a7310192a0111ea156cc0a9 Jun 12 00:12:10.682233 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.682206 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-htfbs_51ab87a8-031d-453d-a44b-f10d222141fa/dns/0.log" Jun 12 00:12:10.705370 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.705337 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-htfbs_51ab87a8-031d-453d-a44b-f10d222141fa/kube-rbac-proxy/0.log" Jun 12 00:12:10.827041 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:10.826965 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8p2hj_ad8ec8a6-ec32-431f-96aa-a595b6e6d53f/dns-node-resolver/0.log" Jun 12 00:12:11.017610 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:11.017573 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" event={"ID":"eccca64a-c163-408e-8ac9-356664102a95","Type":"ContainerStarted","Data":"2df9f28cc201d4b7048efe595a2f9ffbf2fffb61815be004b221e984573490df"} Jun 12 00:12:11.018057 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:11.017624 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" event={"ID":"eccca64a-c163-408e-8ac9-356664102a95","Type":"ContainerStarted","Data":"cc7e9d9798d8c51e4a1a07760091ca71e4d98f3f1a7310192a0111ea156cc0a9"} Jun 12 00:12:11.018057 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:11.017702 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:11.034175 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:11.034116 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" podStartSLOduration=2.034099769 podStartE2EDuration="2.034099769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 00:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 00:12:11.032669402 +0000 UTC m=+2394.755205288" watchObservedRunningTime="2026-06-12 00:12:11.034099769 +0000 UTC m=+2394.756635660" Jun 12 00:12:11.599692 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:11.599663 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tz4hv_6220ce74-b1b0-48b3-ae6a-dbc39011dbe3/node-ca/0.log" Jun 12 00:12:12.547447 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:12.547401 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bck9z2p_30851afc-5572-4a22-8694-5430ce554def/istio-proxy/0.log" Jun 12 00:12:12.681332 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:12.681293 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5tr7t_40a48b03-0390-403c-b6a9-8c28da67faff/istio-proxy/0.log" Jun 12 00:12:12.713355 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:12.713325 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5tr7t_40a48b03-0390-403c-b6a9-8c28da67faff/istio-proxy/1.log" Jun 12 00:12:13.423510 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:13.423477 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k4hdg_ab72fbbb-b32d-4fd3-8544-e43364ac371c/serve-healthcheck-canary/0.log" Jun 12 00:12:14.192668 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:14.192643 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d45jv_2c74611a-89d2-489c-9719-750a8b6c4f22/kube-rbac-proxy/0.log" Jun 12 00:12:14.213176 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:14.213148 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d45jv_2c74611a-89d2-489c-9719-750a8b6c4f22/exporter/0.log" Jun 12 00:12:14.235184 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:14.235157 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d45jv_2c74611a-89d2-489c-9719-750a8b6c4f22/extractor/0.log" Jun 12 00:12:16.473998 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:16.473937 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8569bc4bf6-jphnd_c3002c7f-4f99-4e69-8ee5-6681a16029ff/nginx/0.log" Jun 12 00:12:16.791607 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:16.791500 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79b64d6b4-gjbs6_a1a27304-fd8a-43b2-bb5e-45647099ec20/manager/0.log" Jun 12 00:12:16.865128 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:16.865096 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 12 00:12:16.869890 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:16.869871 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rtrh4_266b6897-265f-4c0e-aa76-50d81144c6a7/ovn-acl-logging/0.log" Jun 12 00:12:16.933101 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:16.933065 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585bb5b6dc-qffwj_e26b1427-59c3-4c15-b2ef-f461db52e737/manager/0.log" Jun 12 00:12:16.952974 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:16.952949 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585bb5b6dc-qffwj_e26b1427-59c3-4c15-b2ef-f461db52e737/copy-manifests/0.log" Jun 12 00:12:17.032368 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:17.032343 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-drrbs" Jun 12 00:12:17.093234 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:17.093142 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-t5xvx_8d08a47a-bd87-447b-bd5e-0d1fae56fffc/postgres/0.log" Jun 12 00:12:18.698479 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:18.698442 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65f5df65d6-nfhpx_25327e5b-e1b3-443d-afd6-064d92023e9e/manager/0.log" Jun 12 00:12:23.287248 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:23.287156 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bck9z2p_30851afc-5572-4a22-8694-5430ce554def/istio-proxy/0.log" Jun 12 00:12:23.397898 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:23.397851 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5tr7t_40a48b03-0390-403c-b6a9-8c28da67faff/istio-proxy/0.log" Jun 12 00:12:23.433671 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:23.433638 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5tr7t_40a48b03-0390-403c-b6a9-8c28da67faff/istio-proxy/1.log" Jun 12 00:12:24.731470 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:24.731412 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bck9z2p_30851afc-5572-4a22-8694-5430ce554def/istio-proxy/0.log" Jun 12 00:12:24.889316 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:24.889286 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5tr7t_40a48b03-0390-403c-b6a9-8c28da67faff/istio-proxy/0.log" Jun 12 00:12:24.919303 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:24.919266 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5tr7t_40a48b03-0390-403c-b6a9-8c28da67faff/istio-proxy/1.log" Jun 12 00:12:26.002098 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.002013 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-56prl_a9a1e881-bf63-40df-9147-d7dd0fc22d3c/kube-multus/0.log" Jun 12 00:12:26.340780 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.340693 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7kht_a9028892-956f-45c6-a197-16d553d9eb9e/kube-multus-additional-cni-plugins/0.log" Jun 12 00:12:26.361807 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.361779 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7kht_a9028892-956f-45c6-a197-16d553d9eb9e/egress-router-binary-copy/0.log" Jun 12 00:12:26.381986 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.381956 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7kht_a9028892-956f-45c6-a197-16d553d9eb9e/cni-plugins/0.log" Jun 12 00:12:26.404150 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.404125 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7kht_a9028892-956f-45c6-a197-16d553d9eb9e/bond-cni-plugin/0.log" Jun 12 00:12:26.429614 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.429585 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7kht_a9028892-956f-45c6-a197-16d553d9eb9e/routeoverride-cni/0.log" Jun 12 00:12:26.455754 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.455725 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7kht_a9028892-956f-45c6-a197-16d553d9eb9e/whereabouts-cni-bincopy/0.log" Jun 12 00:12:26.486942 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.486911 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p7kht_a9028892-956f-45c6-a197-16d553d9eb9e/whereabouts-cni/0.log" Jun 12 00:12:26.583832 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.583803 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7zxrn_dda14d2a-dc6e-4531-bb06-0ab0a7b747e0/network-metrics-daemon/0.log" Jun 12 00:12:26.606502 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.606471 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7zxrn_dda14d2a-dc6e-4531-bb06-0ab0a7b747e0/kube-rbac-proxy/0.log" Jun 12 00:12:26.692959 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.692919 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bck9z2p_30851afc-5572-4a22-8694-5430ce554def/istio-proxy/0.log" Jun 12 00:12:26.796477 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.796437 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5tr7t_40a48b03-0390-403c-b6a9-8c28da67faff/istio-proxy/0.log" Jun 12 00:12:26.828779 ip-10-0-143-183 kubenswrapper[2558]: I0612 00:12:26.828721 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-5tr7t_40a48b03-0390-403c-b6a9-8c28da67faff/istio-proxy/1.log"