Jun 05 17:48:48.939952 ip-10-0-139-141 systemd[1]: Starting Kubernetes Kubelet... Jun 05 17:48:49.371707 ip-10-0-139-141 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 17:48:49.371707 ip-10-0-139-141 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 17:48:49.371707 ip-10-0-139-141 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 17:48:49.371707 ip-10-0-139-141 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 17:48:49.371707 ip-10-0-139-141 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 17:48:49.373774 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.373635 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 17:48:49.380744 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380729 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:49.380744 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380744 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380748 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380751 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380759 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380762 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380765 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380768 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380772 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380774 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380777 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380780 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380782 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380785 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380787 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380790 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380792 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380795 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380797 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380800 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:49.380807 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380802 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380805 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380808 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380810 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380813 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380816 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380819 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380822 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380825 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380827 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380830 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380834 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380838 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380841 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380844 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380846 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380849 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380852 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380854 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380857 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:49.381274 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380859 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380862 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380864 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380867 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380869 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380872 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380876 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380879 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380882 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380885 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380890 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380892 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380896 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380899 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380902 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380905 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380907 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380910 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380912 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:49.382177 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380916 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380919 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380923 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380925 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380928 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380931 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380934 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380936 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380938 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380941 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380943 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380948 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380950 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380953 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380956 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380959 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380961 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380963 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380966 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380968 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:49.382904 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380971 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380973 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380976 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380978 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380981 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380984 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380987 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380990 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380993 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380995 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.380998 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.381000 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.381003 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.381005 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.381008 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.381010 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.381012 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.381015 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.381017 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.381020 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:49.383395 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383367 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383379 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383383 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383386 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383390 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383393 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383396 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383401 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383428 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383431 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383435 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383439 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383442 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383445 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383449 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383451 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383454 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383457 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:49.383894 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383460 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383462 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383465 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383468 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383471 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383473 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383476 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383478 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383481 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383488 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383491 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383493 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383496 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383498 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383501 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383504 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383507 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383510 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383513 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383515 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:49.384337 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383518 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383520 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383523 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383526 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383528 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383531 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383533 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383537 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383539 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383542 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383545 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383548 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383557 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383560 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383563 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383565 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383568 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383570 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383573 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383576 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383578 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:49.384936 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383581 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383583 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383586 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383589 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383591 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383594 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383597 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383622 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383627 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383631 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383636 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383639 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383642 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383645 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383648 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383650 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383655 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383659 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383663 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383665 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:49.385464 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383668 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383671 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383674 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383676 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383688 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383691 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383693 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383696 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383698 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383701 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383704 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383706 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383709 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383711 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383714 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383716 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383719 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383722 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383724 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:49.385970 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.383729 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384140 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384145 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384148 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384151 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384154 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384157 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384160 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384162 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384165 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384168 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384171 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384173 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384176 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384179 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384181 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384184 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384192 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384195 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384198 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:49.386467 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384200 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384203 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384205 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384208 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384211 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384213 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384216 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384218 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384221 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384223 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384226 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384228 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384231 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384234 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384237 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384239 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384242 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384244 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384247 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384250 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:49.386971 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384252 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384255 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384257 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384261 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384270 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384273 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384276 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384278 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384281 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384284 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384292 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384295 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384298 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384300 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384303 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384306 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384308 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384311 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384313 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:49.387491 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384316 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384318 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384321 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384323 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384326 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384329 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384331 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384334 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384336 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384339 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384341 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384344 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384347 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384350 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384353 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384355 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384358 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384361 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384364 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384366 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:49.387964 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384369 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384373 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384376 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384379 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384389 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384393 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384396 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384399 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384402 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384404 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384407 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384410 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384412 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384415 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384418 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384420 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384423 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384426 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384428 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:49.388449 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384431 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.384433 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384512 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384520 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384535 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384542 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384548 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384554 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384559 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384564 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384567 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384571 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384575 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384578 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384581 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384584 2579 flags.go:64] FLAG: --cgroup-root="" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384586 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384590 2579 flags.go:64] FLAG: --client-ca-file="" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384613 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384619 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384628 2579 flags.go:64] FLAG: --cluster-domain="" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384632 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384636 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 17:48:49.388965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384639 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384642 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384650 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384653 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384657 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384660 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384663 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384670 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384674 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384677 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384680 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384684 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384687 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384690 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384693 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384696 2579 flags.go:64] FLAG: --enable-server="true" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384699 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384706 2579 flags.go:64] FLAG: --event-burst="100" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384709 2579 flags.go:64] FLAG: --event-qps="50" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384712 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384715 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384718 2579 flags.go:64] FLAG: --eviction-hard="" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384722 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384724 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384727 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 17:48:49.389530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384731 2579 flags.go:64] FLAG: --eviction-soft="" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384734 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384736 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384740 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384743 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384746 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384750 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384752 2579 flags.go:64] FLAG: --feature-gates="" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384756 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384759 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384762 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384765 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384769 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384772 2579 flags.go:64] FLAG: --help="false" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384777 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384781 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384785 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384788 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384791 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384795 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384797 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384800 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384803 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 17:48:49.390150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384806 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384809 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384812 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384815 2579 flags.go:64] FLAG: --kube-reserved="" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384818 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384821 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384824 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384827 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384829 2579 flags.go:64] FLAG: --lock-file="" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384832 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384835 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384838 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384843 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384847 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384849 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384852 2579 flags.go:64] FLAG: --logging-format="text" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384855 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384858 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384861 2579 flags.go:64] FLAG: --manifest-url="" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384864 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384868 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384871 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384875 2579 flags.go:64] FLAG: --max-pods="110" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384880 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384885 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 17:48:49.390799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384888 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384891 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384894 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384897 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384900 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384907 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384910 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384913 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384917 2579 flags.go:64] FLAG: --pod-cidr="" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384920 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384925 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384928 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384931 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384934 2579 flags.go:64] FLAG: --port="10250" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384937 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384940 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09e7fbc698230210b" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384943 2579 flags.go:64] FLAG: --qos-reserved="" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384946 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384950 2579 flags.go:64] FLAG: --register-node="true" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384953 2579 flags.go:64] FLAG: --register-with-taints="" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384956 2579 flags.go:64] FLAG: --registry-burst="10" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384960 2579 flags.go:64] FLAG: --registry-qps="5" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384963 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384965 2579 flags.go:64] FLAG: --reserved-memory="" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384969 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 17:48:49.391415 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384972 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384975 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384978 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384981 2579 flags.go:64] FLAG: --runonce="false" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384983 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384986 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384992 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384994 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.384997 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385000 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385003 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385006 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385009 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385012 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385015 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385018 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385021 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385024 2579 flags.go:64] FLAG: --system-cgroups="" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385026 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385032 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385034 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385037 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385041 2579 flags.go:64] FLAG: --tls-min-version="" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385044 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385046 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 17:48:49.392053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385049 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385052 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385055 2579 flags.go:64] FLAG: --v="2" Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385059 2579 flags.go:64] FLAG: --version="false" Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385072 2579 flags.go:64] FLAG: --vmodule="" Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385078 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.385081 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385196 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385201 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385204 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385206 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385209 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385212 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385221 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385223 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385226 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385228 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385231 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385234 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385236 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385239 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:49.392684 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385242 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385246 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385250 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385254 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385257 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385259 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385262 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385265 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385268 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385271 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385273 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385276 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385278 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385281 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385283 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385286 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385289 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385291 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385294 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385296 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:49.393208 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385299 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385301 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385304 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385306 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385311 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385314 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385317 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385320 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385323 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385325 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385328 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385330 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385333 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385336 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385338 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385341 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385343 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385346 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385349 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385351 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:49.393784 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385354 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385356 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385359 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385362 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385364 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385367 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385370 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385372 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385375 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385378 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385380 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385383 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385385 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385388 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385390 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385394 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385401 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385404 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385407 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:49.394280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385409 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385413 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385417 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385419 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385422 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385425 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385427 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385430 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385433 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385435 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385437 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385440 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385442 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385445 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385447 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385450 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385452 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385455 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385457 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385460 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:49.394753 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385462 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385465 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385467 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385471 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385474 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.385476 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.386180 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.392826 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.392843 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.392856 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.392861 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392929 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392934 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392937 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392940 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:49.395236 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392943 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392946 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392949 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392952 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392954 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392957 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392959 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392962 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392965 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392967 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392970 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392973 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392975 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392978 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392980 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392983 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392986 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392988 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392991 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392994 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:49.395627 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.392997 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393001 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393004 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393007 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393010 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393014 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393017 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393020 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393023 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393025 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393028 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393031 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393033 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393036 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393038 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393041 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393044 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393046 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393049 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:49.396139 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393053 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393057 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393060 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393070 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393073 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393076 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393079 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393082 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393085 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393088 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393091 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393093 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393096 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393098 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393101 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393104 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393106 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393109 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393113 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393116 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:49.396616 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393119 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393122 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393124 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393127 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393129 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393132 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393135 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393137 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393140 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393142 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393144 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393147 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393150 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393152 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393155 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393157 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393161 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393165 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393168 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:49.397128 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393172 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393174 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393177 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393179 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393182 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393185 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393187 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393189 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393192 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393194 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393197 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393200 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393203 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393206 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393209 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393211 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:49.397586 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393214 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.393219 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393332 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393337 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393340 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393343 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393346 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393348 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393351 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393354 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393357 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393359 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393362 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393364 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393367 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 17:48:49.397994 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393369 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393372 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393375 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393377 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393380 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393383 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393385 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393388 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393390 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393393 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393395 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393398 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393401 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393404 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393407 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393410 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393413 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393415 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393419 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 17:48:49.398366 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393422 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393425 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393429 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393433 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393436 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393439 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393442 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393445 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393447 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393451 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393453 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393456 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393458 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393461 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393464 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393466 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393469 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393472 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393474 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393476 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 17:48:49.398942 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393479 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393481 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393484 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393486 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393490 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393493 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393495 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393498 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393500 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393503 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393506 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393508 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393511 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393513 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393517 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393520 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393523 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393526 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393529 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 17:48:49.399411 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393531 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393534 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393537 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393539 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393542 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393544 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393547 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393550 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393552 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393555 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393557 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393560 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393563 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393565 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393568 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393570 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393572 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393575 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393578 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393581 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 17:48:49.399889 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393583 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393586 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393588 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393591 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393594 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393596 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393615 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:49.393619 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.393625 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.393730 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.395927 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.397462 2579 server.go:1019] "Starting client certificate rotation" Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.397561 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 17:48:49.400373 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.397587 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 17:48:49.400804 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.400790 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 17:48:49.404781 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.404764 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 17:48:49.420636 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.420617 2579 log.go:25] "Validated CRI v1 runtime API" Jun 05 17:48:49.423108 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.423089 2579 log.go:25] "Validated CRI v1 image API" Jun 05 17:48:49.423922 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.423898 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 17:48:49.426513 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.426490 2579 fs.go:135] Filesystem UUIDs: map[04055ae4-204a-4836-af1a-a1533cc37972:/dev/nvme0n1p3 0b90551d-6258-45a5-9157-55f9bf038140:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 05 17:48:49.426623 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.426512 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 17:48:49.428109 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.428086 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 17:48:49.433785 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.433670 2579 manager.go:216] Machine: {Timestamp:2026-06-05 17:48:49.432315535 +0000 UTC m=+0.361364566 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088675 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec226857f60c8d4250364bdeda112da9 SystemUUID:ec226857-f60c-8d42-5036-4bdeda112da9 BootID:3f6b927e-c517-43b8-8827-c231b7a54201 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:76:61:c0:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:76:61:c0:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:d1:16:ee:a9:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 17:48:49.433785 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.433779 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 17:48:49.433907 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.433860 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 17:48:49.434994 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.434972 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 17:48:49.435123 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.434999 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-141.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 17:48:49.435775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.435758 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 17:48:49.435810 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.435778 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 17:48:49.435810 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.435791 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 17:48:49.436510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.436501 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 17:48:49.437683 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.437673 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 17:48:49.440924 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.440913 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 05 17:48:49.441044 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.441035 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 17:48:49.441082 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.441071 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 05 17:48:49.441082 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.441082 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 17:48:49.441140 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.441096 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 17:48:49.441140 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.441105 2579 kubelet.go:398] "Adding apiserver pod source" Jun 05 17:48:49.441140 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.441113 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 17:48:49.441482 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.441470 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 17:48:49.441562 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.441489 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 17:48:49.443732 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.443716 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 17:48:49.445482 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.445465 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 17:48:49.445523 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.445498 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 17:48:49.446059 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446047 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 17:48:49.446115 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446064 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 17:48:49.446115 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446070 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 17:48:49.446115 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446075 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 17:48:49.446115 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446084 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 17:48:49.446115 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446089 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 17:48:49.446251 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446237 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 17:48:49.446251 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446244 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 17:48:49.446301 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446252 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 17:48:49.446301 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446258 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 17:48:49.446301 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446267 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 17:48:49.446301 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.446275 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 17:48:49.447405 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.447396 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 17:48:49.447405 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.447405 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 17:48:49.452193 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.452115 2579 server.go:1268] "Started kubelet" Jun 05 17:48:49.452742 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.452268 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 17:48:49.452742 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.452412 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-141.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 17:48:49.452742 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.452648 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 17:48:49.452921 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.452849 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 17:48:49.453285 ip-10-0-139-141 systemd[1]: Started Kubernetes Kubelet. Jun 05 17:48:49.453772 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.453257 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 17:48:49.453772 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.453375 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 17:48:49.455457 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.455440 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 17:48:49.456213 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.456195 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 05 17:48:49.459566 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.458386 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18b640993604d3b8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-06-05 17:48:49.452069816 +0000 UTC m=+0.381118856,LastTimestamp:2026-06-05 17:48:49.452069816 +0000 UTC m=+0.381118856,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}" Jun 05 17:48:49.460662 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.460642 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 17:48:49.461346 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.461330 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 17:48:49.461411 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.461342 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 17:48:49.461706 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.461461 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:49.461953 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.461939 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 17:48:49.462070 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.461986 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 17:48:49.462070 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.462072 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 17:48:49.462211 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.462171 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 05 17:48:49.462211 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.462182 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 05 17:48:49.462310 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.462244 2579 factory.go:55] Registering systemd factory Jun 05 17:48:49.462310 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.462281 2579 factory.go:223] Registration of the systemd container factory successfully Jun 05 17:48:49.462508 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.462490 2579 factory.go:153] Registering CRI-O factory Jun 05 17:48:49.462508 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.462510 2579 factory.go:223] Registration of the crio container factory successfully Jun 05 17:48:49.462641 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.462561 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 17:48:49.462641 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.462584 2579 factory.go:103] Registering Raw factory Jun 05 17:48:49.462641 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.462615 2579 manager.go:1196] Started watching for new ooms in manager Jun 05 17:48:49.463307 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.463210 2579 manager.go:349] Starting recovery of all containers Jun 05 17:48:49.469964 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.469941 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 17:48:49.470070 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.470001 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 17:48:49.473432 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.473276 2579 manager.go:354] Recovery completed Jun 05 17:48:49.476353 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.476335 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sl498" Jun 05 17:48:49.477466 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.477455 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:49.479095 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.479075 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:49.479161 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.479109 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:49.479161 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.479122 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:49.480133 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.480120 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 17:48:49.480133 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.480127 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:49.480133 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.480132 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 17:48:49.480252 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.480147 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 05 17:48:49.480839 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.480825 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:49.480881 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.480850 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:49.480881 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.480866 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:49.481073 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.480991 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-141.ec2.internal.18b6409937a128f4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-141.ec2.internal,UID:ip-10-0-139-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-141.ec2.internal,},FirstTimestamp:2026-06-05 17:48:49.479092468 +0000 UTC m=+0.408141501,LastTimestamp:2026-06-05 17:48:49.479092468 +0000 UTC m=+0.408141501,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-141.ec2.internal,}" Jun 05 17:48:49.481302 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.481290 2579 policy_none.go:49] "None policy: Start" Jun 05 17:48:49.481345 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.481311 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 17:48:49.481345 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.481321 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 17:48:49.482406 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.482392 2579 policy_none.go:47] "Start" Jun 05 17:48:49.484049 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.484022 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sl498" Jun 05 17:48:49.525277 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.525254 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.526340 2579 manager.go:337] "Starting Device Plugin manager" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.526370 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.526383 2579 server.go:87] "Starting device plugin registration server" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.526561 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.526625 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.526650 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.526655 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.526672 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.526856 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.526925 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.526934 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.527007 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.527595 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.527800 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:49.529412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.528661 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:48:49.627828 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.627724 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal"] Jun 05 17:48:49.627828 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.627813 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:49.627828 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.627740 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:49.628765 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.628745 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:49.628894 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.628779 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:49.628894 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.628797 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:49.628894 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.628813 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:49.628894 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.628839 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:49.628894 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.628849 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:49.628894 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.628868 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.630150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.630137 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:49.630274 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.630256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.630371 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.630291 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:49.630794 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.630771 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:49.630882 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.630798 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:49.630882 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.630773 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:49.630882 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.630811 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:49.630882 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.630822 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:49.630882 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.630834 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:49.631976 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.631961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.632061 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.631990 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 17:48:49.632638 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.632625 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientMemory" Jun 05 17:48:49.632722 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.632652 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 17:48:49.632722 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.632666 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeHasSufficientPID" Jun 05 17:48:49.639049 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.639034 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.639123 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.639054 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-141.ec2.internal\": node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:49.661353 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.661331 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-141.ec2.internal\" not found" node="ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.662954 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.662935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3571460a153096d2b498cbc9c9ff386-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"a3571460a153096d2b498cbc9c9ff386\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.663054 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.662966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3571460a153096d2b498cbc9c9ff386-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"a3571460a153096d2b498cbc9c9ff386\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.663054 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.662989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/321216ca1922a00cb94cc622220890fa-config\") pod \"kube-apiserver-proxy-ip-10-0-139-141.ec2.internal\" (UID: \"321216ca1922a00cb94cc622220890fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.665901 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.665887 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-141.ec2.internal\" not found" node="ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.681181 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.681168 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:49.763621 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.763572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3571460a153096d2b498cbc9c9ff386-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"a3571460a153096d2b498cbc9c9ff386\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.763621 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.763619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/321216ca1922a00cb94cc622220890fa-config\") pod \"kube-apiserver-proxy-ip-10-0-139-141.ec2.internal\" (UID: \"321216ca1922a00cb94cc622220890fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.763760 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.763637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3571460a153096d2b498cbc9c9ff386-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"a3571460a153096d2b498cbc9c9ff386\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.763760 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.763684 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/321216ca1922a00cb94cc622220890fa-config\") pod \"kube-apiserver-proxy-ip-10-0-139-141.ec2.internal\" (UID: \"321216ca1922a00cb94cc622220890fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.763760 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.763681 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3571460a153096d2b498cbc9c9ff386-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"a3571460a153096d2b498cbc9c9ff386\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.763760 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.763738 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3571460a153096d2b498cbc9c9ff386-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal\" (UID: \"a3571460a153096d2b498cbc9c9ff386\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.781579 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.781552 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:49.882070 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.882009 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:49.965739 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.965712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.970394 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:49.970373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" Jun 05 17:48:49.982534 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:49.982514 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:50.083094 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:50.083058 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:50.183621 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:50.183526 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:50.284087 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:50.284057 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:50.384574 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:50.384541 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:50.396713 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.396691 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 17:48:50.396850 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.396833 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 17:48:50.485098 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:50.485068 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-141.ec2.internal\" not found" Jun 05 17:48:50.486167 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.486134 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 17:43:49 +0000 UTC" deadline="2028-03-05 05:48:02.752502406 +0000 UTC" Jun 05 17:48:50.486225 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.486167 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15323h59m12.266338523s" Jun 05 17:48:50.512238 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.512217 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:48:50.518515 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:50.518482 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3571460a153096d2b498cbc9c9ff386.slice/crio-ec8b0e535c7acaab9c23fe438326f66d68633dc7d14cf0d3a81d0005f47fa2a1 WatchSource:0}: Error finding container ec8b0e535c7acaab9c23fe438326f66d68633dc7d14cf0d3a81d0005f47fa2a1: Status 404 returned error can't find the container with id ec8b0e535c7acaab9c23fe438326f66d68633dc7d14cf0d3a81d0005f47fa2a1 Jun 05 17:48:50.518917 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:50.518900 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321216ca1922a00cb94cc622220890fa.slice/crio-d8ac3a2d82416c803aeb9b39ed8fb86bfb2d72eee04ed4c4c6fa47fdd4f8ac87 WatchSource:0}: Error finding container d8ac3a2d82416c803aeb9b39ed8fb86bfb2d72eee04ed4c4c6fa47fdd4f8ac87: Status 404 returned error can't find the container with id d8ac3a2d82416c803aeb9b39ed8fb86bfb2d72eee04ed4c4c6fa47fdd4f8ac87 Jun 05 17:48:50.522651 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.522634 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 17:48:50.531102 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.531057 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" event={"ID":"a3571460a153096d2b498cbc9c9ff386","Type":"ContainerStarted","Data":"ec8b0e535c7acaab9c23fe438326f66d68633dc7d14cf0d3a81d0005f47fa2a1"} Jun 05 17:48:50.531966 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.531949 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" event={"ID":"321216ca1922a00cb94cc622220890fa","Type":"ContainerStarted","Data":"d8ac3a2d82416c803aeb9b39ed8fb86bfb2d72eee04ed4c4c6fa47fdd4f8ac87"} Jun 05 17:48:50.561948 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.561925 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" Jun 05 17:48:50.576662 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.576645 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 17:48:50.578475 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.578462 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" Jun 05 17:48:50.587497 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.587480 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 17:48:50.834216 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.834131 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:48:50.877020 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:50.876982 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:48:51.272259 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.272182 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 17:48:51.442387 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.442358 2579 apiserver.go:52] "Watching apiserver" Jun 05 17:48:51.450417 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.450395 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 17:48:51.450916 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.450886 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-dcgl9","openshift-ovn-kubernetes/ovnkube-node-l9z9x","kube-system/global-pull-secret-syncer-q4k7f","kube-system/konnectivity-agent-9mmgl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh","openshift-cluster-node-tuning-operator/tuned-w9hb5","openshift-dns/node-resolver-ptprv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal","openshift-multus/multus-5vlgq","openshift-multus/multus-additional-cni-plugins-phbl5","kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal","openshift-image-registry/node-ca-fvqnk","openshift-multus/network-metrics-daemon-kpv87","openshift-network-diagnostics/network-check-target-jsr47"] Jun 05 17:48:51.452740 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.452717 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.454106 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.454083 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:51.454213 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.454155 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:48:51.455232 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.455215 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:51.455323 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.455268 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:48:51.455962 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.455940 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 17:48:51.455962 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.455954 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 17:48:51.456111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.456075 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nqgr6\"" Jun 05 17:48:51.456197 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.456176 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 17:48:51.456326 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.456310 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 17:48:51.456482 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.456463 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 17:48:51.456963 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.456945 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.458168 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.458148 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.459427 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.459407 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.459678 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.459660 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 17:48:51.459774 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.459722 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ktd66\"" Jun 05 17:48:51.459872 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.459854 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 17:48:51.460732 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.460705 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 17:48:51.460814 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.460742 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.460951 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.460934 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 17:48:51.461138 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.461118 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 17:48:51.461203 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.461121 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 17:48:51.461261 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.461197 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hsvr2\"" Jun 05 17:48:51.462021 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.462001 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 17:48:51.462469 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.462444 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.463822 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.463392 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sx6z9\"" Jun 05 17:48:51.463822 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.463730 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 17:48:51.463822 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.463792 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:48:51.464380 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.464362 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 17:48:51.464771 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.464751 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6t2zd\"" Jun 05 17:48:51.465857 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.465375 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 17:48:51.465857 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.465637 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wzcmm\"" Jun 05 17:48:51.465857 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.465813 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 17:48:51.467143 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.467124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.468998 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.468968 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.469891 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.469870 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 17:48:51.469994 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.469935 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hr64p\"" Jun 05 17:48:51.470062 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.470047 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 17:48:51.470128 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.470106 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 17:48:51.470128 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.470118 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 17:48:51.470462 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.470334 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 17:48:51.470462 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.470357 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 17:48:51.471997 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.471765 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:48:51.471997 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.471881 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 17:48:51.471997 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.471907 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:48:51.472226 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472205 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/601e5e3a-9aab-4925-8397-6e07d29e761f-host\") pod \"node-ca-fvqnk\" (UID: \"601e5e3a-9aab-4925-8397-6e07d29e761f\") " pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.472271 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472240 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-sysconfig\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.472271 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-kubernetes\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.472345 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-sysctl-d\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.472345 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c617957-864e-494a-8248-5d034bae80ee-tmp\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.472345 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472317 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhxl7\"" Jun 05 17:48:51.472345 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-socket-dir-parent\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.472511 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-systemd\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.472511 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-host\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.472511 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-registration-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.472511 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-run\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.472511 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-cni-dir\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.472511 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-daemon-config\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.472511 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z4xb\" (UniqueName: \"kubernetes.io/projected/cace007d-0b4f-4062-98dc-e5f5784d2ff6-kube-api-access-7z4xb\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.472777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472544 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 17:48:51.472777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjwg6\" (UniqueName: \"kubernetes.io/projected/978fa5ec-4162-4e32-9d8c-c1820792f000-kube-api-access-pjwg6\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.472777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a9dc88-1354-44a8-9e1b-b2333eb4aaef-tmp-dir\") pod \"node-resolver-ptprv\" (UID: \"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef\") " pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.472777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cszqv\" (UniqueName: \"kubernetes.io/projected/ecd92b6d-f844-48c9-917a-0c65a7b05adb-kube-api-access-cszqv\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:51.472777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ld96\" (UniqueName: \"kubernetes.io/projected/601e5e3a-9aab-4925-8397-6e07d29e761f-kube-api-access-5ld96\") pod \"node-ca-fvqnk\" (UID: \"601e5e3a-9aab-4925-8397-6e07d29e761f\") " pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.472777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-hostroot\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.472777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4a9dc88-1354-44a8-9e1b-b2333eb4aaef-hosts-file\") pod \"node-resolver-ptprv\" (UID: \"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef\") " pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.472777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472776 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-etc-selinux\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.473111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472793 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd615d88-cab4-4bdf-a3e7-b5af561ce166-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.473111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-run-multus-certs\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl22h\" (UniqueName: \"kubernetes.io/projected/d4a9dc88-1354-44a8-9e1b-b2333eb4aaef-kube-api-access-wl22h\") pod \"node-resolver-ptprv\" (UID: \"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef\") " pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.473111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-socket-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.473111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.472969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxsmz\" (UniqueName: \"kubernetes.io/projected/0c617957-864e-494a-8248-5d034bae80ee-kube-api-access-cxsmz\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.473111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473021 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-cnibin\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473053 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-run-netns\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c617957-864e-494a-8248-5d034bae80ee-etc-tuned\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.473483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-os-release\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.473483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-lib-modules\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.473483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-var-lib-kubelet\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.473483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473198 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-var-lib-cni-multus\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh88m\" (UniqueName: \"kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m\") pod \"network-check-target-jsr47\" (UID: \"b44b575e-8f8e-4c7d-9afa-89bf3496f307\") " pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:51.473483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd615d88-cab4-4bdf-a3e7-b5af561ce166-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.473483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/978fa5ec-4162-4e32-9d8c-c1820792f000-cni-binary-copy\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-var-lib-kubelet\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-conf-dir\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-device-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-var-lib-cni-bin\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/601e5e3a-9aab-4925-8397-6e07d29e761f-serviceca\") pod \"node-ca-fvqnk\" (UID: \"601e5e3a-9aab-4925-8397-6e07d29e761f\") " pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-modprobe-d\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-system-cni-dir\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-os-release\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473805 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-run-k8s-cni-cncf-io\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-sysctl-conf\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473863 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-etc-kubernetes\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.473902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.474485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-system-cni-dir\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.474485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-cnibin\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.474485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.473986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bdtd\" (UniqueName: \"kubernetes.io/projected/fd615d88-cab4-4bdf-a3e7-b5af561ce166-kube-api-access-6bdtd\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.474485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.474009 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-sys\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.474485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.474030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd615d88-cab4-4bdf-a3e7-b5af561ce166-cni-binary-copy\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.474485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.474051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-sys-fs\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.474485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.474179 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:51.474485 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.474242 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:48:51.474485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.474471 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 17:48:51.474914 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.474647 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 17:48:51.474914 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.474733 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mhnjc\"" Jun 05 17:48:51.478590 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.478569 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 17:48:51.500532 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.500513 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wf7cn" Jun 05 17:48:51.508950 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.508927 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wf7cn" Jun 05 17:48:51.563417 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.563343 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 17:48:51.574775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.574749 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-kubelet-config\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:51.574941 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.574789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-var-lib-cni-bin\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.574941 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.574818 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-run-ovn-kubernetes\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.574941 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.574867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-cni-bin\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.574941 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.574922 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-var-lib-cni-bin\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.574941 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.574930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-env-overrides\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.575217 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.574965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.575217 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/601e5e3a-9aab-4925-8397-6e07d29e761f-serviceca\") pod \"node-ca-fvqnk\" (UID: \"601e5e3a-9aab-4925-8397-6e07d29e761f\") " pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.575217 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575130 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.575217 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-modprobe-d\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.575217 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-system-cni-dir\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.575217 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-os-release\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-run-k8s-cni-cncf-io\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575249 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-node-log\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-sysctl-conf\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575291 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-system-cni-dir\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-ovnkube-script-lib\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575309 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-run-k8s-cni-cncf-io\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575309 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-modprobe-d\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fccb9ffa-b845-4dda-b341-8e57947f0a19-agent-certs\") pod \"konnectivity-agent-9mmgl\" (UID: \"fccb9ffa-b845-4dda-b341-8e57947f0a19\") " pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-etc-kubernetes\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575426 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-etc-kubernetes\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-system-cni-dir\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575473 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-system-cni-dir\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-cnibin\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.575483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575489 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-sysctl-conf\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575505 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-cnibin\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575507 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bdtd\" (UniqueName: \"kubernetes.io/projected/fd615d88-cab4-4bdf-a3e7-b5af561ce166-kube-api-access-6bdtd\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575515 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/601e5e3a-9aab-4925-8397-6e07d29e761f-serviceca\") pod \"node-ca-fvqnk\" (UID: \"601e5e3a-9aab-4925-8397-6e07d29e761f\") " pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-sys\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd615d88-cab4-4bdf-a3e7-b5af561ce166-cni-binary-copy\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-sys-fs\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575651 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-sys\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575708 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-sys-fs\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-systemd-units\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-slash\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-var-lib-openvswitch\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-etc-openvswitch\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-cni-netd\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/601e5e3a-9aab-4925-8397-6e07d29e761f-host\") pod \"node-ca-fvqnk\" (UID: \"601e5e3a-9aab-4925-8397-6e07d29e761f\") " pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575847 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-os-release\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.576156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-sysconfig\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-kubernetes\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-sysctl-d\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/601e5e3a-9aab-4925-8397-6e07d29e761f-host\") pod \"node-ca-fvqnk\" (UID: \"601e5e3a-9aab-4925-8397-6e07d29e761f\") " pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575941 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-sysconfig\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c617957-864e-494a-8248-5d034bae80ee-tmp\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.575980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-socket-dir-parent\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576017 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-kubernetes\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576023 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-run-openvswitch\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576076 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-systemd\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576130 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd615d88-cab4-4bdf-a3e7-b5af561ce166-cni-binary-copy\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576137 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-sysctl-d\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-host\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576081 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-socket-dir-parent\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-registration-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576206 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-host\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.576925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-run\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576228 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-registration-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576213 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-cni-dir\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-daemon-config\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z4xb\" (UniqueName: \"kubernetes.io/projected/cace007d-0b4f-4062-98dc-e5f5784d2ff6-kube-api-access-7z4xb\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576244 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-run\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-run-netns\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576190 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-etc-systemd\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-run-ovn\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-log-socket\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576451 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-cni-dir\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjwg6\" (UniqueName: \"kubernetes.io/projected/978fa5ec-4162-4e32-9d8c-c1820792f000-kube-api-access-pjwg6\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a9dc88-1354-44a8-9e1b-b2333eb4aaef-tmp-dir\") pod \"node-resolver-ptprv\" (UID: \"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef\") " pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cszqv\" (UniqueName: \"kubernetes.io/projected/ecd92b6d-f844-48c9-917a-0c65a7b05adb-kube-api-access-cszqv\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ld96\" (UniqueName: \"kubernetes.io/projected/601e5e3a-9aab-4925-8397-6e07d29e761f-kube-api-access-5ld96\") pod \"node-ca-fvqnk\" (UID: \"601e5e3a-9aab-4925-8397-6e07d29e761f\") " pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-hostroot\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.577775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4a9dc88-1354-44a8-9e1b-b2333eb4aaef-hosts-file\") pod \"node-resolver-ptprv\" (UID: \"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef\") " pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-etc-selinux\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576805 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-run-systemd\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576819 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-hostroot\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576825 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-daemon-config\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576828 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4a9dc88-1354-44a8-9e1b-b2333eb4aaef-hosts-file\") pod \"node-resolver-ptprv\" (UID: \"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef\") " pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a35571-51ad-40d3-b63a-65f791b13cbe-host-slash\") pod \"iptables-alerter-dcgl9\" (UID: \"85a35571-51ad-40d3-b63a-65f791b13cbe\") " pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd615d88-cab4-4bdf-a3e7-b5af561ce166-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-run-multus-certs\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576912 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-etc-selinux\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl22h\" (UniqueName: \"kubernetes.io/projected/d4a9dc88-1354-44a8-9e1b-b2333eb4aaef-kube-api-access-wl22h\") pod \"node-resolver-ptprv\" (UID: \"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef\") " pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576924 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4a9dc88-1354-44a8-9e1b-b2333eb4aaef-tmp-dir\") pod \"node-resolver-ptprv\" (UID: \"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef\") " pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-socket-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576970 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-kubelet\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.576993 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-run-multus-certs\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9xrd\" (UniqueName: \"kubernetes.io/projected/85a35571-51ad-40d3-b63a-65f791b13cbe-kube-api-access-v9xrd\") pod \"iptables-alerter-dcgl9\" (UID: \"85a35571-51ad-40d3-b63a-65f791b13cbe\") " pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxsmz\" (UniqueName: \"kubernetes.io/projected/0c617957-864e-494a-8248-5d034bae80ee-kube-api-access-cxsmz\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.578654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577065 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-socket-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-cnibin\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-run-netns\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577152 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fccb9ffa-b845-4dda-b341-8e57947f0a19-konnectivity-ca\") pod \"konnectivity-agent-9mmgl\" (UID: \"fccb9ffa-b845-4dda-b341-8e57947f0a19\") " pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c617957-864e-494a-8248-5d034bae80ee-etc-tuned\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-os-release\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577204 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-cnibin\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-lib-modules\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-var-lib-kubelet\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-var-lib-cni-multus\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh88m\" (UniqueName: \"kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m\") pod \"network-check-target-jsr47\" (UID: \"b44b575e-8f8e-4c7d-9afa-89bf3496f307\") " pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577332 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-var-lib-kubelet\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85a35571-51ad-40d3-b63a-65f791b13cbe-iptables-alerter-script\") pod \"iptables-alerter-dcgl9\" (UID: \"85a35571-51ad-40d3-b63a-65f791b13cbe\") " pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577348 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd615d88-cab4-4bdf-a3e7-b5af561ce166-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577372 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-var-lib-cni-multus\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd615d88-cab4-4bdf-a3e7-b5af561ce166-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577496 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd615d88-cab4-4bdf-a3e7-b5af561ce166-os-release\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.579510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577513 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c617957-864e-494a-8248-5d034bae80ee-lib-modules\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577535 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-run-netns\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/978fa5ec-4162-4e32-9d8c-c1820792f000-cni-binary-copy\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-ovn-node-metrics-cert\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2twjx\" (UniqueName: \"kubernetes.io/projected/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-kube-api-access-2twjx\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-dbus\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-var-lib-kubelet\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-conf-dir\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-device-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.577916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-ovnkube-config\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.578001 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cace007d-0b4f-4062-98dc-e5f5784d2ff6-device-dir\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.578020 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd615d88-cab4-4bdf-a3e7-b5af561ce166-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.578098 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.578107 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/978fa5ec-4162-4e32-9d8c-c1820792f000-cni-binary-copy\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.578140 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-host-var-lib-kubelet\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.578158 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/978fa5ec-4162-4e32-9d8c-c1820792f000-multus-conf-dir\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.580338 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.578190 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs podName:ecd92b6d-f844-48c9-917a-0c65a7b05adb nodeName:}" failed. No retries permitted until 2026-06-05 17:48:52.078170423 +0000 UTC m=+3.007219449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs") pod "network-metrics-daemon-kpv87" (UID: "ecd92b6d-f844-48c9-917a-0c65a7b05adb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:48:51.581254 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.579579 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c617957-864e-494a-8248-5d034bae80ee-etc-tuned\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.581254 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.579637 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c617957-864e-494a-8248-5d034bae80ee-tmp\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.583678 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.583654 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:48:51.583678 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.583681 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:48:51.583855 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.583695 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fh88m for pod openshift-network-diagnostics/network-check-target-jsr47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:48:51.583855 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.583746 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m podName:b44b575e-8f8e-4c7d-9afa-89bf3496f307 nodeName:}" failed. No retries permitted until 2026-06-05 17:48:52.083729591 +0000 UTC m=+3.012778609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fh88m" (UniqueName: "kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m") pod "network-check-target-jsr47" (UID: "b44b575e-8f8e-4c7d-9afa-89bf3496f307") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:48:51.586420 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.586271 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z4xb\" (UniqueName: \"kubernetes.io/projected/cace007d-0b4f-4062-98dc-e5f5784d2ff6-kube-api-access-7z4xb\") pod \"aws-ebs-csi-driver-node-vmmvh\" (UID: \"cace007d-0b4f-4062-98dc-e5f5784d2ff6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.586420 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.586398 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cszqv\" (UniqueName: \"kubernetes.io/projected/ecd92b6d-f844-48c9-917a-0c65a7b05adb-kube-api-access-cszqv\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:51.586572 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.586552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bdtd\" (UniqueName: \"kubernetes.io/projected/fd615d88-cab4-4bdf-a3e7-b5af561ce166-kube-api-access-6bdtd\") pod \"multus-additional-cni-plugins-phbl5\" (UID: \"fd615d88-cab4-4bdf-a3e7-b5af561ce166\") " pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.586572 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.586567 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ld96\" (UniqueName: \"kubernetes.io/projected/601e5e3a-9aab-4925-8397-6e07d29e761f-kube-api-access-5ld96\") pod \"node-ca-fvqnk\" (UID: \"601e5e3a-9aab-4925-8397-6e07d29e761f\") " pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.587567 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.587525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjwg6\" (UniqueName: \"kubernetes.io/projected/978fa5ec-4162-4e32-9d8c-c1820792f000-kube-api-access-pjwg6\") pod \"multus-5vlgq\" (UID: \"978fa5ec-4162-4e32-9d8c-c1820792f000\") " pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.588784 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.588765 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxsmz\" (UniqueName: \"kubernetes.io/projected/0c617957-864e-494a-8248-5d034bae80ee-kube-api-access-cxsmz\") pod \"tuned-w9hb5\" (UID: \"0c617957-864e-494a-8248-5d034bae80ee\") " pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.589896 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.589875 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl22h\" (UniqueName: \"kubernetes.io/projected/d4a9dc88-1354-44a8-9e1b-b2333eb4aaef-kube-api-access-wl22h\") pod \"node-resolver-ptprv\" (UID: \"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef\") " pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.678266 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678234 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-run-netns\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678266 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-run-ovn\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-log-socket\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-run-systemd\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678345 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-run-ovn\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678370 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a35571-51ad-40d3-b63a-65f791b13cbe-host-slash\") pod \"iptables-alerter-dcgl9\" (UID: \"85a35571-51ad-40d3-b63a-65f791b13cbe\") " pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-kubelet\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678408 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-log-socket\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678414 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9xrd\" (UniqueName: \"kubernetes.io/projected/85a35571-51ad-40d3-b63a-65f791b13cbe-kube-api-access-v9xrd\") pod \"iptables-alerter-dcgl9\" (UID: \"85a35571-51ad-40d3-b63a-65f791b13cbe\") " pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678426 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-run-systemd\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678443 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-run-netns\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fccb9ffa-b845-4dda-b341-8e57947f0a19-konnectivity-ca\") pod \"konnectivity-agent-9mmgl\" (UID: \"fccb9ffa-b845-4dda-b341-8e57947f0a19\") " pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678482 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-kubelet\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.678496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678477 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85a35571-51ad-40d3-b63a-65f791b13cbe-host-slash\") pod \"iptables-alerter-dcgl9\" (UID: \"85a35571-51ad-40d3-b63a-65f791b13cbe\") " pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85a35571-51ad-40d3-b63a-65f791b13cbe-iptables-alerter-script\") pod \"iptables-alerter-dcgl9\" (UID: \"85a35571-51ad-40d3-b63a-65f791b13cbe\") " pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-ovn-node-metrics-cert\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2twjx\" (UniqueName: \"kubernetes.io/projected/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-kube-api-access-2twjx\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-dbus\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-ovnkube-config\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-kubelet-config\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-run-ovn-kubernetes\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-cni-bin\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-env-overrides\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-node-log\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678931 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-dbus\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-ovnkube-script-lib\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678986 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-node-log\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.678998 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-run-ovn-kubernetes\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fccb9ffa-b845-4dda-b341-8e57947f0a19-agent-certs\") pod \"konnectivity-agent-9mmgl\" (UID: \"fccb9ffa-b845-4dda-b341-8e57947f0a19\") " pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679026 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fccb9ffa-b845-4dda-b341-8e57947f0a19-konnectivity-ca\") pod \"konnectivity-agent-9mmgl\" (UID: \"fccb9ffa-b845-4dda-b341-8e57947f0a19\") " pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:48:51.679154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679055 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-cni-bin\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-systemd-units\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-slash\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679106 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-kubelet-config\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-var-lib-openvswitch\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679146 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-slash\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-etc-openvswitch\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-cni-netd\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679181 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-etc-openvswitch\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679208 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-systemd-units\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679274 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85a35571-51ad-40d3-b63a-65f791b13cbe-iptables-alerter-script\") pod \"iptables-alerter-dcgl9\" (UID: \"85a35571-51ad-40d3-b63a-65f791b13cbe\") " pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679523 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-run-openvswitch\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-run-openvswitch\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679570 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679506 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-host-cni-netd\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.679178 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-var-lib-openvswitch\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.679698 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:48:51.679910 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:51.679800 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret podName:3db2f471-0ac4-4179-8c24-5a8ef8c0fba0 nodeName:}" failed. No retries permitted until 2026-06-05 17:48:52.179778577 +0000 UTC m=+3.108827608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret") pod "global-pull-secret-syncer-q4k7f" (UID: "3db2f471-0ac4-4179-8c24-5a8ef8c0fba0") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:48:51.680633 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.680094 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-ovnkube-config\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.680633 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.680111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-env-overrides\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.680633 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.680269 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-ovnkube-script-lib\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.680958 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.680937 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-ovn-node-metrics-cert\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.681380 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.681364 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fccb9ffa-b845-4dda-b341-8e57947f0a19-agent-certs\") pod \"konnectivity-agent-9mmgl\" (UID: \"fccb9ffa-b845-4dda-b341-8e57947f0a19\") " pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:48:51.686856 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.686835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9xrd\" (UniqueName: \"kubernetes.io/projected/85a35571-51ad-40d3-b63a-65f791b13cbe-kube-api-access-v9xrd\") pod \"iptables-alerter-dcgl9\" (UID: \"85a35571-51ad-40d3-b63a-65f791b13cbe\") " pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.687023 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.687008 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2twjx\" (UniqueName: \"kubernetes.io/projected/88cc35cb-116e-4ba6-b2fc-0b37b447fb08-kube-api-access-2twjx\") pod \"ovnkube-node-l9z9x\" (UID: \"88cc35cb-116e-4ba6-b2fc-0b37b447fb08\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.764748 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.764709 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-phbl5" Jun 05 17:48:51.774447 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.774419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fvqnk" Jun 05 17:48:51.782331 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.782310 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" Jun 05 17:48:51.787475 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.787453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" Jun 05 17:48:51.794085 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.794064 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5vlgq" Jun 05 17:48:51.801086 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.801067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ptprv" Jun 05 17:48:51.808058 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.808038 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:48:51.814942 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.814877 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dcgl9" Jun 05 17:48:51.820502 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:51.820485 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:48:52.083441 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.083340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:52.083595 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:52.083512 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:48:52.083595 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:52.083590 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs podName:ecd92b6d-f844-48c9-917a-0c65a7b05adb nodeName:}" failed. No retries permitted until 2026-06-05 17:48:53.083570902 +0000 UTC m=+4.012619936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs") pod "network-metrics-daemon-kpv87" (UID: "ecd92b6d-f844-48c9-917a-0c65a7b05adb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:48:52.184673 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.184629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:52.184843 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.184714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh88m\" (UniqueName: \"kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m\") pod \"network-check-target-jsr47\" (UID: \"b44b575e-8f8e-4c7d-9afa-89bf3496f307\") " pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:52.184843 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:52.184804 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:48:52.184957 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:52.184878 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret podName:3db2f471-0ac4-4179-8c24-5a8ef8c0fba0 nodeName:}" failed. No retries permitted until 2026-06-05 17:48:53.18486241 +0000 UTC m=+4.113911430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret") pod "global-pull-secret-syncer-q4k7f" (UID: "3db2f471-0ac4-4179-8c24-5a8ef8c0fba0") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:48:52.184957 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:52.184876 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:48:52.184957 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:52.184904 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:48:52.184957 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:52.184918 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fh88m for pod openshift-network-diagnostics/network-check-target-jsr47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:48:52.185160 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:52.184964 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m podName:b44b575e-8f8e-4c7d-9afa-89bf3496f307 nodeName:}" failed. No retries permitted until 2026-06-05 17:48:53.184950679 +0000 UTC m=+4.113999695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh88m" (UniqueName: "kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m") pod "network-check-target-jsr47" (UID: "b44b575e-8f8e-4c7d-9afa-89bf3496f307") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:48:52.341975 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:52.341939 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c617957_864e_494a_8248_5d034bae80ee.slice/crio-604d5d217ed8881097466d018195bc767f73af472aed5e95b9317b20b5f9b00f WatchSource:0}: Error finding container 604d5d217ed8881097466d018195bc767f73af472aed5e95b9317b20b5f9b00f: Status 404 returned error can't find the container with id 604d5d217ed8881097466d018195bc767f73af472aed5e95b9317b20b5f9b00f Jun 05 17:48:52.343391 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:52.343284 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd615d88_cab4_4bdf_a3e7_b5af561ce166.slice/crio-f5c8385c5d8f5ea18b8758bb09d5cd45b351d89492572133b630fe7208cbda13 WatchSource:0}: Error finding container f5c8385c5d8f5ea18b8758bb09d5cd45b351d89492572133b630fe7208cbda13: Status 404 returned error can't find the container with id f5c8385c5d8f5ea18b8758bb09d5cd45b351d89492572133b630fe7208cbda13 Jun 05 17:48:52.345665 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:52.345638 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a35571_51ad_40d3_b63a_65f791b13cbe.slice/crio-95cb8b818de6d0d956a2feddf2d90766a00116423d003b2f63979536ddc4816f WatchSource:0}: Error finding container 95cb8b818de6d0d956a2feddf2d90766a00116423d003b2f63979536ddc4816f: Status 404 returned error can't find the container with id 95cb8b818de6d0d956a2feddf2d90766a00116423d003b2f63979536ddc4816f Jun 05 17:48:52.346521 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:52.346494 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88cc35cb_116e_4ba6_b2fc_0b37b447fb08.slice/crio-9f8cc2e4f266c051f6d4f7f757f54bba93abf0867594dad7dec9e4400093b120 WatchSource:0}: Error finding container 9f8cc2e4f266c051f6d4f7f757f54bba93abf0867594dad7dec9e4400093b120: Status 404 returned error can't find the container with id 9f8cc2e4f266c051f6d4f7f757f54bba93abf0867594dad7dec9e4400093b120 Jun 05 17:48:52.348928 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:52.348896 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcace007d_0b4f_4062_98dc_e5f5784d2ff6.slice/crio-6497dee1c06a6b3758968184c822a0ed1618274c7942702c46c278397e8af5e5 WatchSource:0}: Error finding container 6497dee1c06a6b3758968184c822a0ed1618274c7942702c46c278397e8af5e5: Status 404 returned error can't find the container with id 6497dee1c06a6b3758968184c822a0ed1618274c7942702c46c278397e8af5e5 Jun 05 17:48:52.349568 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:52.349544 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a9dc88_1354_44a8_9e1b_b2333eb4aaef.slice/crio-7a3730c206b1cb4b041e4700502be2c381acc785724301eb30d2cb8b22b76dd1 WatchSource:0}: Error finding container 7a3730c206b1cb4b041e4700502be2c381acc785724301eb30d2cb8b22b76dd1: Status 404 returned error can't find the container with id 7a3730c206b1cb4b041e4700502be2c381acc785724301eb30d2cb8b22b76dd1 Jun 05 17:48:52.351445 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:52.351276 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccb9ffa_b845_4dda_b341_8e57947f0a19.slice/crio-078e7373ab9b924c0659e18716ce03c6799620c8b4fe09549f97006e36d93bf5 WatchSource:0}: Error finding container 078e7373ab9b924c0659e18716ce03c6799620c8b4fe09549f97006e36d93bf5: Status 404 returned error can't find the container with id 078e7373ab9b924c0659e18716ce03c6799620c8b4fe09549f97006e36d93bf5 Jun 05 17:48:52.352503 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:52.352442 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601e5e3a_9aab_4925_8397_6e07d29e761f.slice/crio-b03a747a2cc8506f44d9e1a9d8a18463c5403674d9478c2826c1326b22c8e392 WatchSource:0}: Error finding container b03a747a2cc8506f44d9e1a9d8a18463c5403674d9478c2826c1326b22c8e392: Status 404 returned error can't find the container with id b03a747a2cc8506f44d9e1a9d8a18463c5403674d9478c2826c1326b22c8e392 Jun 05 17:48:52.353382 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:48:52.353357 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978fa5ec_4162_4e32_9d8c_c1820792f000.slice/crio-0bc244919d7fa338b7ef21b3df2917f13b7e2df65548283238d43bd4cb2479b4 WatchSource:0}: Error finding container 0bc244919d7fa338b7ef21b3df2917f13b7e2df65548283238d43bd4cb2479b4: Status 404 returned error can't find the container with id 0bc244919d7fa338b7ef21b3df2917f13b7e2df65548283238d43bd4cb2479b4 Jun 05 17:48:52.511151 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.510965 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 17:43:51 +0000 UTC" deadline="2028-03-17 07:43:54.34318654 +0000 UTC" Jun 05 17:48:52.511151 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.511147 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15613h55m1.832043717s" Jun 05 17:48:52.537552 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.537521 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9mmgl" event={"ID":"fccb9ffa-b845-4dda-b341-8e57947f0a19","Type":"ContainerStarted","Data":"078e7373ab9b924c0659e18716ce03c6799620c8b4fe09549f97006e36d93bf5"} Jun 05 17:48:52.538728 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.538694 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" event={"ID":"88cc35cb-116e-4ba6-b2fc-0b37b447fb08","Type":"ContainerStarted","Data":"9f8cc2e4f266c051f6d4f7f757f54bba93abf0867594dad7dec9e4400093b120"} Jun 05 17:48:52.540144 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.540094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ptprv" event={"ID":"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef","Type":"ContainerStarted","Data":"7a3730c206b1cb4b041e4700502be2c381acc785724301eb30d2cb8b22b76dd1"} Jun 05 17:48:52.541155 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.541126 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dcgl9" event={"ID":"85a35571-51ad-40d3-b63a-65f791b13cbe","Type":"ContainerStarted","Data":"95cb8b818de6d0d956a2feddf2d90766a00116423d003b2f63979536ddc4816f"} Jun 05 17:48:52.542182 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.542161 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vlgq" event={"ID":"978fa5ec-4162-4e32-9d8c-c1820792f000","Type":"ContainerStarted","Data":"0bc244919d7fa338b7ef21b3df2917f13b7e2df65548283238d43bd4cb2479b4"} Jun 05 17:48:52.543534 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.543511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" event={"ID":"cace007d-0b4f-4062-98dc-e5f5784d2ff6","Type":"ContainerStarted","Data":"6497dee1c06a6b3758968184c822a0ed1618274c7942702c46c278397e8af5e5"} Jun 05 17:48:52.545503 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.545475 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phbl5" event={"ID":"fd615d88-cab4-4bdf-a3e7-b5af561ce166","Type":"ContainerStarted","Data":"f5c8385c5d8f5ea18b8758bb09d5cd45b351d89492572133b630fe7208cbda13"} Jun 05 17:48:52.547490 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.547470 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" event={"ID":"0c617957-864e-494a-8248-5d034bae80ee","Type":"ContainerStarted","Data":"604d5d217ed8881097466d018195bc767f73af472aed5e95b9317b20b5f9b00f"} Jun 05 17:48:52.549495 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.549474 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" event={"ID":"321216ca1922a00cb94cc622220890fa","Type":"ContainerStarted","Data":"07669f7f6bc03350cff2cb70bbb5b091ab5a3bb6eb3c682ce1aab5fffab1bbf0"} Jun 05 17:48:52.550743 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.550725 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fvqnk" event={"ID":"601e5e3a-9aab-4925-8397-6e07d29e761f","Type":"ContainerStarted","Data":"b03a747a2cc8506f44d9e1a9d8a18463c5403674d9478c2826c1326b22c8e392"} Jun 05 17:48:52.564572 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:52.564530 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-141.ec2.internal" podStartSLOduration=2.564519696 podStartE2EDuration="2.564519696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:48:52.564489932 +0000 UTC m=+3.493538971" watchObservedRunningTime="2026-06-05 17:48:52.564519696 +0000 UTC m=+3.493568734" Jun 05 17:48:53.092824 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:53.092784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:53.093006 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.092984 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:48:53.093086 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.093053 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs podName:ecd92b6d-f844-48c9-917a-0c65a7b05adb nodeName:}" failed. No retries permitted until 2026-06-05 17:48:55.093033872 +0000 UTC m=+6.022082906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs") pod "network-metrics-daemon-kpv87" (UID: "ecd92b6d-f844-48c9-917a-0c65a7b05adb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:48:53.193863 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:53.193825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh88m\" (UniqueName: \"kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m\") pod \"network-check-target-jsr47\" (UID: \"b44b575e-8f8e-4c7d-9afa-89bf3496f307\") " pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:53.194025 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:53.193915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:53.194098 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.194052 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:48:53.194152 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.194120 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret podName:3db2f471-0ac4-4179-8c24-5a8ef8c0fba0 nodeName:}" failed. No retries permitted until 2026-06-05 17:48:55.194098412 +0000 UTC m=+6.123147432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret") pod "global-pull-secret-syncer-q4k7f" (UID: "3db2f471-0ac4-4179-8c24-5a8ef8c0fba0") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:48:53.194548 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.194529 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:48:53.194657 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.194555 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:48:53.194657 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.194569 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fh88m for pod openshift-network-diagnostics/network-check-target-jsr47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:48:53.194657 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.194632 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m podName:b44b575e-8f8e-4c7d-9afa-89bf3496f307 nodeName:}" failed. No retries permitted until 2026-06-05 17:48:55.194616936 +0000 UTC m=+6.123665955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh88m" (UniqueName: "kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m") pod "network-check-target-jsr47" (UID: "b44b575e-8f8e-4c7d-9afa-89bf3496f307") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:48:53.511738 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:53.511645 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 17:43:51 +0000 UTC" deadline="2028-02-27 17:14:02.398340854 +0000 UTC" Jun 05 17:48:53.511738 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:53.511689 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15167h25m8.886656437s" Jun 05 17:48:53.529303 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:53.529235 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:53.529462 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.529376 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:48:53.529525 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:53.529471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:53.529578 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.529541 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:48:53.529646 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:53.529615 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:53.529710 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:53.529688 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:48:53.564626 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:53.564192 2579 generic.go:356] "Generic (PLEG): container finished" podID="a3571460a153096d2b498cbc9c9ff386" containerID="a8663bb95ed1ee6333a321e54091776b2e0c37203e86d833f1fbf0eccf678575" exitCode=0 Jun 05 17:48:53.564626 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:53.564230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" event={"ID":"a3571460a153096d2b498cbc9c9ff386","Type":"ContainerDied","Data":"a8663bb95ed1ee6333a321e54091776b2e0c37203e86d833f1fbf0eccf678575"} Jun 05 17:48:54.593868 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:54.593775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" event={"ID":"a3571460a153096d2b498cbc9c9ff386","Type":"ContainerStarted","Data":"76c331feb9ab3f581f46281272b8799504f4e0f57608596bd35a5ce939872a12"} Jun 05 17:48:55.109212 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:55.109174 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:55.109380 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.109366 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:48:55.109451 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.109428 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs podName:ecd92b6d-f844-48c9-917a-0c65a7b05adb nodeName:}" failed. No retries permitted until 2026-06-05 17:48:59.109410833 +0000 UTC m=+10.038459852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs") pod "network-metrics-daemon-kpv87" (UID: "ecd92b6d-f844-48c9-917a-0c65a7b05adb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:48:55.210068 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:55.210024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:55.210238 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:55.210092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh88m\" (UniqueName: \"kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m\") pod \"network-check-target-jsr47\" (UID: \"b44b575e-8f8e-4c7d-9afa-89bf3496f307\") " pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:55.210296 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.210261 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:48:55.210296 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.210281 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:48:55.210296 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.210295 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fh88m for pod openshift-network-diagnostics/network-check-target-jsr47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:48:55.210452 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.210353 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m podName:b44b575e-8f8e-4c7d-9afa-89bf3496f307 nodeName:}" failed. No retries permitted until 2026-06-05 17:48:59.210335044 +0000 UTC m=+10.139384075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh88m" (UniqueName: "kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m") pod "network-check-target-jsr47" (UID: "b44b575e-8f8e-4c7d-9afa-89bf3496f307") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:48:55.210809 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.210721 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:48:55.210809 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.210782 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret podName:3db2f471-0ac4-4179-8c24-5a8ef8c0fba0 nodeName:}" failed. No retries permitted until 2026-06-05 17:48:59.210763608 +0000 UTC m=+10.139812641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret") pod "global-pull-secret-syncer-q4k7f" (UID: "3db2f471-0ac4-4179-8c24-5a8ef8c0fba0") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:48:55.528685 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:55.528116 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:55.528685 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.528248 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:48:55.528685 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:55.528466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:55.528685 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:55.528629 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:55.529007 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.528626 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:48:55.529007 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:55.528725 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:48:57.527740 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:57.527667 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:57.527740 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:57.527676 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:57.528250 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:57.527676 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:57.528250 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:57.527794 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:48:57.528250 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:57.527908 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:48:57.528250 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:57.527988 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:48:59.146981 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:59.146941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:59.147450 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.147150 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:48:59.147450 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.147217 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs podName:ecd92b6d-f844-48c9-917a-0c65a7b05adb nodeName:}" failed. No retries permitted until 2026-06-05 17:49:07.147195326 +0000 UTC m=+18.076244357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs") pod "network-metrics-daemon-kpv87" (UID: "ecd92b6d-f844-48c9-917a-0c65a7b05adb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:48:59.247691 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:59.247324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:59.247691 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:59.247392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh88m\" (UniqueName: \"kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m\") pod \"network-check-target-jsr47\" (UID: \"b44b575e-8f8e-4c7d-9afa-89bf3496f307\") " pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:59.247691 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.247508 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:48:59.247691 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.247555 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:48:59.247691 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.247563 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret podName:3db2f471-0ac4-4179-8c24-5a8ef8c0fba0 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:07.247546789 +0000 UTC m=+18.176595811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret") pod "global-pull-secret-syncer-q4k7f" (UID: "3db2f471-0ac4-4179-8c24-5a8ef8c0fba0") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:48:59.247691 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.247573 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:48:59.247691 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.247586 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fh88m for pod openshift-network-diagnostics/network-check-target-jsr47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:48:59.247691 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.247655 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m podName:b44b575e-8f8e-4c7d-9afa-89bf3496f307 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:07.24763985 +0000 UTC m=+18.176688890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh88m" (UniqueName: "kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m") pod "network-check-target-jsr47" (UID: "b44b575e-8f8e-4c7d-9afa-89bf3496f307") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:48:59.528375 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:59.527888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:48:59.528375 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:59.527931 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:48:59.528375 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.528053 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:48:59.528375 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:48:59.527887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:48:59.528375 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.528264 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:48:59.529461 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:48:59.529410 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:01.527884 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:01.527846 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:01.527884 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:01.527886 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:01.528426 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:01.527847 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:01.528426 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:01.527989 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:01.528426 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:01.528081 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:01.528426 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:01.528163 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:03.527578 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:03.527484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:03.528021 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:03.527485 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:03.528021 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:03.527637 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:03.528021 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:03.527650 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:03.528021 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:03.527736 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:03.528021 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:03.527824 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:05.527328 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:05.527294 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:05.527328 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:05.527326 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:05.527901 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:05.527294 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:05.527901 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:05.527432 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:05.527901 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:05.527507 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:05.527901 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:05.527588 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:07.207558 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:07.207453 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:07.208047 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.207638 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:07.208047 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.207726 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs podName:ecd92b6d-f844-48c9-917a-0c65a7b05adb nodeName:}" failed. No retries permitted until 2026-06-05 17:49:23.207699409 +0000 UTC m=+34.136748431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs") pod "network-metrics-daemon-kpv87" (UID: "ecd92b6d-f844-48c9-917a-0c65a7b05adb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:07.308722 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:07.308689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh88m\" (UniqueName: \"kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m\") pod \"network-check-target-jsr47\" (UID: \"b44b575e-8f8e-4c7d-9afa-89bf3496f307\") " pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:07.308933 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:07.308753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:07.308933 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.308868 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:07.308933 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.308887 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:07.308933 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.308897 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fh88m for pod openshift-network-diagnostics/network-check-target-jsr47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:07.308933 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.308911 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:07.309215 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.308960 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m podName:b44b575e-8f8e-4c7d-9afa-89bf3496f307 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:23.308945323 +0000 UTC m=+34.237994344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh88m" (UniqueName: "kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m") pod "network-check-target-jsr47" (UID: "b44b575e-8f8e-4c7d-9afa-89bf3496f307") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:07.309215 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.308990 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret podName:3db2f471-0ac4-4179-8c24-5a8ef8c0fba0 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:23.308979757 +0000 UTC m=+34.238028794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret") pod "global-pull-secret-syncer-q4k7f" (UID: "3db2f471-0ac4-4179-8c24-5a8ef8c0fba0") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:07.527940 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:07.527849 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:07.528097 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:07.527854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:07.528097 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.527991 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:07.528097 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:07.527854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:07.528097 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.528073 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:07.528281 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:07.528180 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:09.528778 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:09.528741 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:09.529350 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:09.528857 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:09.529350 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:09.528893 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:09.529350 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:09.528933 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:09.529350 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:09.528959 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:09.529350 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:09.529043 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:11.527178 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.526873 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:11.528048 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:11.527288 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:11.528048 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.526876 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:11.528048 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:11.527349 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:11.528048 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.526876 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:11.528048 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:11.527426 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:11.628818 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.628789 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fvqnk" event={"ID":"601e5e3a-9aab-4925-8397-6e07d29e761f","Type":"ContainerStarted","Data":"fc39b7327d6786f3995988fad5ba8b8dbdb67bf613b552e9ae7b349dd16c98f3"} Jun 05 17:49:11.630145 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.630122 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9mmgl" event={"ID":"fccb9ffa-b845-4dda-b341-8e57947f0a19","Type":"ContainerStarted","Data":"d4696a463f1672d8f039d4b714f9f70a0820279df5ddefdb88a46c23dfc6ffdf"} Jun 05 17:49:11.632420 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.632400 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" event={"ID":"88cc35cb-116e-4ba6-b2fc-0b37b447fb08","Type":"ContainerStarted","Data":"2ba44568dcd14412661f645707cf31f26bf09a4f487eef3b513d9b5ef7e2e9d5"} Jun 05 17:49:11.632506 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.632460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" event={"ID":"88cc35cb-116e-4ba6-b2fc-0b37b447fb08","Type":"ContainerStarted","Data":"f31392bbe100bdc4b2ab4865c9f65e5e6bc4c48d625e28549093ff400d689621"} Jun 05 17:49:11.632552 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.632511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" event={"ID":"88cc35cb-116e-4ba6-b2fc-0b37b447fb08","Type":"ContainerStarted","Data":"c472e21f597f262a5394bca582136aae21ed02c1171228bf9a963629bf960fde"} Jun 05 17:49:11.632586 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.632558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" event={"ID":"88cc35cb-116e-4ba6-b2fc-0b37b447fb08","Type":"ContainerStarted","Data":"bf45a79b0976ee81eb4817b822fd0f2cc4d39d8359fe4bf70d456176376cb378"} Jun 05 17:49:11.633698 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.633681 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ptprv" event={"ID":"d4a9dc88-1354-44a8-9e1b-b2333eb4aaef","Type":"ContainerStarted","Data":"0f655a2970781093ad2cf564751ae3407b193bc02acdf0ecef9632a56213b6f8"} Jun 05 17:49:11.634885 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.634865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5vlgq" event={"ID":"978fa5ec-4162-4e32-9d8c-c1820792f000","Type":"ContainerStarted","Data":"79fc229b571adcb0aaa191cab3a8ad4fc2cd01a0614e83cd990eb74950e023bb"} Jun 05 17:49:11.635994 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.635973 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" event={"ID":"cace007d-0b4f-4062-98dc-e5f5784d2ff6","Type":"ContainerStarted","Data":"7118da1b3cb427e10a7e3b141020f7b5f5e75251d109a85897da3dfdb85f9c9d"} Jun 05 17:49:11.637285 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.637265 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd615d88-cab4-4bdf-a3e7-b5af561ce166" containerID="1bf430a9688cbad2918e2a3b1ce3610840017cb87b3c6dc19be96434f1eced2a" exitCode=0 Jun 05 17:49:11.637372 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.637336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phbl5" event={"ID":"fd615d88-cab4-4bdf-a3e7-b5af561ce166","Type":"ContainerDied","Data":"1bf430a9688cbad2918e2a3b1ce3610840017cb87b3c6dc19be96434f1eced2a"} Jun 05 17:49:11.638673 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.638645 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" event={"ID":"0c617957-864e-494a-8248-5d034bae80ee","Type":"ContainerStarted","Data":"f98385ced6ab914e9eda112b14849a1d973acc630fba2d656ba1489431609a19"} Jun 05 17:49:11.662357 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.662317 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-141.ec2.internal" podStartSLOduration=21.662304927 podStartE2EDuration="21.662304927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:48:54.611582947 +0000 UTC m=+5.540631987" watchObservedRunningTime="2026-06-05 17:49:11.662304927 +0000 UTC m=+22.591353965" Jun 05 17:49:11.679878 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.679834 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w9hb5" podStartSLOduration=3.899716131 podStartE2EDuration="22.679820748s" totalImagesPullingTime="18.780104617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:11.679499352 +0000 UTC m=+22.608548392" watchObservedRunningTime="2026-06-05 17:49:11.679820748 +0000 UTC m=+22.608869787" Jun 05 17:49:11.699053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.699007 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5vlgq" podStartSLOduration=3.885599056 podStartE2EDuration="22.698991395s" totalImagesPullingTime="18.813392339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:11.698588549 +0000 UTC m=+22.627637587" watchObservedRunningTime="2026-06-05 17:49:11.698991395 +0000 UTC m=+22.628040434" Jun 05 17:49:11.760240 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.760192 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fvqnk" podStartSLOduration=4.011066506 podStartE2EDuration="22.76017223s" totalImagesPullingTime="18.749105724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:11.760163987 +0000 UTC m=+22.689213028" watchObservedRunningTime="2026-06-05 17:49:11.76017223 +0000 UTC m=+22.689221266" Jun 05 17:49:11.760571 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.760544 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9mmgl" podStartSLOduration=7.176382077 podStartE2EDuration="21.7605347s" totalImagesPullingTime="14.584152623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:11.734291548 +0000 UTC m=+22.663340588" watchObservedRunningTime="2026-06-05 17:49:11.7605347 +0000 UTC m=+22.689583792" Jun 05 17:49:11.800877 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:11.800806 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ptprv" podStartSLOduration=4.041449181 podStartE2EDuration="22.800784953s" totalImagesPullingTime="18.759335772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:11.800581004 +0000 UTC m=+22.729630045" watchObservedRunningTime="2026-06-05 17:49:11.800784953 +0000 UTC m=+22.729833992" Jun 05 17:49:12.580491 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:12.580463 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 17:49:12.643639 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:12.643575 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" event={"ID":"cace007d-0b4f-4062-98dc-e5f5784d2ff6","Type":"ContainerStarted","Data":"9ab50dbd9e1543c22fa39f10c49fc53f4971214e80f988cf6ebd79e360e5ab5d"} Jun 05 17:49:12.647152 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:12.647119 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" event={"ID":"88cc35cb-116e-4ba6-b2fc-0b37b447fb08","Type":"ContainerStarted","Data":"743bae2b1c227444a8ee6f1fac19105db5ec021a41c0cab27aa3b528b40818bd"} Jun 05 17:49:12.647284 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:12.647207 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" event={"ID":"88cc35cb-116e-4ba6-b2fc-0b37b447fb08","Type":"ContainerStarted","Data":"d080aa01e369a84f3d4779188149975874a5df8968f5e25a4e71d8314ebba266"} Jun 05 17:49:12.648723 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:12.648687 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dcgl9" event={"ID":"85a35571-51ad-40d3-b63a-65f791b13cbe","Type":"ContainerStarted","Data":"775452ebb3b0cd05195a4684cdb7c0985b56546a1a5b0c4171deed185d9505f6"} Jun 05 17:49:12.665868 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:12.665825 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dcgl9" podStartSLOduration=4.907157069 podStartE2EDuration="23.665810735s" totalImagesPullingTime="18.758653666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:12.665297445 +0000 UTC m=+23.594346483" watchObservedRunningTime="2026-06-05 17:49:12.665810735 +0000 UTC m=+23.594859773" Jun 05 17:49:13.527736 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:13.527707 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:13.527891 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:13.527839 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:13.528179 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:13.528157 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:13.528284 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:13.528264 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:13.528351 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:13.528298 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:13.528407 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:13.528365 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:13.541269 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:13.541171 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T17:49:12.580485715Z","UUID":"69409438-c29a-490d-96d1-7cf911bd47e4","Handler":null,"Name":"","Endpoint":""} Jun 05 17:49:13.543901 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:13.543876 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 17:49:13.544017 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:13.543925 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 17:49:13.654030 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:13.653888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" event={"ID":"cace007d-0b4f-4062-98dc-e5f5784d2ff6","Type":"ContainerStarted","Data":"029b1cedb986aa573f6d49fad9bea25c32a3bc321649bb8648d9fea4361fe524"} Jun 05 17:49:13.672798 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:13.672748 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vmmvh" podStartSLOduration=3.8898143259999998 podStartE2EDuration="24.672732927s" totalImagesPullingTime="20.782918601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:13.672388573 +0000 UTC m=+24.601437612" watchObservedRunningTime="2026-06-05 17:49:13.672732927 +0000 UTC m=+24.601781965" Jun 05 17:49:14.660192 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:14.660155 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" event={"ID":"88cc35cb-116e-4ba6-b2fc-0b37b447fb08","Type":"ContainerStarted","Data":"ecb12f1f9cab45f4c0c4c9607040ebe3ed7bd28e91544214ad34375087af15b1"} Jun 05 17:49:14.847397 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:14.847352 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:49:14.847975 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:14.847942 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:49:15.527500 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:15.527258 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:15.527695 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:15.527266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:15.527695 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:15.527621 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:15.527695 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:15.527316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:15.527851 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:15.527702 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:15.527851 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:15.527757 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:15.662814 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:15.662783 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:49:15.663328 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:15.663310 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9mmgl" Jun 05 17:49:16.667653 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:16.667612 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" event={"ID":"88cc35cb-116e-4ba6-b2fc-0b37b447fb08","Type":"ContainerStarted","Data":"067a74212e59fc5f5a4113b3c1235043330993420fc890fb46becbe505f1cd71"} Jun 05 17:49:16.668329 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:16.668033 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:49:16.668329 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:16.668313 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:49:16.668432 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:16.668368 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:49:16.682993 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:16.682906 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:49:16.683405 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:16.683388 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:49:16.698371 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:16.698314 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" podStartSLOduration=8.858225564 podStartE2EDuration="27.698293749s" totalImagesPullingTime="18.840068185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:16.695750085 +0000 UTC m=+27.624799124" watchObservedRunningTime="2026-06-05 17:49:16.698293749 +0000 UTC m=+27.627342789" Jun 05 17:49:17.526910 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:17.526871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:17.527129 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:17.526871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:17.527129 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:17.527008 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:17.527129 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:17.527002 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:17.527277 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:17.527137 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:17.527277 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:17.527187 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:17.672140 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:17.672103 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd615d88-cab4-4bdf-a3e7-b5af561ce166" containerID="167055af77c1e52b9b35cce1e8e304b431961993f8160c08a8b24757b1c47d2c" exitCode=0 Jun 05 17:49:17.672771 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:17.672164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phbl5" event={"ID":"fd615d88-cab4-4bdf-a3e7-b5af561ce166","Type":"ContainerDied","Data":"167055af77c1e52b9b35cce1e8e304b431961993f8160c08a8b24757b1c47d2c"} Jun 05 17:49:18.361152 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:18.361112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kpv87"] Jun 05 17:49:18.361466 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:18.361258 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:18.361466 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:18.361345 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:18.364620 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:18.364577 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jsr47"] Jun 05 17:49:18.364757 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:18.364708 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:18.364835 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:18.364812 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:18.365445 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:18.365419 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q4k7f"] Jun 05 17:49:18.365544 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:18.365526 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:18.365662 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:18.365635 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:19.527918 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:19.527883 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:19.528284 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:19.527979 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:19.528284 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:19.528019 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:19.528284 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:19.528075 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:19.678535 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:19.678500 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd615d88-cab4-4bdf-a3e7-b5af561ce166" containerID="728d535d30d86482fb820822992519ef6f2319be09cf583f33c79cfc9dcbcc10" exitCode=0 Jun 05 17:49:19.678535 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:19.678539 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phbl5" event={"ID":"fd615d88-cab4-4bdf-a3e7-b5af561ce166","Type":"ContainerDied","Data":"728d535d30d86482fb820822992519ef6f2319be09cf583f33c79cfc9dcbcc10"} Jun 05 17:49:20.527310 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:20.527280 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:20.527430 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:20.527411 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:21.526924 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:21.526898 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:21.527279 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:21.526906 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:21.527279 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:21.526991 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:21.527279 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:21.527091 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:21.685796 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:21.685759 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd615d88-cab4-4bdf-a3e7-b5af561ce166" containerID="a848602b6b9c2f3d4fbbe4ca991bc62b5c36b8b9c5f32c7ccc4cc782fc58afe9" exitCode=0 Jun 05 17:49:21.685796 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:21.685799 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phbl5" event={"ID":"fd615d88-cab4-4bdf-a3e7-b5af561ce166","Type":"ContainerDied","Data":"a848602b6b9c2f3d4fbbe4ca991bc62b5c36b8b9c5f32c7ccc4cc782fc58afe9"} Jun 05 17:49:22.527037 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:22.527006 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:22.527423 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:22.527130 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:49:23.228055 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.228016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:23.228228 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:23.228187 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:23.228303 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:23.228270 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs podName:ecd92b6d-f844-48c9-917a-0c65a7b05adb nodeName:}" failed. No retries permitted until 2026-06-05 17:49:55.228247926 +0000 UTC m=+66.157296942 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs") pod "network-metrics-daemon-kpv87" (UID: "ecd92b6d-f844-48c9-917a-0c65a7b05adb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 17:49:23.328912 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.328860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:23.329082 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.328957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh88m\" (UniqueName: \"kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m\") pod \"network-check-target-jsr47\" (UID: \"b44b575e-8f8e-4c7d-9afa-89bf3496f307\") " pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:23.329082 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:23.329022 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:23.329181 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:23.329090 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 17:49:23.329181 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:23.329100 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret podName:3db2f471-0ac4-4179-8c24-5a8ef8c0fba0 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:55.329079311 +0000 UTC m=+66.258128348 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret") pod "global-pull-secret-syncer-q4k7f" (UID: "3db2f471-0ac4-4179-8c24-5a8ef8c0fba0") : object "kube-system"/"original-pull-secret" not registered Jun 05 17:49:23.329181 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:23.329107 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 17:49:23.329181 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:23.329121 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fh88m for pod openshift-network-diagnostics/network-check-target-jsr47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:23.329181 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:23.329162 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m podName:b44b575e-8f8e-4c7d-9afa-89bf3496f307 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:55.329151361 +0000 UTC m=+66.258200377 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fh88m" (UniqueName: "kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m") pod "network-check-target-jsr47" (UID: "b44b575e-8f8e-4c7d-9afa-89bf3496f307") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 17:49:23.527497 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.527466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:23.527497 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.527466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:23.527991 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:23.527635 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsr47" podUID="b44b575e-8f8e-4c7d-9afa-89bf3496f307" Jun 05 17:49:23.527991 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:23.527695 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q4k7f" podUID="3db2f471-0ac4-4179-8c24-5a8ef8c0fba0" Jun 05 17:49:23.843409 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.843325 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-141.ec2.internal" event="NodeReady" Jun 05 17:49:23.843572 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.843478 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 17:49:23.878426 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.878397 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76866d48b4-qzn57"] Jun 05 17:49:23.880112 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.880098 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:23.883212 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.883095 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 17:49:23.883212 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.883155 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vknkw\"" Jun 05 17:49:23.883404 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.883157 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 17:49:23.883404 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.883236 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 17:49:23.889860 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.889587 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nmpjh"] Jun 05 17:49:23.889860 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.889650 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 17:49:23.891867 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.891849 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:23.892450 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.892431 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fz9zj"] Jun 05 17:49:23.894803 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.894780 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 17:49:23.895123 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.894785 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 17:49:23.895123 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.895006 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fz9zj" Jun 05 17:49:23.895123 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.895070 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c4cc\"" Jun 05 17:49:23.896565 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.896545 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76866d48b4-qzn57"] Jun 05 17:49:23.898224 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.898068 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 17:49:23.898224 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.898142 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 17:49:23.898366 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.898068 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 17:49:23.898768 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.898665 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xwlsz\"" Jun 05 17:49:23.907733 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.907713 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nmpjh"] Jun 05 17:49:23.908619 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:23.908575 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fz9zj"] Jun 05 17:49:24.033731 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.033697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-trusted-ca\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.033731 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.033730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.033975 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.033751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-ca-trust-extracted\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.033975 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.033872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-certificates\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.033975 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.033917 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvgb5\" (UniqueName: \"kubernetes.io/projected/4fda909c-c3d9-4e7b-929a-4226cd4df135-kube-api-access-fvgb5\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.034102 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.033983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-bound-sa-token\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.034102 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.034015 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-image-registry-private-configuration\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.034102 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.034044 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbkt6\" (UniqueName: \"kubernetes.io/projected/ec5314a2-68ff-40b9-8eec-b90afd721fe8-kube-api-access-vbkt6\") pod \"ingress-canary-fz9zj\" (UID: \"ec5314a2-68ff-40b9-8eec-b90afd721fe8\") " pod="openshift-ingress-canary/ingress-canary-fz9zj" Jun 05 17:49:24.034222 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.034138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4fda909c-c3d9-4e7b-929a-4226cd4df135-config-volume\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.034222 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.034179 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79j2q\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-kube-api-access-79j2q\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.034304 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.034223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.034304 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.034247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec5314a2-68ff-40b9-8eec-b90afd721fe8-cert\") pod \"ingress-canary-fz9zj\" (UID: \"ec5314a2-68ff-40b9-8eec-b90afd721fe8\") " pod="openshift-ingress-canary/ingress-canary-fz9zj" Jun 05 17:49:24.034377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.034310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-installation-pull-secrets\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.034377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.034349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fda909c-c3d9-4e7b-929a-4226cd4df135-tmp-dir\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.050287 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.050259 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:24.135439 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135354 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-trusted-ca\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.135439 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.135439 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-ca-trust-extracted\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.135746 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-certificates\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.135746 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvgb5\" (UniqueName: \"kubernetes.io/projected/4fda909c-c3d9-4e7b-929a-4226cd4df135-kube-api-access-fvgb5\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.135746 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-bound-sa-token\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.135746 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-image-registry-private-configuration\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.135746 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:24.135509 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:24.135746 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:24.135595 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls podName:4fda909c-c3d9-4e7b-929a-4226cd4df135 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:24.635573188 +0000 UTC m=+35.564622210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls") pod "dns-default-nmpjh" (UID: "4fda909c-c3d9-4e7b-929a-4226cd4df135") : secret "dns-default-metrics-tls" not found Jun 05 17:49:24.135746 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbkt6\" (UniqueName: \"kubernetes.io/projected/ec5314a2-68ff-40b9-8eec-b90afd721fe8-kube-api-access-vbkt6\") pod \"ingress-canary-fz9zj\" (UID: \"ec5314a2-68ff-40b9-8eec-b90afd721fe8\") " pod="openshift-ingress-canary/ingress-canary-fz9zj" Jun 05 17:49:24.135746 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4fda909c-c3d9-4e7b-929a-4226cd4df135-config-volume\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.135746 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79j2q\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-kube-api-access-79j2q\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.135746 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.136240 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec5314a2-68ff-40b9-8eec-b90afd721fe8-cert\") pod \"ingress-canary-fz9zj\" (UID: \"ec5314a2-68ff-40b9-8eec-b90afd721fe8\") " pod="openshift-ingress-canary/ingress-canary-fz9zj" Jun 05 17:49:24.136240 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-installation-pull-secrets\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.136240 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.135831 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fda909c-c3d9-4e7b-929a-4226cd4df135-tmp-dir\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.136240 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:24.135942 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:49:24.136240 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:24.135960 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76866d48b4-qzn57: secret "image-registry-tls" not found Jun 05 17:49:24.136240 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:24.136005 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls podName:f8b0f00e-17d7-4dce-a845-5d4aa3df90cd nodeName:}" failed. No retries permitted until 2026-06-05 17:49:24.635990311 +0000 UTC m=+35.565039346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls") pod "image-registry-76866d48b4-qzn57" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd") : secret "image-registry-tls" not found Jun 05 17:49:24.136240 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.136178 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fda909c-c3d9-4e7b-929a-4226cd4df135-tmp-dir\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.136240 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.136214 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-certificates\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.136675 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.136345 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4fda909c-c3d9-4e7b-929a-4226cd4df135-config-volume\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.136675 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.136387 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-trusted-ca\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.136675 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.136515 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-ca-trust-extracted\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.138644 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.138617 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:24.139895 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.139874 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-installation-pull-secrets\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.139895 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.139892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-image-registry-private-configuration\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.140034 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.139951 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec5314a2-68ff-40b9-8eec-b90afd721fe8-cert\") pod \"ingress-canary-fz9zj\" (UID: \"ec5314a2-68ff-40b9-8eec-b90afd721fe8\") " pod="openshift-ingress-canary/ingress-canary-fz9zj" Jun 05 17:49:24.148966 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.148935 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-bound-sa-token\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.148966 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.148960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79j2q\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-kube-api-access-79j2q\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.149118 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.149071 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbkt6\" (UniqueName: \"kubernetes.io/projected/ec5314a2-68ff-40b9-8eec-b90afd721fe8-kube-api-access-vbkt6\") pod \"ingress-canary-fz9zj\" (UID: \"ec5314a2-68ff-40b9-8eec-b90afd721fe8\") " pod="openshift-ingress-canary/ingress-canary-fz9zj" Jun 05 17:49:24.149118 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.149083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvgb5\" (UniqueName: \"kubernetes.io/projected/4fda909c-c3d9-4e7b-929a-4226cd4df135-kube-api-access-fvgb5\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.210440 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.210402 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fz9zj" Jun 05 17:49:24.361671 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.361623 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fz9zj"] Jun 05 17:49:24.527142 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.527109 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:24.531800 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.531773 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 17:49:24.532492 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.531825 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42j2w\"" Jun 05 17:49:24.621496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.621457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:24.640619 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.640575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:24.640783 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.640660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:24.640783 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:24.640715 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:49:24.640783 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:24.640730 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76866d48b4-qzn57: secret "image-registry-tls" not found Jun 05 17:49:24.640783 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:24.640760 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:24.641001 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:24.640789 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls podName:f8b0f00e-17d7-4dce-a845-5d4aa3df90cd nodeName:}" failed. No retries permitted until 2026-06-05 17:49:25.640768892 +0000 UTC m=+36.569817913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls") pod "image-registry-76866d48b4-qzn57" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd") : secret "image-registry-tls" not found Jun 05 17:49:24.641001 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:24.640823 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls podName:4fda909c-c3d9-4e7b-929a-4226cd4df135 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:25.640805061 +0000 UTC m=+36.569854098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls") pod "dns-default-nmpjh" (UID: "4fda909c-c3d9-4e7b-929a-4226cd4df135") : secret "dns-default-metrics-tls" not found Jun 05 17:49:24.695032 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:24.694992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fz9zj" event={"ID":"ec5314a2-68ff-40b9-8eec-b90afd721fe8","Type":"ContainerStarted","Data":"49be0247d9ab5e0107d07a150d0f3c2b4a85ec79a2f44ee584d7c952b75b8e0d"} Jun 05 17:49:25.528267 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:25.527871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:25.528983 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:25.527872 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:25.532375 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:25.531974 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 17:49:25.533781 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:25.533215 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 17:49:25.533781 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:25.533215 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s9z2b\"" Jun 05 17:49:25.533781 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:25.533479 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 17:49:25.649912 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:25.649879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:25.650109 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:25.649995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:25.650109 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:25.650042 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:25.650109 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:25.650106 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:49:25.650267 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:25.650119 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls podName:4fda909c-c3d9-4e7b-929a-4226cd4df135 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:27.65010274 +0000 UTC m=+38.579151757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls") pod "dns-default-nmpjh" (UID: "4fda909c-c3d9-4e7b-929a-4226cd4df135") : secret "dns-default-metrics-tls" not found Jun 05 17:49:25.650267 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:25.650121 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76866d48b4-qzn57: secret "image-registry-tls" not found Jun 05 17:49:25.650267 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:25.650176 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls podName:f8b0f00e-17d7-4dce-a845-5d4aa3df90cd nodeName:}" failed. No retries permitted until 2026-06-05 17:49:27.650159463 +0000 UTC m=+38.579208498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls") pod "image-registry-76866d48b4-qzn57" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd") : secret "image-registry-tls" not found Jun 05 17:49:27.667321 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:27.667242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:27.667750 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:27.667325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:27.667750 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:27.667389 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:27.667750 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:27.667408 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:49:27.667750 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:27.667424 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76866d48b4-qzn57: secret "image-registry-tls" not found Jun 05 17:49:27.667750 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:27.667457 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls podName:4fda909c-c3d9-4e7b-929a-4226cd4df135 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:31.667440891 +0000 UTC m=+42.596489934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls") pod "dns-default-nmpjh" (UID: "4fda909c-c3d9-4e7b-929a-4226cd4df135") : secret "dns-default-metrics-tls" not found Jun 05 17:49:27.667750 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:27.667471 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls podName:f8b0f00e-17d7-4dce-a845-5d4aa3df90cd nodeName:}" failed. No retries permitted until 2026-06-05 17:49:31.667465131 +0000 UTC m=+42.596514148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls") pod "image-registry-76866d48b4-qzn57" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd") : secret "image-registry-tls" not found Jun 05 17:49:27.705943 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:27.705914 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd615d88-cab4-4bdf-a3e7-b5af561ce166" containerID="fb996d5ab6e3edbf7bde7db8a8569559c86d6e24f61ba4875be1ca195994b3d5" exitCode=0 Jun 05 17:49:27.706080 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:27.705997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phbl5" event={"ID":"fd615d88-cab4-4bdf-a3e7-b5af561ce166","Type":"ContainerDied","Data":"fb996d5ab6e3edbf7bde7db8a8569559c86d6e24f61ba4875be1ca195994b3d5"} Jun 05 17:49:27.707517 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:27.707495 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fz9zj" event={"ID":"ec5314a2-68ff-40b9-8eec-b90afd721fe8","Type":"ContainerStarted","Data":"0b7e3249ba74375c57748ed6173299091d3cd5a00c4529260a5bcc08a91e7e61"} Jun 05 17:49:27.734033 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:27.734010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:27.751666 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:27.751623 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fz9zj" podStartSLOduration=1.745392459 podStartE2EDuration="4.751588289s" totalImagesPullingTime="3.00619583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:27.751285279 +0000 UTC m=+38.680334318" watchObservedRunningTime="2026-06-05 17:49:27.751588289 +0000 UTC m=+38.680637328" Jun 05 17:49:27.833016 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:27.832978 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:28.712913 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:28.712883 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd615d88-cab4-4bdf-a3e7-b5af561ce166" containerID="86f982a19027218af09bc746120387987bdeb3544bc14cd6b565d67874eb9c73" exitCode=0 Jun 05 17:49:28.713370 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:28.712974 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phbl5" event={"ID":"fd615d88-cab4-4bdf-a3e7-b5af561ce166","Type":"ContainerDied","Data":"86f982a19027218af09bc746120387987bdeb3544bc14cd6b565d67874eb9c73"} Jun 05 17:49:29.424575 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:29.424545 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:29.484730 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:29.484691 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:29.718116 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:29.718031 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phbl5" event={"ID":"fd615d88-cab4-4bdf-a3e7-b5af561ce166","Type":"ContainerStarted","Data":"7d79e1cfbd7f9da0611df9c9c8b53310c838a675691aa9e66fd1b4904cd6ced1"} Jun 05 17:49:29.742284 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:29.742232 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-phbl5" podStartSLOduration=9.353638876 podStartE2EDuration="40.742215636s" totalImagesPullingTime="31.38857676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:49:29.740306753 +0000 UTC m=+40.669355791" watchObservedRunningTime="2026-06-05 17:49:29.742215636 +0000 UTC m=+40.671264675" Jun 05 17:49:29.866102 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:29.866072 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:29.961173 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:29.961140 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:31.696335 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:31.696302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:31.696739 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:31.696383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:31.696739 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:31.696445 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:31.696739 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:31.696475 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:49:31.696739 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:31.696487 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76866d48b4-qzn57: secret "image-registry-tls" not found Jun 05 17:49:31.696739 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:31.696511 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls podName:4fda909c-c3d9-4e7b-929a-4226cd4df135 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:39.696495386 +0000 UTC m=+50.625544402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls") pod "dns-default-nmpjh" (UID: "4fda909c-c3d9-4e7b-929a-4226cd4df135") : secret "dns-default-metrics-tls" not found Jun 05 17:49:31.696739 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:31.696532 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls podName:f8b0f00e-17d7-4dce-a845-5d4aa3df90cd nodeName:}" failed. No retries permitted until 2026-06-05 17:49:39.696520669 +0000 UTC m=+50.625569685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls") pod "image-registry-76866d48b4-qzn57" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd") : secret "image-registry-tls" not found Jun 05 17:49:32.975809 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:32.975771 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:33.039990 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:33.039956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:33.507883 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:33.507848 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:33.572541 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:33.572507 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:33.642849 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:33.642787 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:34.544853 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:34.544819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:34.611906 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:34.611874 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:36.752656 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:36.752625 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:36.812217 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:36.812193 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:37.482922 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:37.482887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:37.914840 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:37.914751 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:38.014696 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:38.014669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:39.752889 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:39.752851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:39.752889 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:39.752895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:39.753391 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:39.752994 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:39.753391 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:39.753003 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:49:39.753391 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:39.753019 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76866d48b4-qzn57: secret "image-registry-tls" not found Jun 05 17:49:39.753391 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:39.753057 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls podName:4fda909c-c3d9-4e7b-929a-4226cd4df135 nodeName:}" failed. No retries permitted until 2026-06-05 17:49:55.75304157 +0000 UTC m=+66.682090586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls") pod "dns-default-nmpjh" (UID: "4fda909c-c3d9-4e7b-929a-4226cd4df135") : secret "dns-default-metrics-tls" not found Jun 05 17:49:39.753391 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:39.753071 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls podName:f8b0f00e-17d7-4dce-a845-5d4aa3df90cd nodeName:}" failed. No retries permitted until 2026-06-05 17:49:55.753064017 +0000 UTC m=+66.682113034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls") pod "image-registry-76866d48b4-qzn57" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd") : secret "image-registry-tls" not found Jun 05 17:49:45.824293 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:45.824258 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:45.883337 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:45.883307 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:48.684334 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:48.684310 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9z9x" Jun 05 17:49:48.851302 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:48.851270 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:48.909832 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:48.909804 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:49.634908 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:49.634871 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:49.704043 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:49.704007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:51.246953 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:51.246925 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:51.305921 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:51.305893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:55.273947 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.273914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:49:55.276915 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.276897 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 17:49:55.284358 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:55.284341 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 17:49:55.284409 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:55.284397 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs podName:ecd92b6d-f844-48c9-917a-0c65a7b05adb nodeName:}" failed. No retries permitted until 2026-06-05 17:50:59.284380853 +0000 UTC m=+130.213429871 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs") pod "network-metrics-daemon-kpv87" (UID: "ecd92b6d-f844-48c9-917a-0c65a7b05adb") : secret "metrics-daemon-secret" not found Jun 05 17:49:55.374947 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.374909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:55.375055 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.375001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh88m\" (UniqueName: \"kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m\") pod \"network-check-target-jsr47\" (UID: \"b44b575e-8f8e-4c7d-9afa-89bf3496f307\") " pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:55.378498 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.378478 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 17:49:55.378553 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.378516 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 17:49:55.389259 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.389238 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 17:49:55.389879 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.389862 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db2f471-0ac4-4179-8c24-5a8ef8c0fba0-original-pull-secret\") pod \"global-pull-secret-syncer-q4k7f\" (UID: \"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0\") " pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:55.398294 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.398272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh88m\" (UniqueName: \"kubernetes.io/projected/b44b575e-8f8e-4c7d-9afa-89bf3496f307-kube-api-access-fh88m\") pod \"network-check-target-jsr47\" (UID: \"b44b575e-8f8e-4c7d-9afa-89bf3496f307\") " pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:55.541947 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.541866 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4k7f" Jun 05 17:49:55.553006 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.552978 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s9z2b\"" Jun 05 17:49:55.560025 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.560005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:49:55.683894 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.683861 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q4k7f"] Jun 05 17:49:55.686654 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:49:55.686624 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db2f471_0ac4_4179_8c24_5a8ef8c0fba0.slice/crio-34ecf6b2185f34a9b00327e4c3862cdbf920f24695cfdeaafab1c1838c31e874 WatchSource:0}: Error finding container 34ecf6b2185f34a9b00327e4c3862cdbf920f24695cfdeaafab1c1838c31e874: Status 404 returned error can't find the container with id 34ecf6b2185f34a9b00327e4c3862cdbf920f24695cfdeaafab1c1838c31e874 Jun 05 17:49:55.703045 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.702969 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jsr47"] Jun 05 17:49:55.705286 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:49:55.705264 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44b575e_8f8e_4c7d_9afa_89bf3496f307.slice/crio-ff281163f9362bd60ec0a6add59ebb1f868a1e85b31e9359e55d0a2b37a38711 WatchSource:0}: Error finding container ff281163f9362bd60ec0a6add59ebb1f868a1e85b31e9359e55d0a2b37a38711: Status 404 returned error can't find the container with id ff281163f9362bd60ec0a6add59ebb1f868a1e85b31e9359e55d0a2b37a38711 Jun 05 17:49:55.777595 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.777560 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jsr47" event={"ID":"b44b575e-8f8e-4c7d-9afa-89bf3496f307","Type":"ContainerStarted","Data":"ff281163f9362bd60ec0a6add59ebb1f868a1e85b31e9359e55d0a2b37a38711"} Jun 05 17:49:55.778321 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.778295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:49:55.778442 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.778338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:49:55.778495 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:55.778438 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:49:55.778495 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:55.778453 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:49:55.778495 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:55.778455 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76866d48b4-qzn57: secret "image-registry-tls" not found Jun 05 17:49:55.778664 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:55.778512 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls podName:4fda909c-c3d9-4e7b-929a-4226cd4df135 nodeName:}" failed. No retries permitted until 2026-06-05 17:50:27.778493599 +0000 UTC m=+98.707542616 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls") pod "dns-default-nmpjh" (UID: "4fda909c-c3d9-4e7b-929a-4226cd4df135") : secret "dns-default-metrics-tls" not found Jun 05 17:49:55.778664 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:49:55.778529 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls podName:f8b0f00e-17d7-4dce-a845-5d4aa3df90cd nodeName:}" failed. No retries permitted until 2026-06-05 17:50:27.778522035 +0000 UTC m=+98.707571064 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls") pod "image-registry-76866d48b4-qzn57" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd") : secret "image-registry-tls" not found Jun 05 17:49:55.778751 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:55.778664 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q4k7f" event={"ID":"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0","Type":"ContainerStarted","Data":"34ecf6b2185f34a9b00327e4c3862cdbf920f24695cfdeaafab1c1838c31e874"} Jun 05 17:49:58.725736 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:58.725694 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:49:58.792752 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:49:58.792720 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:50:00.793425 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:00.793384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jsr47" event={"ID":"b44b575e-8f8e-4c7d-9afa-89bf3496f307","Type":"ContainerStarted","Data":"328fb9fc89d47295328be77482587dc5df3ef08f6a15bdeae97c26b4e8b5b1ae"} Jun 05 17:50:00.793876 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:00.793479 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:50:00.794704 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:00.794678 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q4k7f" event={"ID":"3db2f471-0ac4-4179-8c24-5a8ef8c0fba0","Type":"ContainerStarted","Data":"4685d1814bcdc1fc2de6482df88c27df53e5223dc7f820c657a176c63298be3c"} Jun 05 17:50:00.827508 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:00.827459 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q4k7f" podStartSLOduration=66.35192246 podStartE2EDuration="1m10.827445351s" totalImagesPullingTime="4.475522891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:50:00.827380779 +0000 UTC m=+71.756429817" watchObservedRunningTime="2026-06-05 17:50:00.827445351 +0000 UTC m=+71.756494390" Jun 05 17:50:00.827701 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:00.827679 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jsr47" podStartSLOduration=67.374736513 podStartE2EDuration="1m11.827673004s" totalImagesPullingTime="4.452936491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:50:00.810901027 +0000 UTC m=+71.739950066" watchObservedRunningTime="2026-06-05 17:50:00.827673004 +0000 UTC m=+71.756722043" Jun 05 17:50:11.589520 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:11.589488 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:50:11.652273 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:11.652240 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:50:27.807417 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:27.807383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:50:27.807834 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:27.807433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:50:27.807834 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:50:27.807555 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:50:27.807834 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:50:27.807558 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:50:27.807834 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:50:27.807670 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76866d48b4-qzn57: secret "image-registry-tls" not found Jun 05 17:50:27.807834 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:50:27.807681 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls podName:4fda909c-c3d9-4e7b-929a-4226cd4df135 nodeName:}" failed. No retries permitted until 2026-06-05 17:51:31.807655749 +0000 UTC m=+162.736704789 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls") pod "dns-default-nmpjh" (UID: "4fda909c-c3d9-4e7b-929a-4226cd4df135") : secret "dns-default-metrics-tls" not found Jun 05 17:50:27.807834 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:50:27.807722 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls podName:f8b0f00e-17d7-4dce-a845-5d4aa3df90cd nodeName:}" failed. No retries permitted until 2026-06-05 17:51:31.807709231 +0000 UTC m=+162.736758256 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls") pod "image-registry-76866d48b4-qzn57" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd") : secret "image-registry-tls" not found Jun 05 17:50:31.799765 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:31.799728 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jsr47" Jun 05 17:50:59.323300 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:50:59.323243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:50:59.323842 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:50:59.323419 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 17:50:59.323842 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:50:59.323505 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs podName:ecd92b6d-f844-48c9-917a-0c65a7b05adb nodeName:}" failed. No retries permitted until 2026-06-05 17:53:01.32348258 +0000 UTC m=+252.252531617 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs") pod "network-metrics-daemon-kpv87" (UID: "ecd92b6d-f844-48c9-917a-0c65a7b05adb") : secret "metrics-daemon-secret" not found Jun 05 17:51:26.891564 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:51:26.891515 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" podUID="f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" Jun 05 17:51:26.903882 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:51:26.903857 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nmpjh" podUID="4fda909c-c3d9-4e7b-929a-4226cd4df135" Jun 05 17:51:26.996245 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:51:26.996219 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:51:26.996336 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:51:26.996257 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nmpjh" Jun 05 17:51:27.538990 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:51:27.538954 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kpv87" podUID="ecd92b6d-f844-48c9-917a-0c65a7b05adb" Jun 05 17:51:31.843074 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:51:31.843027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:51:31.843464 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:51:31.843121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:51:31.843464 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:51:31.843180 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 17:51:31.843464 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:51:31.843216 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 17:51:31.843464 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:51:31.843229 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76866d48b4-qzn57: secret "image-registry-tls" not found Jun 05 17:51:31.843464 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:51:31.843255 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls podName:4fda909c-c3d9-4e7b-929a-4226cd4df135 nodeName:}" failed. No retries permitted until 2026-06-05 17:53:33.84323803 +0000 UTC m=+284.772287047 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls") pod "dns-default-nmpjh" (UID: "4fda909c-c3d9-4e7b-929a-4226cd4df135") : secret "dns-default-metrics-tls" not found Jun 05 17:51:31.843464 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:51:31.843270 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls podName:f8b0f00e-17d7-4dce-a845-5d4aa3df90cd nodeName:}" failed. No retries permitted until 2026-06-05 17:53:33.843263721 +0000 UTC m=+284.772312738 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls") pod "image-registry-76866d48b4-qzn57" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd") : secret "image-registry-tls" not found Jun 05 17:51:41.527150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:51:41.527055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:52:35.331276 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.331244 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct"] Jun 05 17:52:35.333322 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.333300 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-59fjp"] Jun 05 17:52:35.333472 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.333441 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.335388 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.335367 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.337034 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.336996 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 05 17:52:35.337465 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.337445 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-5cgw9"] Jun 05 17:52:35.337660 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.337644 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 05 17:52:35.337728 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.337667 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:52:35.338253 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.338236 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 05 17:52:35.338253 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.338247 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 05 17:52:35.338437 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.338421 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-c8wkm\"" Jun 05 17:52:35.339201 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.339175 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:52:35.339315 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.339222 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.339315 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.339290 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 05 17:52:35.339433 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.339352 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 05 17:52:35.341865 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.341848 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pk5rk\"" Jun 05 17:52:35.343619 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.343573 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 05 17:52:35.343736 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.343680 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 17:52:35.343736 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.343702 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 05 17:52:35.344396 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.344376 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cxj6w\"" Jun 05 17:52:35.344485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.344376 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 17:52:35.345500 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.345481 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 05 17:52:35.347338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.347318 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct"] Jun 05 17:52:35.350308 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.350286 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 05 17:52:35.360650 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.360621 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-59fjp"] Jun 05 17:52:35.366318 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.366285 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-5cgw9"] Jun 05 17:52:35.428892 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.428857 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw"] Jun 05 17:52:35.432462 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.432431 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl"] Jun 05 17:52:35.432750 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.432718 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.434781 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.434762 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:35.437520 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.437495 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zvscd\"" Jun 05 17:52:35.437520 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.437515 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 17:52:35.437698 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.437517 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 17:52:35.437698 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.437534 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:52:35.438165 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.438147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 05 17:52:35.438544 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.438526 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wbbf8\"" Jun 05 17:52:35.438626 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.438578 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 05 17:52:35.438679 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.438623 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 17:52:35.444173 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.444152 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw"] Jun 05 17:52:35.451978 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.451955 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl"] Jun 05 17:52:35.483820 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.483794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e337b0e-8777-4211-b9b1-d295dd381440-serving-cert\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.483967 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.483840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6be1f372-fce4-4128-a3be-60be3efb2fb3-service-ca-bundle\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.483967 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.483857 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnvrg\" (UniqueName: \"kubernetes.io/projected/6be1f372-fce4-4128-a3be-60be3efb2fb3-kube-api-access-tnvrg\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.483967 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.483929 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e337b0e-8777-4211-b9b1-d295dd381440-trusted-ca\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.483967 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.483960 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6be1f372-fce4-4128-a3be-60be3efb2fb3-snapshots\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.484145 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.483984 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v84s7\" (UniqueName: \"kubernetes.io/projected/3a07721e-1cf6-4804-b305-036bfb9ead6f-kube-api-access-v84s7\") pod \"service-ca-operator-6bc5ff68f5-tcvct\" (UID: \"3a07721e-1cf6-4804-b305-036bfb9ead6f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.484145 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.484005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be1f372-fce4-4128-a3be-60be3efb2fb3-tmp\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.484145 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.484030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6be1f372-fce4-4128-a3be-60be3efb2fb3-trusted-ca-bundle\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.484145 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.484117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pgsf\" (UniqueName: \"kubernetes.io/projected/3e337b0e-8777-4211-b9b1-d295dd381440-kube-api-access-5pgsf\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.484294 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.484166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6be1f372-fce4-4128-a3be-60be3efb2fb3-serving-cert\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.484294 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.484211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a07721e-1cf6-4804-b305-036bfb9ead6f-config\") pod \"service-ca-operator-6bc5ff68f5-tcvct\" (UID: \"3a07721e-1cf6-4804-b305-036bfb9ead6f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.484294 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.484233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a07721e-1cf6-4804-b305-036bfb9ead6f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-tcvct\" (UID: \"3a07721e-1cf6-4804-b305-036bfb9ead6f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.484294 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.484251 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e337b0e-8777-4211-b9b1-d295dd381440-config\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.520934 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.520906 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-szrts"] Jun 05 17:52:35.522859 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.522843 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-szrts" Jun 05 17:52:35.525744 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.525726 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tmvpt\"" Jun 05 17:52:35.532926 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.532904 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-szrts"] Jun 05 17:52:35.584780 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.584701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e337b0e-8777-4211-b9b1-d295dd381440-serving-cert\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.584780 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.584748 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3e220ca-335c-4845-8acc-ecf81256e56f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-qrkcw\" (UID: \"c3e220ca-335c-4845-8acc-ecf81256e56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.584942 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.584785 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp99b\" (UniqueName: \"kubernetes.io/projected/c3e220ca-335c-4845-8acc-ecf81256e56f-kube-api-access-gp99b\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-qrkcw\" (UID: \"c3e220ca-335c-4845-8acc-ecf81256e56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.584942 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.584820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6be1f372-fce4-4128-a3be-60be3efb2fb3-service-ca-bundle\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.584942 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.584879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnvrg\" (UniqueName: \"kubernetes.io/projected/6be1f372-fce4-4128-a3be-60be3efb2fb3-kube-api-access-tnvrg\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.584942 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.584921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e337b0e-8777-4211-b9b1-d295dd381440-trusted-ca\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.585110 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.584945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6be1f372-fce4-4128-a3be-60be3efb2fb3-snapshots\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.585110 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.584963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v84s7\" (UniqueName: \"kubernetes.io/projected/3a07721e-1cf6-4804-b305-036bfb9ead6f-kube-api-access-v84s7\") pod \"service-ca-operator-6bc5ff68f5-tcvct\" (UID: \"3a07721e-1cf6-4804-b305-036bfb9ead6f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.585110 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.584982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3e220ca-335c-4845-8acc-ecf81256e56f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-qrkcw\" (UID: \"c3e220ca-335c-4845-8acc-ecf81256e56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.585110 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be1f372-fce4-4128-a3be-60be3efb2fb3-tmp\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.585479 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6be1f372-fce4-4128-a3be-60be3efb2fb3-trusted-ca-bundle\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.585479 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pgsf\" (UniqueName: \"kubernetes.io/projected/3e337b0e-8777-4211-b9b1-d295dd381440-kube-api-access-5pgsf\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.585479 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:35.585479 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6be1f372-fce4-4128-a3be-60be3efb2fb3-serving-cert\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.585479 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585431 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6be1f372-fce4-4128-a3be-60be3efb2fb3-service-ca-bundle\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.585804 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a07721e-1cf6-4804-b305-036bfb9ead6f-config\") pod \"service-ca-operator-6bc5ff68f5-tcvct\" (UID: \"3a07721e-1cf6-4804-b305-036bfb9ead6f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.585804 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:35.585804 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585557 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be1f372-fce4-4128-a3be-60be3efb2fb3-tmp\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.585804 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a07721e-1cf6-4804-b305-036bfb9ead6f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-tcvct\" (UID: \"3a07721e-1cf6-4804-b305-036bfb9ead6f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.585804 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585623 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6be1f372-fce4-4128-a3be-60be3efb2fb3-snapshots\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.585804 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e337b0e-8777-4211-b9b1-d295dd381440-config\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.586078 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.585977 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e337b0e-8777-4211-b9b1-d295dd381440-trusted-ca\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.586212 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.586191 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a07721e-1cf6-4804-b305-036bfb9ead6f-config\") pod \"service-ca-operator-6bc5ff68f5-tcvct\" (UID: \"3a07721e-1cf6-4804-b305-036bfb9ead6f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.586456 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.586434 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e337b0e-8777-4211-b9b1-d295dd381440-config\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.586514 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.586493 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6be1f372-fce4-4128-a3be-60be3efb2fb3-trusted-ca-bundle\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.587411 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.587390 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e337b0e-8777-4211-b9b1-d295dd381440-serving-cert\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.587840 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.587817 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6be1f372-fce4-4128-a3be-60be3efb2fb3-serving-cert\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.587924 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.587900 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a07721e-1cf6-4804-b305-036bfb9ead6f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-tcvct\" (UID: \"3a07721e-1cf6-4804-b305-036bfb9ead6f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.595369 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.595344 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnvrg\" (UniqueName: \"kubernetes.io/projected/6be1f372-fce4-4128-a3be-60be3efb2fb3-kube-api-access-tnvrg\") pod \"insights-operator-896549976-5cgw9\" (UID: \"6be1f372-fce4-4128-a3be-60be3efb2fb3\") " pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.595742 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.595722 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pgsf\" (UniqueName: \"kubernetes.io/projected/3e337b0e-8777-4211-b9b1-d295dd381440-kube-api-access-5pgsf\") pod \"console-operator-668fdbf85c-59fjp\" (UID: \"3e337b0e-8777-4211-b9b1-d295dd381440\") " pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.595908 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.595887 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v84s7\" (UniqueName: \"kubernetes.io/projected/3a07721e-1cf6-4804-b305-036bfb9ead6f-kube-api-access-v84s7\") pod \"service-ca-operator-6bc5ff68f5-tcvct\" (UID: \"3a07721e-1cf6-4804-b305-036bfb9ead6f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.630069 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.630040 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:35.644334 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.644298 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" Jun 05 17:52:35.652707 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.652690 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:35.657714 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.657678 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-5cgw9" Jun 05 17:52:35.686068 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.686023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:35.686068 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.686076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3e220ca-335c-4845-8acc-ecf81256e56f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-qrkcw\" (UID: \"c3e220ca-335c-4845-8acc-ecf81256e56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.686316 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.686098 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcr6k\" (UniqueName: \"kubernetes.io/projected/7afbf48c-ea69-49c8-a932-244e6422ba1d-kube-api-access-rcr6k\") pod \"network-check-source-dbd9cf844-szrts\" (UID: \"7afbf48c-ea69-49c8-a932-244e6422ba1d\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-szrts" Jun 05 17:52:35.686316 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.686119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp99b\" (UniqueName: \"kubernetes.io/projected/c3e220ca-335c-4845-8acc-ecf81256e56f-kube-api-access-gp99b\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-qrkcw\" (UID: \"c3e220ca-335c-4845-8acc-ecf81256e56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.686316 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.686160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3e220ca-335c-4845-8acc-ecf81256e56f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-qrkcw\" (UID: \"c3e220ca-335c-4845-8acc-ecf81256e56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.686316 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.686187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:35.686576 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:35.686310 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 17:52:35.686576 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.686374 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:35.686576 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:35.686399 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert podName:7d2181de-2880-4b30-bdc6-4c3c99f2d7ab nodeName:}" failed. No retries permitted until 2026-06-05 17:52:36.186381013 +0000 UTC m=+227.115430029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-srsjl" (UID: "7d2181de-2880-4b30-bdc6-4c3c99f2d7ab") : secret "networking-console-plugin-cert" not found Jun 05 17:52:35.687205 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.687178 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3e220ca-335c-4845-8acc-ecf81256e56f-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-qrkcw\" (UID: \"c3e220ca-335c-4845-8acc-ecf81256e56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.687205 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.687200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:35.688872 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.688849 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3e220ca-335c-4845-8acc-ecf81256e56f-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-qrkcw\" (UID: \"c3e220ca-335c-4845-8acc-ecf81256e56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.695789 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.695672 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp99b\" (UniqueName: \"kubernetes.io/projected/c3e220ca-335c-4845-8acc-ecf81256e56f-kube-api-access-gp99b\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-qrkcw\" (UID: \"c3e220ca-335c-4845-8acc-ecf81256e56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.743245 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.742998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" Jun 05 17:52:35.787704 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.787623 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcr6k\" (UniqueName: \"kubernetes.io/projected/7afbf48c-ea69-49c8-a932-244e6422ba1d-kube-api-access-rcr6k\") pod \"network-check-source-dbd9cf844-szrts\" (UID: \"7afbf48c-ea69-49c8-a932-244e6422ba1d\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-szrts" Jun 05 17:52:35.796170 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.796143 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct"] Jun 05 17:52:35.798346 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:52:35.798307 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a07721e_1cf6_4804_b305_036bfb9ead6f.slice/crio-3a06a0f9c7fde22d1fdd95869842f62985f49d57e3c24a896dbd778cc7282efe WatchSource:0}: Error finding container 3a06a0f9c7fde22d1fdd95869842f62985f49d57e3c24a896dbd778cc7282efe: Status 404 returned error can't find the container with id 3a06a0f9c7fde22d1fdd95869842f62985f49d57e3c24a896dbd778cc7282efe Jun 05 17:52:35.799891 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.799863 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcr6k\" (UniqueName: \"kubernetes.io/projected/7afbf48c-ea69-49c8-a932-244e6422ba1d-kube-api-access-rcr6k\") pod \"network-check-source-dbd9cf844-szrts\" (UID: \"7afbf48c-ea69-49c8-a932-244e6422ba1d\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-szrts" Jun 05 17:52:35.831713 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.831589 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-szrts" Jun 05 17:52:35.878914 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.878882 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw"] Jun 05 17:52:35.881619 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:52:35.881580 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e220ca_335c_4845_8acc_ecf81256e56f.slice/crio-e63fab99c3657f7ec13aa4257060e32065f7e3a3c6c13bac3fa3b8ea6da4cf19 WatchSource:0}: Error finding container e63fab99c3657f7ec13aa4257060e32065f7e3a3c6c13bac3fa3b8ea6da4cf19: Status 404 returned error can't find the container with id e63fab99c3657f7ec13aa4257060e32065f7e3a3c6c13bac3fa3b8ea6da4cf19 Jun 05 17:52:35.965471 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:35.965441 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-szrts"] Jun 05 17:52:35.968054 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:52:35.968027 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7afbf48c_ea69_49c8_a932_244e6422ba1d.slice/crio-41897e41f04c1bf18128c9f36f723a2fd9dae485b636f697fcbe388d334cbcba WatchSource:0}: Error finding container 41897e41f04c1bf18128c9f36f723a2fd9dae485b636f697fcbe388d334cbcba: Status 404 returned error can't find the container with id 41897e41f04c1bf18128c9f36f723a2fd9dae485b636f697fcbe388d334cbcba Jun 05 17:52:36.015303 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:36.015278 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-59fjp"] Jun 05 17:52:36.019919 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:36.019893 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-5cgw9"] Jun 05 17:52:36.020437 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:52:36.020415 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e337b0e_8777_4211_b9b1_d295dd381440.slice/crio-36bbb86fa39bd047925caaaf3f5c3a4df88005370aaefa06e2be750047532c68 WatchSource:0}: Error finding container 36bbb86fa39bd047925caaaf3f5c3a4df88005370aaefa06e2be750047532c68: Status 404 returned error can't find the container with id 36bbb86fa39bd047925caaaf3f5c3a4df88005370aaefa06e2be750047532c68 Jun 05 17:52:36.022747 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:52:36.022722 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be1f372_fce4_4128_a3be_60be3efb2fb3.slice/crio-404f011b79aa700f45eaa4de7294a9e0994bc5d92cc5a12f9ffbef3c058da520 WatchSource:0}: Error finding container 404f011b79aa700f45eaa4de7294a9e0994bc5d92cc5a12f9ffbef3c058da520: Status 404 returned error can't find the container with id 404f011b79aa700f45eaa4de7294a9e0994bc5d92cc5a12f9ffbef3c058da520 Jun 05 17:52:36.161409 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:36.161323 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5cgw9" event={"ID":"6be1f372-fce4-4128-a3be-60be3efb2fb3","Type":"ContainerStarted","Data":"404f011b79aa700f45eaa4de7294a9e0994bc5d92cc5a12f9ffbef3c058da520"} Jun 05 17:52:36.162921 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:36.162885 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-szrts" event={"ID":"7afbf48c-ea69-49c8-a932-244e6422ba1d","Type":"ContainerStarted","Data":"c40f3b4c2a2ead6ff24797ccb7bcaa2a9e1ed650b52a38aecdb38a29fd24a13e"} Jun 05 17:52:36.163072 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:36.162935 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-szrts" event={"ID":"7afbf48c-ea69-49c8-a932-244e6422ba1d","Type":"ContainerStarted","Data":"41897e41f04c1bf18128c9f36f723a2fd9dae485b636f697fcbe388d334cbcba"} Jun 05 17:52:36.163951 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:36.163930 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" event={"ID":"c3e220ca-335c-4845-8acc-ecf81256e56f","Type":"ContainerStarted","Data":"e63fab99c3657f7ec13aa4257060e32065f7e3a3c6c13bac3fa3b8ea6da4cf19"} Jun 05 17:52:36.164933 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:36.164912 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" event={"ID":"3a07721e-1cf6-4804-b305-036bfb9ead6f","Type":"ContainerStarted","Data":"3a06a0f9c7fde22d1fdd95869842f62985f49d57e3c24a896dbd778cc7282efe"} Jun 05 17:52:36.165880 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:36.165859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" event={"ID":"3e337b0e-8777-4211-b9b1-d295dd381440","Type":"ContainerStarted","Data":"36bbb86fa39bd047925caaaf3f5c3a4df88005370aaefa06e2be750047532c68"} Jun 05 17:52:36.179696 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:36.179650 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-szrts" podStartSLOduration=1.179634334 podStartE2EDuration="1.179634334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:52:36.17899482 +0000 UTC m=+227.108043864" watchObservedRunningTime="2026-06-05 17:52:36.179634334 +0000 UTC m=+227.108683376" Jun 05 17:52:36.191375 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:36.191349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:36.191513 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:36.191496 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 17:52:36.191571 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:36.191559 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert podName:7d2181de-2880-4b30-bdc6-4c3c99f2d7ab nodeName:}" failed. No retries permitted until 2026-06-05 17:52:37.191545345 +0000 UTC m=+228.120594362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-srsjl" (UID: "7d2181de-2880-4b30-bdc6-4c3c99f2d7ab") : secret "networking-console-plugin-cert" not found Jun 05 17:52:37.025727 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:37.025655 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:37.125613 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:37.125564 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:37.200526 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:37.199957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:37.200526 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:37.200092 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 17:52:37.200526 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:37.200154 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert podName:7d2181de-2880-4b30-bdc6-4c3c99f2d7ab nodeName:}" failed. No retries permitted until 2026-06-05 17:52:39.200136234 +0000 UTC m=+230.129185256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-srsjl" (UID: "7d2181de-2880-4b30-bdc6-4c3c99f2d7ab") : secret "networking-console-plugin-cert" not found Jun 05 17:52:39.216957 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:39.216915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:39.217356 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:39.217036 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 17:52:39.217356 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:39.217123 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert podName:7d2181de-2880-4b30-bdc6-4c3c99f2d7ab nodeName:}" failed. No retries permitted until 2026-06-05 17:52:43.217098156 +0000 UTC m=+234.146147192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-srsjl" (UID: "7d2181de-2880-4b30-bdc6-4c3c99f2d7ab") : secret "networking-console-plugin-cert" not found Jun 05 17:52:40.181006 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.180960 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" event={"ID":"c3e220ca-335c-4845-8acc-ecf81256e56f","Type":"ContainerStarted","Data":"873b65eddbc0dd0d28a6cf924fbde3e3f7c796c3ae53058043fd56838a03ee4b"} Jun 05 17:52:40.182710 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.182676 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" event={"ID":"3a07721e-1cf6-4804-b305-036bfb9ead6f","Type":"ContainerStarted","Data":"35357945320a456ab554ce46b559d38eddc3ed826d5756aff1d843c5a1b039af"} Jun 05 17:52:40.184413 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.184389 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/0.log" Jun 05 17:52:40.184546 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.184430 2579 generic.go:356] "Generic (PLEG): container finished" podID="3e337b0e-8777-4211-b9b1-d295dd381440" containerID="3476b3ad823871dafce94b9d5e4aa5b8f7103276a98c2b11b549586da535a40b" exitCode=255 Jun 05 17:52:40.184546 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.184519 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" event={"ID":"3e337b0e-8777-4211-b9b1-d295dd381440","Type":"ContainerDied","Data":"3476b3ad823871dafce94b9d5e4aa5b8f7103276a98c2b11b549586da535a40b"} Jun 05 17:52:40.184683 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.184665 2579 scope.go:117] "RemoveContainer" containerID="3476b3ad823871dafce94b9d5e4aa5b8f7103276a98c2b11b549586da535a40b" Jun 05 17:52:40.186159 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.186137 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5cgw9" event={"ID":"6be1f372-fce4-4128-a3be-60be3efb2fb3","Type":"ContainerStarted","Data":"db2bab69749a23a0173edc52e45e1a086fa71dea01a6de186b792ceaff2dedb7"} Jun 05 17:52:40.200072 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.200020 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" podStartSLOduration=1.364536717 podStartE2EDuration="5.200004223s" totalImagesPullingTime="3.835467506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:52:40.199348997 +0000 UTC m=+231.128398035" watchObservedRunningTime="2026-06-05 17:52:40.200004223 +0000 UTC m=+231.129053257" Jun 05 17:52:40.255742 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.255689 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-5cgw9" podStartSLOduration=1.5551390779999998 podStartE2EDuration="5.255591103s" totalImagesPullingTime="3.700452025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:52:40.237445249 +0000 UTC m=+231.166494289" watchObservedRunningTime="2026-06-05 17:52:40.255591103 +0000 UTC m=+231.184640146" Jun 05 17:52:40.256194 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.256163 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" podStartSLOduration=1.332910321 podStartE2EDuration="5.256151332s" totalImagesPullingTime="3.923241011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:52:40.255014266 +0000 UTC m=+231.184063307" watchObservedRunningTime="2026-06-05 17:52:40.256151332 +0000 UTC m=+231.185200372" Jun 05 17:52:40.996925 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:40.996885 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:41.049303 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.049267 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:41.196030 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.196003 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 17:52:41.196434 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.196414 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/0.log" Jun 05 17:52:41.196502 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.196450 2579 generic.go:356] "Generic (PLEG): container finished" podID="3e337b0e-8777-4211-b9b1-d295dd381440" containerID="e37b5d71b7560d1351147b111171a65920c55dbef82b0b96f98555aeec7b4d5d" exitCode=255 Jun 05 17:52:41.196556 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.196524 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" event={"ID":"3e337b0e-8777-4211-b9b1-d295dd381440","Type":"ContainerDied","Data":"e37b5d71b7560d1351147b111171a65920c55dbef82b0b96f98555aeec7b4d5d"} Jun 05 17:52:41.196668 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.196630 2579 scope.go:117] "RemoveContainer" containerID="3476b3ad823871dafce94b9d5e4aa5b8f7103276a98c2b11b549586da535a40b" Jun 05 17:52:41.196840 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.196820 2579 scope.go:117] "RemoveContainer" containerID="e37b5d71b7560d1351147b111171a65920c55dbef82b0b96f98555aeec7b4d5d" Jun 05 17:52:41.197037 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:41.197015 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-59fjp_openshift-console-operator(3e337b0e-8777-4211-b9b1-d295dd381440)\"" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" podUID="3e337b0e-8777-4211-b9b1-d295dd381440" Jun 05 17:52:41.233352 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.233322 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:41.706717 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.706676 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:41.783174 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.783135 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt"] Jun 05 17:52:41.787841 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.787818 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt" Jun 05 17:52:41.790987 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.790967 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 05 17:52:41.791120 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.790968 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bqrfw\"" Jun 05 17:52:41.792399 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.792377 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 05 17:52:41.797473 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.797451 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt"] Jun 05 17:52:41.801717 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.801697 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:41.910088 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.910053 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:41.944401 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:41.944358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwl4n\" (UniqueName: \"kubernetes.io/projected/16ad1a55-cdcc-483f-87ec-e7455c7d54aa-kube-api-access-jwl4n\") pod \"migrator-955ffdf5f-z64rt\" (UID: \"16ad1a55-cdcc-483f-87ec-e7455c7d54aa\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt" Jun 05 17:52:42.044879 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:42.044842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwl4n\" (UniqueName: \"kubernetes.io/projected/16ad1a55-cdcc-483f-87ec-e7455c7d54aa-kube-api-access-jwl4n\") pod \"migrator-955ffdf5f-z64rt\" (UID: \"16ad1a55-cdcc-483f-87ec-e7455c7d54aa\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt" Jun 05 17:52:42.054381 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:42.054353 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwl4n\" (UniqueName: \"kubernetes.io/projected/16ad1a55-cdcc-483f-87ec-e7455c7d54aa-kube-api-access-jwl4n\") pod \"migrator-955ffdf5f-z64rt\" (UID: \"16ad1a55-cdcc-483f-87ec-e7455c7d54aa\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt" Jun 05 17:52:42.098328 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:42.098296 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt" Jun 05 17:52:42.201104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:42.201081 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 17:52:42.201460 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:42.201439 2579 scope.go:117] "RemoveContainer" containerID="e37b5d71b7560d1351147b111171a65920c55dbef82b0b96f98555aeec7b4d5d" Jun 05 17:52:42.201638 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:42.201618 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-59fjp_openshift-console-operator(3e337b0e-8777-4211-b9b1-d295dd381440)\"" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" podUID="3e337b0e-8777-4211-b9b1-d295dd381440" Jun 05 17:52:42.223663 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:42.223637 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt"] Jun 05 17:52:42.227459 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:52:42.227434 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ad1a55_cdcc_483f_87ec_e7455c7d54aa.slice/crio-638c645889b4508054d0ccc008b224539b4fc8bb3b2fc5d98381ac3c7672f3f9 WatchSource:0}: Error finding container 638c645889b4508054d0ccc008b224539b4fc8bb3b2fc5d98381ac3c7672f3f9: Status 404 returned error can't find the container with id 638c645889b4508054d0ccc008b224539b4fc8bb3b2fc5d98381ac3c7672f3f9 Jun 05 17:52:43.209076 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:43.209030 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt" event={"ID":"16ad1a55-cdcc-483f-87ec-e7455c7d54aa","Type":"ContainerStarted","Data":"638c645889b4508054d0ccc008b224539b4fc8bb3b2fc5d98381ac3c7672f3f9"} Jun 05 17:52:43.255647 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:43.255593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:43.255790 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:43.255734 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 17:52:43.255847 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:43.255806 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert podName:7d2181de-2880-4b30-bdc6-4c3c99f2d7ab nodeName:}" failed. No retries permitted until 2026-06-05 17:52:51.2557903 +0000 UTC m=+242.184839319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-srsjl" (UID: "7d2181de-2880-4b30-bdc6-4c3c99f2d7ab") : secret "networking-console-plugin-cert" not found Jun 05 17:52:43.387754 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:43.387718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:43.740436 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:43.740413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ptprv_d4a9dc88-1354-44a8-9e1b-b2333eb4aaef/dns-node-resolver/0.log" Jun 05 17:52:44.213668 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:44.213631 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt" event={"ID":"16ad1a55-cdcc-483f-87ec-e7455c7d54aa","Type":"ContainerStarted","Data":"66fc59f83818604dd99df15a14dcf9840a2a2eac5dfd9b8a101b8681039ac3a5"} Jun 05 17:52:44.214027 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:44.213688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt" event={"ID":"16ad1a55-cdcc-483f-87ec-e7455c7d54aa","Type":"ContainerStarted","Data":"90542d27c26b1a4ed6299aede5ba998a6df8a228e1bbefa9ad7bb610b903cfef"} Jun 05 17:52:44.256698 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:44.256646 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-z64rt" podStartSLOduration=1.943736307 podStartE2EDuration="3.256631084s" totalImagesPullingTime="1.312894777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:52:44.256214393 +0000 UTC m=+235.185263431" watchObservedRunningTime="2026-06-05 17:52:44.256631084 +0000 UTC m=+235.185680120" Jun 05 17:52:44.350266 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:44.350234 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:44.542139 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:44.542109 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fvqnk_601e5e3a-9aab-4925-8397-6e07d29e761f/node-ca/0.log" Jun 05 17:52:45.541288 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:45.541260 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fz9zj_ec5314a2-68ff-40b9-8eec-b90afd721fe8/serve-healthcheck-canary/0.log" Jun 05 17:52:45.653200 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:45.653109 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:45.653200 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:45.653170 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:45.653497 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:45.653486 2579 scope.go:117] "RemoveContainer" containerID="e37b5d71b7560d1351147b111171a65920c55dbef82b0b96f98555aeec7b4d5d" Jun 05 17:52:45.653690 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:45.653671 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-59fjp_openshift-console-operator(3e337b0e-8777-4211-b9b1-d295dd381440)\"" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" podUID="3e337b0e-8777-4211-b9b1-d295dd381440" Jun 05 17:52:46.443221 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:46.443193 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:46.544851 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:46.544817 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:46.723555 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:46.723477 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:46.822589 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:46.822559 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:46.922672 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:46.922635 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:47.147682 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:47.147634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:47.259908 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:47.259879 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:48.104304 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:48.104277 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:48.195290 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:48.195253 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:48.336104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:48.336077 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:48.539480 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:48.539450 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:48.745089 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:48.745063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:48.937514 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:48.937439 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:49.151076 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:49.151043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:50.135569 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:50.135533 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:50.339419 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:50.339386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:50.396900 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:50.396825 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:50.665182 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:50.665103 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:50.766653 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:50.766620 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:50.834662 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:50.834619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:50.937929 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:50.937850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:51.312091 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:51.312056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:52:51.312263 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:51.312175 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 17:52:51.312263 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:52:51.312232 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert podName:7d2181de-2880-4b30-bdc6-4c3c99f2d7ab nodeName:}" failed. No retries permitted until 2026-06-05 17:53:07.312218227 +0000 UTC m=+258.241267244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-srsjl" (UID: "7d2181de-2880-4b30-bdc6-4c3c99f2d7ab") : secret "networking-console-plugin-cert" not found Jun 05 17:52:51.337258 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:51.337230 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:51.938271 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:51.938241 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:52.339039 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:52.339013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:52.539885 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:52.539856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:52.889723 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:52.889674 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:52.991243 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:52.991212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:53.539028 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:53.538996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:53.741330 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:53.741295 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:53.935808 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:53.935717 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:54.346501 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:54.346462 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:55.139663 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:55.139630 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:55.349096 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:55.349065 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:55.539832 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:55.539798 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:55.727290 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:55.727260 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:55.830112 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:55.830037 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:55.934755 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:55.934726 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:56.528027 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:56.527994 2579 scope.go:117] "RemoveContainer" containerID="e37b5d71b7560d1351147b111171a65920c55dbef82b0b96f98555aeec7b4d5d" Jun 05 17:52:56.737949 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:56.737914 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:56.938408 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:56.938324 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:57.133739 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.133707 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:57.255881 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.255854 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 17:52:57.256017 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.255935 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" event={"ID":"3e337b0e-8777-4211-b9b1-d295dd381440","Type":"ContainerStarted","Data":"d3ee83e677f961492767148569123df6752877ca322d9163059c2cffb0a1ae9a"} Jun 05 17:52:57.256282 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.256265 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:57.260719 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.260696 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" Jun 05 17:52:57.274356 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.274311 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-59fjp" podStartSLOduration=18.578551932 podStartE2EDuration="22.274299593s" totalImagesPullingTime="3.695747661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:52:57.273972542 +0000 UTC m=+248.203021591" watchObservedRunningTime="2026-06-05 17:52:57.274299593 +0000 UTC m=+248.203348683" Jun 05 17:52:57.353398 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.353356 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:57.469862 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.469825 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:57.653846 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.653756 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:57.756433 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.756402 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:57.857532 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:57.857503 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:58.034980 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:58.034948 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:58.132657 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:58.132626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:58.233781 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:58.233753 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:58.333825 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:58.333739 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:58.440232 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:58.440201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:58.664652 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:58.664561 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:58.767893 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:58.767860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:59.042046 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:59.042009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:59.243107 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:59.243077 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:52:59.380261 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:52:59.380179 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:00.670587 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:00.670555 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:00.772296 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:00.772265 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:01.388170 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:01.388123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:53:01.390514 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:01.390492 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecd92b6d-f844-48c9-917a-0c65a7b05adb-metrics-certs\") pod \"network-metrics-daemon-kpv87\" (UID: \"ecd92b6d-f844-48c9-917a-0c65a7b05adb\") " pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:53:01.631095 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:01.631066 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42j2w\"" Jun 05 17:53:01.638569 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:01.638500 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kpv87" Jun 05 17:53:01.766609 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:01.766551 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kpv87"] Jun 05 17:53:01.770946 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:01.770915 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd92b6d_f844_48c9_917a_0c65a7b05adb.slice/crio-93e1bbd4acd9a0830a4fdf07ab171e17bde27fa9ec5ca86e8e5238a8f43a9937 WatchSource:0}: Error finding container 93e1bbd4acd9a0830a4fdf07ab171e17bde27fa9ec5ca86e8e5238a8f43a9937: Status 404 returned error can't find the container with id 93e1bbd4acd9a0830a4fdf07ab171e17bde27fa9ec5ca86e8e5238a8f43a9937 Jun 05 17:53:01.896677 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:01.896553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:01.959048 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:01.958999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:02.270374 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:02.270321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kpv87" event={"ID":"ecd92b6d-f844-48c9-917a-0c65a7b05adb","Type":"ContainerStarted","Data":"93e1bbd4acd9a0830a4fdf07ab171e17bde27fa9ec5ca86e8e5238a8f43a9937"} Jun 05 17:53:03.274986 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:03.274947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kpv87" event={"ID":"ecd92b6d-f844-48c9-917a-0c65a7b05adb","Type":"ContainerStarted","Data":"dc1abe5b64e92da041266691221bfe93c0bcd7f95b94382d3faa10d332a438d8"} Jun 05 17:53:03.275377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:03.275002 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kpv87" event={"ID":"ecd92b6d-f844-48c9-917a-0c65a7b05adb","Type":"ContainerStarted","Data":"82c3f90c289dd1b6c36304d51c3ac5741c221a14c02414456c60e0d9da31bf67"} Jun 05 17:53:03.292064 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:03.292010 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kpv87" podStartSLOduration=253.384628641 podStartE2EDuration="4m14.291994548s" totalImagesPullingTime="907.365907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:03.291249471 +0000 UTC m=+254.220298510" watchObservedRunningTime="2026-06-05 17:53:03.291994548 +0000 UTC m=+254.221043587" Jun 05 17:53:05.692486 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.692452 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-tmf5r"] Jun 05 17:53:05.695611 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.695583 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-tmf5r" Jun 05 17:53:05.698780 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.698760 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 17:53:05.698944 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.698927 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fdhw9\"" Jun 05 17:53:05.701637 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.701595 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 17:53:05.707146 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.707125 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-tmf5r"] Jun 05 17:53:05.725431 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.725399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxrx\" (UniqueName: \"kubernetes.io/projected/1c9ce558-fe57-4bd3-a057-ce76a0f10769-kube-api-access-8cxrx\") pod \"downloads-6657875f97-tmf5r\" (UID: \"1c9ce558-fe57-4bd3-a057-ce76a0f10769\") " pod="openshift-console/downloads-6657875f97-tmf5r" Jun 05 17:53:05.763225 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.763187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:05.825856 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.825822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxrx\" (UniqueName: \"kubernetes.io/projected/1c9ce558-fe57-4bd3-a057-ce76a0f10769-kube-api-access-8cxrx\") pod \"downloads-6657875f97-tmf5r\" (UID: \"1c9ce558-fe57-4bd3-a057-ce76a0f10769\") " pod="openshift-console/downloads-6657875f97-tmf5r" Jun 05 17:53:05.864538 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.864495 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hgsfj"] Jun 05 17:53:05.867778 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.867754 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:05.868027 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.868001 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxrx\" (UniqueName: \"kubernetes.io/projected/1c9ce558-fe57-4bd3-a057-ce76a0f10769-kube-api-access-8cxrx\") pod \"downloads-6657875f97-tmf5r\" (UID: \"1c9ce558-fe57-4bd3-a057-ce76a0f10769\") " pod="openshift-console/downloads-6657875f97-tmf5r" Jun 05 17:53:05.880791 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:53:05.880760 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-hgsfj\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="11c3f739-7ab2-4145-9033-1647ccd03065" pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:05.885326 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:53:05.885301 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-mz8gr\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mz8gr\"" type="*v1.Secret" Jun 05 17:53:05.885405 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:53:05.885366 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jun 05 17:53:05.913160 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:53:05.913119 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jun 05 17:53:05.926220 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.926187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11c3f739-7ab2-4145-9033-1647ccd03065-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:05.926220 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.926221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrm2p\" (UniqueName: \"kubernetes.io/projected/11c3f739-7ab2-4145-9033-1647ccd03065-kube-api-access-zrm2p\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:05.926364 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.926257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11c3f739-7ab2-4145-9033-1647ccd03065-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:05.926364 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.926303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11c3f739-7ab2-4145-9033-1647ccd03065-crio-socket\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:05.926364 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.926323 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11c3f739-7ab2-4145-9033-1647ccd03065-data-volume\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:05.935366 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.935339 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hgsfj"] Jun 05 17:53:05.938724 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:05.938695 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:06.005842 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.005812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-tmf5r" Jun 05 17:53:06.027289 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.027254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11c3f739-7ab2-4145-9033-1647ccd03065-crio-socket\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:06.027289 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.027286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11c3f739-7ab2-4145-9033-1647ccd03065-data-volume\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:06.027451 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.027377 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11c3f739-7ab2-4145-9033-1647ccd03065-crio-socket\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:06.027485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.027450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11c3f739-7ab2-4145-9033-1647ccd03065-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:06.027485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.027476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrm2p\" (UniqueName: \"kubernetes.io/projected/11c3f739-7ab2-4145-9033-1647ccd03065-kube-api-access-zrm2p\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:06.027548 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.027505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11c3f739-7ab2-4145-9033-1647ccd03065-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:06.027730 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.027715 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11c3f739-7ab2-4145-9033-1647ccd03065-data-volume\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:06.031889 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.031860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:06.035489 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.035466 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrm2p\" (UniqueName: \"kubernetes.io/projected/11c3f739-7ab2-4145-9033-1647ccd03065-kube-api-access-zrm2p\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:06.137194 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.137161 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:06.147264 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.147227 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-tmf5r"] Jun 05 17:53:06.151130 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:06.151101 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9ce558_fe57_4bd3_a057_ce76a0f10769.slice/crio-41a92838dad89656430d6e060a0a33452ec7d21053464e43ef2bfe51f8a72ac0 WatchSource:0}: Error finding container 41a92838dad89656430d6e060a0a33452ec7d21053464e43ef2bfe51f8a72ac0: Status 404 returned error can't find the container with id 41a92838dad89656430d6e060a0a33452ec7d21053464e43ef2bfe51f8a72ac0 Jun 05 17:53:06.283689 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.283587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-tmf5r" event={"ID":"1c9ce558-fe57-4bd3-a057-ce76a0f10769","Type":"ContainerStarted","Data":"41a92838dad89656430d6e060a0a33452ec7d21053464e43ef2bfe51f8a72ac0"} Jun 05 17:53:06.749363 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.749330 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mz8gr\"" Jun 05 17:53:06.764546 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.764511 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 17:53:06.770097 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.770073 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11c3f739-7ab2-4145-9033-1647ccd03065-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:06.823999 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.823963 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 17:53:06.828329 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:06.828301 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11c3f739-7ab2-4145-9033-1647ccd03065-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hgsfj\" (UID: \"11c3f739-7ab2-4145-9033-1647ccd03065\") " pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:07.080775 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:07.080682 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hgsfj" Jun 05 17:53:07.210986 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:07.210816 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hgsfj"] Jun 05 17:53:07.213967 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:07.213939 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c3f739_7ab2_4145_9033_1647ccd03065.slice/crio-f3968fef6818be9fcd9f77cd21f73c63d995d3bd25f518a2097da6480ad8cf28 WatchSource:0}: Error finding container f3968fef6818be9fcd9f77cd21f73c63d995d3bd25f518a2097da6480ad8cf28: Status 404 returned error can't find the container with id f3968fef6818be9fcd9f77cd21f73c63d995d3bd25f518a2097da6480ad8cf28 Jun 05 17:53:07.289203 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:07.289163 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgsfj" event={"ID":"11c3f739-7ab2-4145-9033-1647ccd03065","Type":"ContainerStarted","Data":"f3968fef6818be9fcd9f77cd21f73c63d995d3bd25f518a2097da6480ad8cf28"} Jun 05 17:53:07.339078 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:07.338992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:53:07.341688 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:07.341663 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7d2181de-2880-4b30-bdc6-4c3c99f2d7ab-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-srsjl\" (UID: \"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:53:07.552028 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:07.551998 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wbbf8\"" Jun 05 17:53:07.559661 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:07.559636 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" Jun 05 17:53:07.721111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:07.721056 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl"] Jun 05 17:53:07.724172 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:07.724141 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2181de_2880_4b30_bdc6_4c3c99f2d7ab.slice/crio-fb51bce36b9eac61dce5fd078e3398040e0383460f3eaadf23264e1a32c0f6b6 WatchSource:0}: Error finding container fb51bce36b9eac61dce5fd078e3398040e0383460f3eaadf23264e1a32c0f6b6: Status 404 returned error can't find the container with id fb51bce36b9eac61dce5fd078e3398040e0383460f3eaadf23264e1a32c0f6b6 Jun 05 17:53:08.295141 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:08.295103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgsfj" event={"ID":"11c3f739-7ab2-4145-9033-1647ccd03065","Type":"ContainerStarted","Data":"e21ad4ea175df406a048868a09b0e38b1f405811af8ca7b64eb03b89398f5ce7"} Jun 05 17:53:08.295689 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:08.295182 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgsfj" event={"ID":"11c3f739-7ab2-4145-9033-1647ccd03065","Type":"ContainerStarted","Data":"c0f5ce9f3f212600266a5881cad01e4bbd1f9ba0c49e89ecb333bf4970422f2d"} Jun 05 17:53:08.296430 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:08.296393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" event={"ID":"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab","Type":"ContainerStarted","Data":"fb51bce36b9eac61dce5fd078e3398040e0383460f3eaadf23264e1a32c0f6b6"} Jun 05 17:53:09.645699 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.645666 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:09.745907 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.745876 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:09.817187 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.817158 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6"] Jun 05 17:53:09.822947 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.822921 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6" Jun 05 17:53:09.826077 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.826052 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 05 17:53:09.826212 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.826099 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-77xgz\"" Jun 05 17:53:09.833465 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.833438 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6"] Jun 05 17:53:09.833892 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.833851 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:09.861454 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.861423 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/801ea9b4-06bc-4318-b38b-42ef11599e7b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-b28x6\" (UID: \"801ea9b4-06bc-4318-b38b-42ef11599e7b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6" Jun 05 17:53:09.894496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.894465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:09.962571 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.962484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/801ea9b4-06bc-4318-b38b-42ef11599e7b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-b28x6\" (UID: \"801ea9b4-06bc-4318-b38b-42ef11599e7b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6" Jun 05 17:53:09.965144 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:09.965119 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/801ea9b4-06bc-4318-b38b-42ef11599e7b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-b28x6\" (UID: \"801ea9b4-06bc-4318-b38b-42ef11599e7b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6" Jun 05 17:53:10.134763 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:10.134712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6" Jun 05 17:53:10.265736 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:10.265703 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6"] Jun 05 17:53:10.269662 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:10.269627 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801ea9b4_06bc_4318_b38b_42ef11599e7b.slice/crio-3e7b8b005cedcc95dfd1ee8c2c78330f0e3accb29c36048f23708048406e119d WatchSource:0}: Error finding container 3e7b8b005cedcc95dfd1ee8c2c78330f0e3accb29c36048f23708048406e119d: Status 404 returned error can't find the container with id 3e7b8b005cedcc95dfd1ee8c2c78330f0e3accb29c36048f23708048406e119d Jun 05 17:53:10.309755 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:10.309701 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hgsfj" event={"ID":"11c3f739-7ab2-4145-9033-1647ccd03065","Type":"ContainerStarted","Data":"6506f052650227efe51b50114f9317ed53ceda2d325d3fa6c5905802938fb586"} Jun 05 17:53:10.311024 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:10.310999 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6" event={"ID":"801ea9b4-06bc-4318-b38b-42ef11599e7b","Type":"ContainerStarted","Data":"3e7b8b005cedcc95dfd1ee8c2c78330f0e3accb29c36048f23708048406e119d"} Jun 05 17:53:10.312728 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:10.312699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" event={"ID":"7d2181de-2880-4b30-bdc6-4c3c99f2d7ab","Type":"ContainerStarted","Data":"85c2cdc37afb64e80cca28ad62888f058377706880cd456f08fdb81ecfca47e9"} Jun 05 17:53:10.329422 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:10.329369 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hgsfj" podStartSLOduration=2.954162784 podStartE2EDuration="5.3293495s" totalImagesPullingTime="2.375186716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 17:53:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:10.328157568 +0000 UTC m=+261.257206639" watchObservedRunningTime="2026-06-05 17:53:10.3293495 +0000 UTC m=+261.258398543" Jun 05 17:53:10.344198 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:10.344154 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-srsjl" podStartSLOduration=33.338253398 podStartE2EDuration="35.344139928s" totalImagesPullingTime="2.00588653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:10.343078506 +0000 UTC m=+261.272127545" watchObservedRunningTime="2026-06-05 17:53:10.344139928 +0000 UTC m=+261.273188966" Jun 05 17:53:10.473560 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:10.473476 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:10.532706 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:10.532661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:11.665986 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.665861 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:11.720506 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.720476 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:11.886807 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.886774 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85b8b6fdf5-8m7sd"] Jun 05 17:53:11.892251 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.892227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:11.895323 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.895303 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 17:53:11.895462 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.895443 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 17:53:11.896919 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.896901 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 17:53:11.897011 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.896924 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 17:53:11.897011 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.896974 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pzlgh\"" Jun 05 17:53:11.897011 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.896983 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 17:53:11.901059 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.901014 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b8b6fdf5-8m7sd"] Jun 05 17:53:11.978977 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.978896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-console-config\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:11.978977 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.978955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-oauth-serving-cert\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:11.979184 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.979017 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xjv7\" (UniqueName: \"kubernetes.io/projected/bb37389b-dbd8-4759-9a19-5ce1df498759-kube-api-access-4xjv7\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:11.979184 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.979047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-serving-cert\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:11.979184 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.979074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-service-ca\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:11.979184 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:11.979159 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-oauth-config\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.080334 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.080296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-serving-cert\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.080334 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.080339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-service-ca\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.080577 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.080373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-oauth-config\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.080577 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.080408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-console-config\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.080577 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.080428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-oauth-serving-cert\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.080577 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.080473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xjv7\" (UniqueName: \"kubernetes.io/projected/bb37389b-dbd8-4759-9a19-5ce1df498759-kube-api-access-4xjv7\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.081108 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.081080 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-service-ca\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.081205 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.081145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-console-config\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.081246 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.081203 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-oauth-serving-cert\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.082838 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.082818 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-oauth-config\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.082920 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.082818 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-serving-cert\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.088967 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.088947 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xjv7\" (UniqueName: \"kubernetes.io/projected/bb37389b-dbd8-4759-9a19-5ce1df498759-kube-api-access-4xjv7\") pod \"console-85b8b6fdf5-8m7sd\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.202168 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.202128 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:12.324321 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.324283 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6" event={"ID":"801ea9b4-06bc-4318-b38b-42ef11599e7b","Type":"ContainerStarted","Data":"1c40d8a80e0377a412809af50162c4061c7763b25e4277cc5b272b677fbee279"} Jun 05 17:53:12.324797 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.324717 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6" Jun 05 17:53:12.331401 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.331332 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6" Jun 05 17:53:12.341128 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.341086 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-b28x6" podStartSLOduration=2.223899994 podStartE2EDuration="3.341071477s" totalImagesPullingTime="1.117171483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:12.340541333 +0000 UTC m=+263.269590375" watchObservedRunningTime="2026-06-05 17:53:12.341071477 +0000 UTC m=+263.270120510" Jun 05 17:53:12.352112 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.352082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:12.369937 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.369883 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b8b6fdf5-8m7sd"] Jun 05 17:53:12.373436 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:12.373406 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb37389b_dbd8_4759_9a19_5ce1df498759.slice/crio-11dea865f34983e2283b7f9f007aad4e8778595cad463eddc574bd6cc65f169e WatchSource:0}: Error finding container 11dea865f34983e2283b7f9f007aad4e8778595cad463eddc574bd6cc65f169e: Status 404 returned error can't find the container with id 11dea865f34983e2283b7f9f007aad4e8778595cad463eddc574bd6cc65f169e Jun 05 17:53:12.452746 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.452718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:12.841779 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.841747 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:12.886452 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.886421 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xgln5"] Jun 05 17:53:12.912921 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.912890 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xgln5"] Jun 05 17:53:12.913068 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.913027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:12.916113 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.916088 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 05 17:53:12.916249 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.916181 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 17:53:12.917645 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.917623 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kb79n\"" Jun 05 17:53:12.917769 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.917709 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 17:53:12.917769 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.917719 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 17:53:12.917871 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.917809 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 05 17:53:12.934351 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.934331 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:12.989428 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.989394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4r4g\" (UniqueName: \"kubernetes.io/projected/a11869d5-2571-44d4-b7b6-163522f712e0-kube-api-access-j4r4g\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:12.989582 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.989475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a11869d5-2571-44d4-b7b6-163522f712e0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:12.989582 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.989514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a11869d5-2571-44d4-b7b6-163522f712e0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:12.989726 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:12.989624 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a11869d5-2571-44d4-b7b6-163522f712e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.090552 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.090509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a11869d5-2571-44d4-b7b6-163522f712e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.090759 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.090572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4r4g\" (UniqueName: \"kubernetes.io/projected/a11869d5-2571-44d4-b7b6-163522f712e0-kube-api-access-j4r4g\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.090759 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.090650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a11869d5-2571-44d4-b7b6-163522f712e0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.090759 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.090683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a11869d5-2571-44d4-b7b6-163522f712e0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.090925 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:53:13.090801 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 05 17:53:13.090925 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:53:13.090868 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a11869d5-2571-44d4-b7b6-163522f712e0-prometheus-operator-tls podName:a11869d5-2571-44d4-b7b6-163522f712e0 nodeName:}" failed. No retries permitted until 2026-06-05 17:53:13.590849611 +0000 UTC m=+264.519898633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a11869d5-2571-44d4-b7b6-163522f712e0-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-xgln5" (UID: "a11869d5-2571-44d4-b7b6-163522f712e0") : secret "prometheus-operator-tls" not found Jun 05 17:53:13.091437 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.091410 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a11869d5-2571-44d4-b7b6-163522f712e0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.093627 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.093519 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a11869d5-2571-44d4-b7b6-163522f712e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.100150 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.099988 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4r4g\" (UniqueName: \"kubernetes.io/projected/a11869d5-2571-44d4-b7b6-163522f712e0-kube-api-access-j4r4g\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.147554 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.147526 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:13.263104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.263067 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:13.322637 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.322591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:13.328769 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.328730 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b8b6fdf5-8m7sd" event={"ID":"bb37389b-dbd8-4759-9a19-5ce1df498759","Type":"ContainerStarted","Data":"11dea865f34983e2283b7f9f007aad4e8778595cad463eddc574bd6cc65f169e"} Jun 05 17:53:13.595962 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.595926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a11869d5-2571-44d4-b7b6-163522f712e0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.598707 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.598677 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a11869d5-2571-44d4-b7b6-163522f712e0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xgln5\" (UID: \"a11869d5-2571-44d4-b7b6-163522f712e0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.822371 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.822332 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" Jun 05 17:53:13.997878 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:13.997698 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xgln5"] Jun 05 17:53:14.333663 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:14.333625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" event={"ID":"a11869d5-2571-44d4-b7b6-163522f712e0","Type":"ContainerStarted","Data":"eb2dc3b07b2966103af066cdf25e66cc69c6f319fb2ff49f51db9ee8f229e11b"} Jun 05 17:53:15.067417 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:15.067375 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:15.168466 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:15.168391 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:16.345810 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:16.345775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" event={"ID":"a11869d5-2571-44d4-b7b6-163522f712e0","Type":"ContainerStarted","Data":"12b479b938a6c381fc6167c0969703a247b3c3b0c9daea771849e7f16ed00104"} Jun 05 17:53:16.348169 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:16.348141 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b8b6fdf5-8m7sd" event={"ID":"bb37389b-dbd8-4759-9a19-5ce1df498759","Type":"ContainerStarted","Data":"e321ce1663d746d775c29997334e413deea0d9f4949aed7506270a6d9a34952c"} Jun 05 17:53:16.366752 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:16.366697 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85b8b6fdf5-8m7sd" podStartSLOduration=1.52511138 podStartE2EDuration="5.366678037s" totalImagesPullingTime="3.841566657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:16.365632027 +0000 UTC m=+267.294681075" watchObservedRunningTime="2026-06-05 17:53:16.366678037 +0000 UTC m=+267.295727077" Jun 05 17:53:16.519539 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:16.519457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:16.617862 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:16.617820 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:17.356145 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:17.356096 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" event={"ID":"a11869d5-2571-44d4-b7b6-163522f712e0","Type":"ContainerStarted","Data":"0d2723a11847f0b11b96546552a28386107273bfeda3c1a922c7bd898de7cf6a"} Jun 05 17:53:18.983616 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:18.983568 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:19.086702 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.086660 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:19.198366 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.198327 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:19.257957 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.257853 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xgln5" podStartSLOduration=5.042919354 podStartE2EDuration="7.257834102s" totalImagesPullingTime="2.214914748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:17.373933146 +0000 UTC m=+268.302982188" watchObservedRunningTime="2026-06-05 17:53:19.257834102 +0000 UTC m=+270.186883141" Jun 05 17:53:19.258119 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.258020 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n"] Jun 05 17:53:19.261261 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.261241 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.264547 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.264522 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8pwbk\"" Jun 05 17:53:19.264547 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.264543 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 17:53:19.264735 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.264690 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 17:53:19.273553 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.273526 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n"] Jun 05 17:53:19.283941 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.283920 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn"] Jun 05 17:53:19.287961 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.287933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:19.288703 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.288676 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.292334 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.292314 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 05 17:53:19.292478 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.292393 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 05 17:53:19.292656 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.292637 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ktht7\"" Jun 05 17:53:19.292797 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.292779 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 05 17:53:19.304850 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.304826 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-stgmm"] Jun 05 17:53:19.308362 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.308334 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn"] Jun 05 17:53:19.308471 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.308453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.311527 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.311504 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 17:53:19.311683 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.311558 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-chqsh\"" Jun 05 17:53:19.311747 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.311689 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 17:53:19.311819 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.311797 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 17:53:19.351802 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.351770 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8nlr\" (UniqueName: \"kubernetes.io/projected/22e6b257-c7d2-4593-90c7-0ff247d5207c-kube-api-access-f8nlr\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.351802 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.351807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22e6b257-c7d2-4593-90c7-0ff247d5207c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.352056 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.351846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/023fec53-f003-4d05-a0bc-ee08bc365f6f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.352056 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.351921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.352056 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.351985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22e6b257-c7d2-4593-90c7-0ff247d5207c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.352189 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.352061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.352189 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.352094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.352189 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.352143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svrkl\" (UniqueName: \"kubernetes.io/projected/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-api-access-svrkl\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.352189 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.352174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/023fec53-f003-4d05-a0bc-ee08bc365f6f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.352337 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.352236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22e6b257-c7d2-4593-90c7-0ff247d5207c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.364769 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.364725 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:19.452709 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.452672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2fc76e6-f0e9-4abe-9073-979464b72ddc-sys\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.452709 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.452717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-accelerators-collector-config\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.452969 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.452756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-wtmp\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.452969 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.452792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8nlr\" (UniqueName: \"kubernetes.io/projected/22e6b257-c7d2-4593-90c7-0ff247d5207c-kube-api-access-f8nlr\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.452969 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.452824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22e6b257-c7d2-4593-90c7-0ff247d5207c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.452969 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.452842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsdhh\" (UniqueName: \"kubernetes.io/projected/d2fc76e6-f0e9-4abe-9073-979464b72ddc-kube-api-access-bsdhh\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.452969 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.452889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/023fec53-f003-4d05-a0bc-ee08bc365f6f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.452969 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.452914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-textfile\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.452969 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.452940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2fc76e6-f0e9-4abe-9073-979464b72ddc-metrics-client-ca\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.452980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.453009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22e6b257-c7d2-4593-90c7-0ff247d5207c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.453063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.453093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.453120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svrkl\" (UniqueName: \"kubernetes.io/projected/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-api-access-svrkl\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.453153 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/023fec53-f003-4d05-a0bc-ee08bc365f6f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.453199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2fc76e6-f0e9-4abe-9073-979464b72ddc-root\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.453232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22e6b257-c7d2-4593-90c7-0ff247d5207c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.453275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.453321 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-tls\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.453377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.453341 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/023fec53-f003-4d05-a0bc-ee08bc365f6f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.454225 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.454195 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.454331 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.454202 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/023fec53-f003-4d05-a0bc-ee08bc365f6f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.455674 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.455646 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22e6b257-c7d2-4593-90c7-0ff247d5207c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.456221 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.456194 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.456696 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.456653 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.456804 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.456705 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22e6b257-c7d2-4593-90c7-0ff247d5207c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.457152 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.457066 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22e6b257-c7d2-4593-90c7-0ff247d5207c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.463256 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.463230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8nlr\" (UniqueName: \"kubernetes.io/projected/22e6b257-c7d2-4593-90c7-0ff247d5207c-kube-api-access-f8nlr\") pod \"openshift-state-metrics-65f78d5c66-hnb4n\" (UID: \"22e6b257-c7d2-4593-90c7-0ff247d5207c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.465016 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.464987 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svrkl\" (UniqueName: \"kubernetes.io/projected/023fec53-f003-4d05-a0bc-ee08bc365f6f-kube-api-access-svrkl\") pod \"kube-state-metrics-57bbf8bfb5-cdwtn\" (UID: \"023fec53-f003-4d05-a0bc-ee08bc365f6f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.469458 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.469431 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:19.554053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.553963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2fc76e6-f0e9-4abe-9073-979464b72ddc-sys\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-accelerators-collector-config\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554272 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-wtmp\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554272 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsdhh\" (UniqueName: \"kubernetes.io/projected/d2fc76e6-f0e9-4abe-9073-979464b72ddc-kube-api-access-bsdhh\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554272 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554089 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2fc76e6-f0e9-4abe-9073-979464b72ddc-sys\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554272 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554209 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-wtmp\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554272 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-textfile\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554272 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2fc76e6-f0e9-4abe-9073-979464b72ddc-metrics-client-ca\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554572 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2fc76e6-f0e9-4abe-9073-979464b72ddc-root\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554572 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554394 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554572 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554457 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2fc76e6-f0e9-4abe-9073-979464b72ddc-root\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554572 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554501 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-textfile\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554572 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-tls\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554828 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554758 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-accelerators-collector-config\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.554955 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.554925 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2fc76e6-f0e9-4abe-9073-979464b72ddc-metrics-client-ca\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.556931 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.556899 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-tls\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.556931 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.556910 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2fc76e6-f0e9-4abe-9073-979464b72ddc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.563716 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.563666 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsdhh\" (UniqueName: \"kubernetes.io/projected/d2fc76e6-f0e9-4abe-9073-979464b72ddc-kube-api-access-bsdhh\") pod \"node-exporter-stgmm\" (UID: \"d2fc76e6-f0e9-4abe-9073-979464b72ddc\") " pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.572155 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.572133 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" Jun 05 17:53:19.573541 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.573475 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:19.600825 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.600797 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" Jun 05 17:53:19.620221 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.620194 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-stgmm" Jun 05 17:53:19.672488 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:19.672459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:20.080782 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:20.080723 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:20.202721 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:20.202689 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:20.289546 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:20.289508 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:20.403004 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:20.402928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:20.510769 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:20.510684 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:22.139443 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:22.139406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:22.203191 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:22.203156 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:22.203357 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:22.203247 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:22.204813 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:22.204776 2579 patch_prober.go:28] interesting pod/console-85b8b6fdf5-8m7sd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 05 17:53:22.204943 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:22.204837 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85b8b6fdf5-8m7sd" podUID="bb37389b-dbd8-4759-9a19-5ce1df498759" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 05 17:53:22.241456 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:22.241412 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:22.306137 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:22.306103 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:22.366683 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:22.366646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:23.471444 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.471408 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:23.537125 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.537094 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d59948bdd-klhmr"] Jun 05 17:53:23.539693 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.539670 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.540072 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.540043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:23.544557 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.544534 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 05 17:53:23.544557 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.544547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 05 17:53:23.544557 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.544559 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qn9dk\"" Jun 05 17:53:23.544777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.544554 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 17:53:23.544777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.544671 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 05 17:53:23.544947 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.544929 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8att78098uv9v\"" Jun 05 17:53:23.551310 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.551285 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d59948bdd-klhmr"] Jun 05 17:53:23.696771 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.696734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79965f85-651c-40b6-9e83-ad46ece8ebea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.696951 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.696838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79965f85-651c-40b6-9e83-ad46ece8ebea-client-ca-bundle\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.696951 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.696906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79965f85-651c-40b6-9e83-ad46ece8ebea-audit-log\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.696951 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.696935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79965f85-651c-40b6-9e83-ad46ece8ebea-metrics-server-audit-profiles\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.697109 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.696998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79965f85-651c-40b6-9e83-ad46ece8ebea-secret-metrics-server-client-certs\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.697109 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.697025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79965f85-651c-40b6-9e83-ad46ece8ebea-secret-metrics-server-tls\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.697109 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.697058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlh4\" (UniqueName: \"kubernetes.io/projected/79965f85-651c-40b6-9e83-ad46ece8ebea-kube-api-access-9dlh4\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.798226 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.798176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79965f85-651c-40b6-9e83-ad46ece8ebea-audit-log\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.798419 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.798236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79965f85-651c-40b6-9e83-ad46ece8ebea-metrics-server-audit-profiles\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.798419 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.798307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79965f85-651c-40b6-9e83-ad46ece8ebea-secret-metrics-server-client-certs\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.798419 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.798337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79965f85-651c-40b6-9e83-ad46ece8ebea-secret-metrics-server-tls\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.798419 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.798367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlh4\" (UniqueName: \"kubernetes.io/projected/79965f85-651c-40b6-9e83-ad46ece8ebea-kube-api-access-9dlh4\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.798419 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.798401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79965f85-651c-40b6-9e83-ad46ece8ebea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.798716 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.798488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79965f85-651c-40b6-9e83-ad46ece8ebea-client-ca-bundle\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.798716 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.798700 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79965f85-651c-40b6-9e83-ad46ece8ebea-audit-log\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.799329 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.799301 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79965f85-651c-40b6-9e83-ad46ece8ebea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.799442 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.799399 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79965f85-651c-40b6-9e83-ad46ece8ebea-metrics-server-audit-profiles\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.801499 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.801474 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79965f85-651c-40b6-9e83-ad46ece8ebea-client-ca-bundle\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.801593 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.801509 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79965f85-651c-40b6-9e83-ad46ece8ebea-secret-metrics-server-tls\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.801593 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.801558 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79965f85-651c-40b6-9e83-ad46ece8ebea-secret-metrics-server-client-certs\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.807640 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.807597 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlh4\" (UniqueName: \"kubernetes.io/projected/79965f85-651c-40b6-9e83-ad46ece8ebea-kube-api-access-9dlh4\") pod \"metrics-server-7d59948bdd-klhmr\" (UID: \"79965f85-651c-40b6-9e83-ad46ece8ebea\") " pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:23.851592 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:23.851556 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:24.007901 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.007860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:24.069840 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.069755 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:24.283630 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.283582 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b8b6fdf5-8m7sd"] Jun 05 17:53:24.310955 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.310889 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bfc844db4-v4rkd"] Jun 05 17:53:24.313574 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.313552 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.321338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.321254 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 17:53:24.324895 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.324844 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bfc844db4-v4rkd"] Jun 05 17:53:24.404714 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.404664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-oauth-config\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.404901 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.404719 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-console-config\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.404901 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.404750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-oauth-serving-cert\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.404901 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.404775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-service-ca\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.404901 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.404834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9gzt\" (UniqueName: \"kubernetes.io/projected/4a478214-6980-4547-9f68-47a17cd918c7-kube-api-access-f9gzt\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.404901 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.404872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-serving-cert\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.405107 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.404925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-trusted-ca-bundle\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.466767 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.466740 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:24.505889 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.505857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-trusted-ca-bundle\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.506347 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.505987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-oauth-config\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.506347 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.506018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-console-config\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.506347 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.506052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-oauth-serving-cert\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.506347 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.506128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-service-ca\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.506347 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.506178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9gzt\" (UniqueName: \"kubernetes.io/projected/4a478214-6980-4547-9f68-47a17cd918c7-kube-api-access-f9gzt\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.506347 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.506221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-serving-cert\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.506829 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.506808 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-oauth-serving-cert\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.506944 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.506923 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-service-ca\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.506987 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.506933 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-trusted-ca-bundle\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.507267 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.507216 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-console-config\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.509043 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.509011 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-serving-cert\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.509318 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.509298 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-oauth-config\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.514806 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.514786 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9gzt\" (UniqueName: \"kubernetes.io/projected/4a478214-6980-4547-9f68-47a17cd918c7-kube-api-access-f9gzt\") pod \"console-bfc844db4-v4rkd\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.626949 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:24.626852 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:24.964879 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:24.964820 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2fc76e6_f0e9_4abe_9073_979464b72ddc.slice/crio-91e5f5006d7ae9819f434c77c45f370e633b2f48e86257aacb4295aa5a7df021 WatchSource:0}: Error finding container 91e5f5006d7ae9819f434c77c45f370e633b2f48e86257aacb4295aa5a7df021: Status 404 returned error can't find the container with id 91e5f5006d7ae9819f434c77c45f370e633b2f48e86257aacb4295aa5a7df021 Jun 05 17:53:25.081352 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.081281 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:25.108305 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.107913 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bfc844db4-v4rkd"] Jun 05 17:53:25.110577 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:25.110473 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a478214_6980_4547_9f68_47a17cd918c7.slice/crio-4088a31618bb901a69ebe54aed72b60bb3da8a3f6adbb977b5fe07851e3e8cc2 WatchSource:0}: Error finding container 4088a31618bb901a69ebe54aed72b60bb3da8a3f6adbb977b5fe07851e3e8cc2: Status 404 returned error can't find the container with id 4088a31618bb901a69ebe54aed72b60bb3da8a3f6adbb977b5fe07851e3e8cc2 Jun 05 17:53:25.138980 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.138951 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d59948bdd-klhmr"] Jun 05 17:53:25.144706 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:25.144665 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79965f85_651c_40b6_9e83_ad46ece8ebea.slice/crio-1618d8327a9a5764629869b542d9e1dcb3cc8447aa8abc071ad2d958900d0eb1 WatchSource:0}: Error finding container 1618d8327a9a5764629869b542d9e1dcb3cc8447aa8abc071ad2d958900d0eb1: Status 404 returned error can't find the container with id 1618d8327a9a5764629869b542d9e1dcb3cc8447aa8abc071ad2d958900d0eb1 Jun 05 17:53:25.158780 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.158758 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn"] Jun 05 17:53:25.160619 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:25.160583 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023fec53_f003_4d05_a0bc_ee08bc365f6f.slice/crio-a4faa32a1220306f28fabe29e1e18b3b27e44590fcf64b52134313fdc8886b32 WatchSource:0}: Error finding container a4faa32a1220306f28fabe29e1e18b3b27e44590fcf64b52134313fdc8886b32: Status 404 returned error can't find the container with id a4faa32a1220306f28fabe29e1e18b3b27e44590fcf64b52134313fdc8886b32 Jun 05 17:53:25.164349 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.164328 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:25.304100 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.304051 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:25.368984 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.368951 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n"] Jun 05 17:53:25.371861 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:25.371831 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e6b257_c7d2_4593_90c7_0ff247d5207c.slice/crio-08d00e156a20e228dcb05e1eb0209599b747d0ee535a65f01409c0c995a77912 WatchSource:0}: Error finding container 08d00e156a20e228dcb05e1eb0209599b747d0ee535a65f01409c0c995a77912: Status 404 returned error can't find the container with id 08d00e156a20e228dcb05e1eb0209599b747d0ee535a65f01409c0c995a77912 Jun 05 17:53:25.384354 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.384319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:25.392467 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.392437 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" event={"ID":"023fec53-f003-4d05-a0bc-ee08bc365f6f","Type":"ContainerStarted","Data":"a4faa32a1220306f28fabe29e1e18b3b27e44590fcf64b52134313fdc8886b32"} Jun 05 17:53:25.394321 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.394294 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-stgmm" event={"ID":"d2fc76e6-f0e9-4abe-9073-979464b72ddc","Type":"ContainerStarted","Data":"91e5f5006d7ae9819f434c77c45f370e633b2f48e86257aacb4295aa5a7df021"} Jun 05 17:53:25.397109 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.397014 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" event={"ID":"79965f85-651c-40b6-9e83-ad46ece8ebea","Type":"ContainerStarted","Data":"1618d8327a9a5764629869b542d9e1dcb3cc8447aa8abc071ad2d958900d0eb1"} Jun 05 17:53:25.401592 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.401565 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bfc844db4-v4rkd" event={"ID":"4a478214-6980-4547-9f68-47a17cd918c7","Type":"ContainerStarted","Data":"396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85"} Jun 05 17:53:25.401791 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.401771 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bfc844db4-v4rkd" event={"ID":"4a478214-6980-4547-9f68-47a17cd918c7","Type":"ContainerStarted","Data":"4088a31618bb901a69ebe54aed72b60bb3da8a3f6adbb977b5fe07851e3e8cc2"} Jun 05 17:53:25.404059 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.403963 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" event={"ID":"22e6b257-c7d2-4593-90c7-0ff247d5207c","Type":"ContainerStarted","Data":"08d00e156a20e228dcb05e1eb0209599b747d0ee535a65f01409c0c995a77912"} Jun 05 17:53:25.405776 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.405731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-tmf5r" event={"ID":"1c9ce558-fe57-4bd3-a057-ce76a0f10769","Type":"ContainerStarted","Data":"c4a7e1f66efa21856f29ab3853be4156350588e77207b0994c7a3c3d237c47e0"} Jun 05 17:53:25.406031 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.406005 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-tmf5r" Jun 05 17:53:25.414816 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.414766 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-tmf5r" Jun 05 17:53:25.468225 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.466661 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bfc844db4-v4rkd" podStartSLOduration=1.4666400290000001 podStartE2EDuration="1.466640029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:25.435212577 +0000 UTC m=+276.364261618" watchObservedRunningTime="2026-06-05 17:53:25.466640029 +0000 UTC m=+276.395689049" Jun 05 17:53:25.468225 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.467560 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-tmf5r" podStartSLOduration=1.579040719 podStartE2EDuration="20.467546094s" totalImagesPullingTime="18.888505375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:25.463581876 +0000 UTC m=+276.392630915" watchObservedRunningTime="2026-06-05 17:53:25.467546094 +0000 UTC m=+276.396595133" Jun 05 17:53:25.513813 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:25.513573 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:26.416072 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:26.416033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" event={"ID":"22e6b257-c7d2-4593-90c7-0ff247d5207c","Type":"ContainerStarted","Data":"aa87a20566aaa51b07bf39f35d038de4a5432bb5988c3ae16917b50e4affc8c0"} Jun 05 17:53:26.416265 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:26.416099 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" event={"ID":"22e6b257-c7d2-4593-90c7-0ff247d5207c","Type":"ContainerStarted","Data":"9bc573bce3590ed2fed49887434c21727eb6b5e101c3443e532919a512276682"} Jun 05 17:53:27.727888 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:27.727808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:27.779098 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:27.779065 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:28.273010 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.272975 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c787c696d-bhhg7"] Jun 05 17:53:28.290282 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.290249 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c787c696d-bhhg7"] Jun 05 17:53:28.290460 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.290371 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.450877 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.450581 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-oauth-serving-cert\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.450877 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.450696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-trusted-ca-bundle\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.450877 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.450731 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmqr2\" (UniqueName: \"kubernetes.io/projected/25350199-7a66-4f3c-a06e-6750f0abb9d3-kube-api-access-hmqr2\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.450877 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.450783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-serving-cert\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.450877 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.450828 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-config\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.450877 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.450852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-service-ca\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.451239 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.450889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-oauth-config\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.551846 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.551808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-oauth-serving-cert\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.552068 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.551887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-trusted-ca-bundle\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.552068 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.551920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqr2\" (UniqueName: \"kubernetes.io/projected/25350199-7a66-4f3c-a06e-6750f0abb9d3-kube-api-access-hmqr2\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.552068 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.551967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-serving-cert\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.552068 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.552014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-config\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.552068 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.552044 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-service-ca\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.552330 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.552086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-oauth-config\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.552839 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.552715 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-oauth-serving-cert\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.552981 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.552861 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-trusted-ca-bundle\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.552981 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.552936 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-config\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.553091 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.553025 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-service-ca\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.555233 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.555206 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-oauth-config\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.555233 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.555218 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-serving-cert\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.561579 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.561531 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmqr2\" (UniqueName: \"kubernetes.io/projected/25350199-7a66-4f3c-a06e-6750f0abb9d3-kube-api-access-hmqr2\") pod \"console-7c787c696d-bhhg7\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.604634 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.604581 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:28.826692 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:28.823340 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c787c696d-bhhg7"] Jun 05 17:53:29.433662 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.433593 2579 generic.go:356] "Generic (PLEG): container finished" podID="d2fc76e6-f0e9-4abe-9073-979464b72ddc" containerID="9da1970599b63e17b7a4d3e53937960e176520046dbe42e396a5b689bfa3ddf2" exitCode=0 Jun 05 17:53:29.433901 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.433660 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-stgmm" event={"ID":"d2fc76e6-f0e9-4abe-9073-979464b72ddc","Type":"ContainerDied","Data":"9da1970599b63e17b7a4d3e53937960e176520046dbe42e396a5b689bfa3ddf2"} Jun 05 17:53:29.435630 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.435575 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" event={"ID":"79965f85-651c-40b6-9e83-ad46ece8ebea","Type":"ContainerStarted","Data":"20d362c32f0bb8449db1244b65058f9426959834b35c4d3c3b9b80df48a2574c"} Jun 05 17:53:29.437392 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.437366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c787c696d-bhhg7" event={"ID":"25350199-7a66-4f3c-a06e-6750f0abb9d3","Type":"ContainerStarted","Data":"8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858"} Jun 05 17:53:29.437516 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.437410 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c787c696d-bhhg7" event={"ID":"25350199-7a66-4f3c-a06e-6750f0abb9d3","Type":"ContainerStarted","Data":"5267c2af5c5b66ba225cdfd69039ba37a0fa1aa6e7027d2adef8c75f0dad91df"} Jun 05 17:53:29.439839 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.439815 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" event={"ID":"22e6b257-c7d2-4593-90c7-0ff247d5207c","Type":"ContainerStarted","Data":"615428b81cd15c7d3c7c7d22c09937e7d635f597b566ba5220aed0196fc7014a"} Jun 05 17:53:29.442427 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.442400 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" event={"ID":"023fec53-f003-4d05-a0bc-ee08bc365f6f","Type":"ContainerStarted","Data":"c96cb8dfdf2cbcc6f06870ce5a482cc4bf363e1a52acbe41ad2c8c994fe7def1"} Jun 05 17:53:29.442516 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.442447 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" event={"ID":"023fec53-f003-4d05-a0bc-ee08bc365f6f","Type":"ContainerStarted","Data":"811d550335b7277c791cb32f308293091a417e327ba9286ba285d6666ec31d5f"} Jun 05 17:53:29.442516 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.442472 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" event={"ID":"023fec53-f003-4d05-a0bc-ee08bc365f6f","Type":"ContainerStarted","Data":"85405cf80b28fb5629ac1a71b92aa4fd423023e4d6d30a3c2c44b17665254c2a"} Jun 05 17:53:29.471159 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.471109 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cdwtn" podStartSLOduration=7.006941648 podStartE2EDuration="10.471089785s" totalImagesPullingTime="3.464148137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:29.470834169 +0000 UTC m=+280.399883213" watchObservedRunningTime="2026-06-05 17:53:29.471089785 +0000 UTC m=+280.400138825" Jun 05 17:53:29.489214 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.489172 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hnb4n" podStartSLOduration=7.1276817470000005 podStartE2EDuration="10.489152617s" totalImagesPullingTime="3.36147087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:29.489015425 +0000 UTC m=+280.418064475" watchObservedRunningTime="2026-06-05 17:53:29.489152617 +0000 UTC m=+280.418201655" Jun 05 17:53:29.516814 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.513761 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c787c696d-bhhg7" podStartSLOduration=1.513739484 podStartE2EDuration="1.513739484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:29.512201348 +0000 UTC m=+280.441250414" watchObservedRunningTime="2026-06-05 17:53:29.513739484 +0000 UTC m=+280.442788525" Jun 05 17:53:29.535924 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:29.535862 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" podStartSLOduration=3.05312841 podStartE2EDuration="6.535843057s" totalImagesPullingTime="3.482714647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:29.534645886 +0000 UTC m=+280.463694925" watchObservedRunningTime="2026-06-05 17:53:29.535843057 +0000 UTC m=+280.464892097" Jun 05 17:53:29.997753 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:53:29.997703 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" podUID="f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" Jun 05 17:53:29.998279 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:53:29.997704 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nmpjh" podUID="4fda909c-c3d9-4e7b-929a-4226cd4df135" Jun 05 17:53:30.450736 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:30.450647 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-stgmm" event={"ID":"d2fc76e6-f0e9-4abe-9073-979464b72ddc","Type":"ContainerStarted","Data":"16ffe8deac2a4ae4ffb2cd0687f80dd4afc48a9cda6b4a4e726219ac63c97a03"} Jun 05 17:53:30.450736 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:30.450674 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:53:30.450736 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:30.450723 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-stgmm" event={"ID":"d2fc76e6-f0e9-4abe-9073-979464b72ddc","Type":"ContainerStarted","Data":"931e4826c2808eab07ee6662d69528a6a891aefca1b53b988a41b6dd46a6fc2e"} Jun 05 17:53:30.451255 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:30.451229 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nmpjh" Jun 05 17:53:30.473136 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:30.473075 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-stgmm" podStartSLOduration=7.692733614 podStartE2EDuration="11.473057332s" totalImagesPullingTime="3.637894926s" totalInitContainerRuntime="142.428792ms" isStatefulPod=true podCreationTimestamp="2026-06-05 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:30.471264744 +0000 UTC m=+281.400313844" watchObservedRunningTime="2026-06-05 17:53:30.473057332 +0000 UTC m=+281.402106365" Jun 05 17:53:33.911783 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:33.911749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:53:33.912261 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:33.911855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:53:33.914280 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:33.914253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fda909c-c3d9-4e7b-929a-4226cd4df135-metrics-tls\") pod \"dns-default-nmpjh\" (UID: \"4fda909c-c3d9-4e7b-929a-4226cd4df135\") " pod="openshift-dns/dns-default-nmpjh" Jun 05 17:53:33.914467 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:33.914328 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"image-registry-76866d48b4-qzn57\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:53:34.054897 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.054867 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c4cc\"" Jun 05 17:53:34.056103 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.056085 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vknkw\"" Jun 05 17:53:34.062423 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.062401 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:53:34.062524 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.062505 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nmpjh" Jun 05 17:53:34.232272 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.232137 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76866d48b4-qzn57"] Jun 05 17:53:34.234410 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:34.234381 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b0f00e_17d7_4dce_a845_5d4aa3df90cd.slice/crio-064ac20b1f8880f77367c5f7298f1d03329633e8755d8d47a137007ea99a7fab WatchSource:0}: Error finding container 064ac20b1f8880f77367c5f7298f1d03329633e8755d8d47a137007ea99a7fab: Status 404 returned error can't find the container with id 064ac20b1f8880f77367c5f7298f1d03329633e8755d8d47a137007ea99a7fab Jun 05 17:53:34.257140 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.257114 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nmpjh"] Jun 05 17:53:34.260414 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:53:34.260387 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fda909c_c3d9_4e7b_929a_4226cd4df135.slice/crio-ac1aada9060e710b354a9928293ff257149aba108dcf8eefd7ac06dec4e91651 WatchSource:0}: Error finding container ac1aada9060e710b354a9928293ff257149aba108dcf8eefd7ac06dec4e91651: Status 404 returned error can't find the container with id ac1aada9060e710b354a9928293ff257149aba108dcf8eefd7ac06dec4e91651 Jun 05 17:53:34.470847 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.470753 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" event={"ID":"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd","Type":"ContainerStarted","Data":"e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6"} Jun 05 17:53:34.470847 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.470819 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:53:34.470847 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.470844 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" event={"ID":"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd","Type":"ContainerStarted","Data":"064ac20b1f8880f77367c5f7298f1d03329633e8755d8d47a137007ea99a7fab"} Jun 05 17:53:34.472010 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.471982 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nmpjh" event={"ID":"4fda909c-c3d9-4e7b-929a-4226cd4df135","Type":"ContainerStarted","Data":"ac1aada9060e710b354a9928293ff257149aba108dcf8eefd7ac06dec4e91651"} Jun 05 17:53:34.496923 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.496865 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" podStartSLOduration=284.496843967 podStartE2EDuration="4m44.496843967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:34.494323041 +0000 UTC m=+285.423372104" watchObservedRunningTime="2026-06-05 17:53:34.496843967 +0000 UTC m=+285.425893008" Jun 05 17:53:34.627344 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.627301 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:34.627543 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.627372 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:34.628826 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.628798 2579 patch_prober.go:28] interesting pod/console-bfc844db4-v4rkd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 05 17:53:34.628931 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.628851 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-bfc844db4-v4rkd" podUID="4a478214-6980-4547-9f68-47a17cd918c7" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 05 17:53:34.776112 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.776069 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:34.834522 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:34.834489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:36.483392 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:36.483351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nmpjh" event={"ID":"4fda909c-c3d9-4e7b-929a-4226cd4df135","Type":"ContainerStarted","Data":"707be3b3a8e5d17cd325d87632ffc81f073bebe55850c10ac53c05c4e1d2c1c0"} Jun 05 17:53:37.489158 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:37.489122 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nmpjh" event={"ID":"4fda909c-c3d9-4e7b-929a-4226cd4df135","Type":"ContainerStarted","Data":"5007aca4eb11e253bbc3e9ad1da52858467337be6fc8f24f41870d4a77eea072"} Jun 05 17:53:37.489683 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:37.489270 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nmpjh" Jun 05 17:53:37.507593 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:37.507545 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nmpjh" podStartSLOduration=252.434698822 podStartE2EDuration="4m14.50752962s" totalImagesPullingTime="2.072830798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:53:37.506712506 +0000 UTC m=+288.435761564" watchObservedRunningTime="2026-06-05 17:53:37.50752962 +0000 UTC m=+288.436578699" Jun 05 17:53:38.605180 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:38.605143 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:38.605590 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:38.605203 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:38.606588 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:38.606566 2579 patch_prober.go:28] interesting pod/console-7c787c696d-bhhg7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" start-of-body= Jun 05 17:53:38.606659 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:38.606634 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7c787c696d-bhhg7" podUID="25350199-7a66-4f3c-a06e-6750f0abb9d3" containerName="console" probeResult="failure" output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" Jun 05 17:53:39.129369 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:39.129337 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:39.193412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:39.193375 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:43.852258 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:43.852222 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:43.852745 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:43.852287 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:53:44.410336 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:44.410305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:44.509587 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:44.509552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:44.627564 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:44.627524 2579 patch_prober.go:28] interesting pod/console-bfc844db4-v4rkd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jun 05 17:53:44.627737 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:44.627616 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-bfc844db4-v4rkd" podUID="4a478214-6980-4547-9f68-47a17cd918c7" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jun 05 17:53:46.534538 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:46.534505 2579 generic.go:356] "Generic (PLEG): container finished" podID="c3e220ca-335c-4845-8acc-ecf81256e56f" containerID="873b65eddbc0dd0d28a6cf924fbde3e3f7c796c3ae53058043fd56838a03ee4b" exitCode=0 Jun 05 17:53:46.535025 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:46.534576 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" event={"ID":"c3e220ca-335c-4845-8acc-ecf81256e56f","Type":"ContainerDied","Data":"873b65eddbc0dd0d28a6cf924fbde3e3f7c796c3ae53058043fd56838a03ee4b"} Jun 05 17:53:46.535025 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:46.534915 2579 scope.go:117] "RemoveContainer" containerID="873b65eddbc0dd0d28a6cf924fbde3e3f7c796c3ae53058043fd56838a03ee4b" Jun 05 17:53:47.495562 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:47.495527 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nmpjh" Jun 05 17:53:47.540377 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:47.540346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-qrkcw" event={"ID":"c3e220ca-335c-4845-8acc-ecf81256e56f","Type":"ContainerStarted","Data":"fc330b9033d6e0b829146fd29276f6ff63c1e4db727d3c8af522f0fac777dd34"} Jun 05 17:53:48.605835 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:48.605799 2579 patch_prober.go:28] interesting pod/console-7c787c696d-bhhg7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" start-of-body= Jun 05 17:53:48.606233 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:48.605856 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7c787c696d-bhhg7" podUID="25350199-7a66-4f3c-a06e-6750f0abb9d3" containerName="console" probeResult="failure" output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" Jun 05 17:53:49.306624 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:49.306569 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85b8b6fdf5-8m7sd" podUID="bb37389b-dbd8-4759-9a19-5ce1df498759" containerName="console" containerID="cri-o://e321ce1663d746d775c29997334e413deea0d9f4949aed7506270a6d9a34952c" gracePeriod=15 Jun 05 17:53:49.484091 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:49.484064 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 17:53:49.485031 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:49.485005 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 17:53:49.499632 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:49.499593 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 17:53:51.558655 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.558592 2579 generic.go:356] "Generic (PLEG): container finished" podID="bb37389b-dbd8-4759-9a19-5ce1df498759" containerID="e321ce1663d746d775c29997334e413deea0d9f4949aed7506270a6d9a34952c" exitCode=0 Jun 05 17:53:51.559033 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.558669 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b8b6fdf5-8m7sd" event={"ID":"bb37389b-dbd8-4759-9a19-5ce1df498759","Type":"ContainerDied","Data":"e321ce1663d746d775c29997334e413deea0d9f4949aed7506270a6d9a34952c"} Jun 05 17:53:51.651398 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.651373 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:51.766520 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.766489 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-service-ca\") pod \"bb37389b-dbd8-4759-9a19-5ce1df498759\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " Jun 05 17:53:51.766737 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.766540 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xjv7\" (UniqueName: \"kubernetes.io/projected/bb37389b-dbd8-4759-9a19-5ce1df498759-kube-api-access-4xjv7\") pod \"bb37389b-dbd8-4759-9a19-5ce1df498759\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " Jun 05 17:53:51.766737 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.766575 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-oauth-config\") pod \"bb37389b-dbd8-4759-9a19-5ce1df498759\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " Jun 05 17:53:51.766737 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.766633 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-serving-cert\") pod \"bb37389b-dbd8-4759-9a19-5ce1df498759\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " Jun 05 17:53:51.766888 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.766764 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-oauth-serving-cert\") pod \"bb37389b-dbd8-4759-9a19-5ce1df498759\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " Jun 05 17:53:51.766888 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.766806 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-console-config\") pod \"bb37389b-dbd8-4759-9a19-5ce1df498759\" (UID: \"bb37389b-dbd8-4759-9a19-5ce1df498759\") " Jun 05 17:53:51.767110 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.767080 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-service-ca" (OuterVolumeSpecName: "service-ca") pod "bb37389b-dbd8-4759-9a19-5ce1df498759" (UID: "bb37389b-dbd8-4759-9a19-5ce1df498759"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:53:51.767237 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.767178 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-console-config" (OuterVolumeSpecName: "console-config") pod "bb37389b-dbd8-4759-9a19-5ce1df498759" (UID: "bb37389b-dbd8-4759-9a19-5ce1df498759"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:53:51.767237 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.767215 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bb37389b-dbd8-4759-9a19-5ce1df498759" (UID: "bb37389b-dbd8-4759-9a19-5ce1df498759"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:53:51.768897 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.768872 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bb37389b-dbd8-4759-9a19-5ce1df498759" (UID: "bb37389b-dbd8-4759-9a19-5ce1df498759"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:53:51.769175 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.769144 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bb37389b-dbd8-4759-9a19-5ce1df498759" (UID: "bb37389b-dbd8-4759-9a19-5ce1df498759"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:53:51.769175 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.769164 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb37389b-dbd8-4759-9a19-5ce1df498759-kube-api-access-4xjv7" (OuterVolumeSpecName: "kube-api-access-4xjv7") pod "bb37389b-dbd8-4759-9a19-5ce1df498759" (UID: "bb37389b-dbd8-4759-9a19-5ce1df498759"). InnerVolumeSpecName "kube-api-access-4xjv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:53:51.867962 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.867925 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-oauth-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:53:51.867962 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.867955 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-console-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:53:51.867962 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.867965 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb37389b-dbd8-4759-9a19-5ce1df498759-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:53:51.868176 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.867973 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xjv7\" (UniqueName: \"kubernetes.io/projected/bb37389b-dbd8-4759-9a19-5ce1df498759-kube-api-access-4xjv7\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:53:51.868176 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.867981 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-oauth-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:53:51.868176 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:51.867991 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb37389b-dbd8-4759-9a19-5ce1df498759-console-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:53:52.563812 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:52.563773 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b8b6fdf5-8m7sd" Jun 05 17:53:52.564225 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:52.563813 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b8b6fdf5-8m7sd" event={"ID":"bb37389b-dbd8-4759-9a19-5ce1df498759","Type":"ContainerDied","Data":"11dea865f34983e2283b7f9f007aad4e8778595cad463eddc574bd6cc65f169e"} Jun 05 17:53:52.564225 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:52.563873 2579 scope.go:117] "RemoveContainer" containerID="e321ce1663d746d775c29997334e413deea0d9f4949aed7506270a6d9a34952c" Jun 05 17:53:52.587289 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:52.587260 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b8b6fdf5-8m7sd"] Jun 05 17:53:52.591921 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:52.591898 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85b8b6fdf5-8m7sd"] Jun 05 17:53:53.534962 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:53.533733 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb37389b-dbd8-4759-9a19-5ce1df498759" path="/var/lib/kubelet/pods/bb37389b-dbd8-4759-9a19-5ce1df498759/volumes" Jun 05 17:53:54.016814 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:54.016775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:54.066892 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:54.066859 2579 patch_prober.go:28] interesting pod/image-registry-76866d48b4-qzn57 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 17:53:54.067037 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:54.066912 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" podUID="f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:53:54.072103 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:54.072076 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:54.631894 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:54.631864 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:54.635705 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:54.635679 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:53:54.788105 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:54.788047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:54.846396 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:54.846365 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:55.156028 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:55.155996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:55.255483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:55.255449 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:55.482013 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:55.481993 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:53:55.577561 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:55.577532 2579 generic.go:356] "Generic (PLEG): container finished" podID="3a07721e-1cf6-4804-b305-036bfb9ead6f" containerID="35357945320a456ab554ce46b559d38eddc3ed826d5756aff1d843c5a1b039af" exitCode=0 Jun 05 17:53:55.577735 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:55.577632 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" event={"ID":"3a07721e-1cf6-4804-b305-036bfb9ead6f","Type":"ContainerDied","Data":"35357945320a456ab554ce46b559d38eddc3ed826d5756aff1d843c5a1b039af"} Jun 05 17:53:55.578050 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:55.578036 2579 scope.go:117] "RemoveContainer" containerID="35357945320a456ab554ce46b559d38eddc3ed826d5756aff1d843c5a1b039af" Jun 05 17:53:55.668992 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:55.668962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:55.770981 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:55.770881 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:56.584844 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:56.584809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-tcvct" event={"ID":"3a07721e-1cf6-4804-b305-036bfb9ead6f","Type":"ContainerStarted","Data":"cb25753e76a25f3b3e567ab94f8201cfae6c41b776d7ba4110b413c84b98dec0"} Jun 05 17:53:56.702710 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:56.702681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:56.803319 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:56.803266 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:56.902666 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:56.902553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:57.727267 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:57.727226 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:57.783143 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:57.783111 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:58.609317 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:58.609290 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:58.612918 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:58.612896 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:53:58.688091 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:58.688057 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bfc844db4-v4rkd"] Jun 05 17:53:58.798564 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:58.798527 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:58.950564 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:58.950485 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:53:59.016010 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:53:59.015973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:01.607661 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:01.607628 2579 generic.go:356] "Generic (PLEG): container finished" podID="6be1f372-fce4-4128-a3be-60be3efb2fb3" containerID="db2bab69749a23a0173edc52e45e1a086fa71dea01a6de186b792ceaff2dedb7" exitCode=0 Jun 05 17:54:01.608106 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:01.607688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5cgw9" event={"ID":"6be1f372-fce4-4128-a3be-60be3efb2fb3","Type":"ContainerDied","Data":"db2bab69749a23a0173edc52e45e1a086fa71dea01a6de186b792ceaff2dedb7"} Jun 05 17:54:01.608106 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:01.608071 2579 scope.go:117] "RemoveContainer" containerID="db2bab69749a23a0173edc52e45e1a086fa71dea01a6de186b792ceaff2dedb7" Jun 05 17:54:02.614725 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:02.614691 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-5cgw9" event={"ID":"6be1f372-fce4-4128-a3be-60be3efb2fb3","Type":"ContainerStarted","Data":"9793a47054ff76e3cabe9842767d4be102d31ae069ad759c553421ec738d1178"} Jun 05 17:54:03.629002 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:03.628973 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nmpjh_4fda909c-c3d9-4e7b-929a-4226cd4df135/dns/0.log" Jun 05 17:54:03.830406 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:03.830371 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nmpjh_4fda909c-c3d9-4e7b-929a-4226cd4df135/kube-rbac-proxy/0.log" Jun 05 17:54:03.857737 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:03.857708 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:54:03.861889 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:03.861859 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d59948bdd-klhmr" Jun 05 17:54:04.630449 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:04.630417 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ptprv_d4a9dc88-1354-44a8-9e1b-b2333eb4aaef/dns-node-resolver/0.log" Jun 05 17:54:05.430375 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:05.430345 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fz9zj_ec5314a2-68ff-40b9-8eec-b90afd721fe8/serve-healthcheck-canary/0.log" Jun 05 17:54:05.665643 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:05.665594 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:05.723677 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:05.723571 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:05.886971 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:05.886931 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:05.942963 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:05.942931 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:06.183384 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:06.183349 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76866d48b4-qzn57"] Jun 05 17:54:06.278353 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:06.278318 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:06.380807 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:06.380773 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:06.479426 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:06.479346 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:13.585205 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:13.585171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:13.685005 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:13.684968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:17.389994 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:17.389961 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:17.461579 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:17.461546 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:19.655638 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:19.655586 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:19.755993 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:19.755962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:19.814606 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:19.814572 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:23.709510 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:23.709443 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bfc844db4-v4rkd" podUID="4a478214-6980-4547-9f68-47a17cd918c7" containerName="console" containerID="cri-o://396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85" gracePeriod=15 Jun 05 17:54:23.947487 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:23.947462 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:54:24.052947 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.052914 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-service-ca\") pod \"4a478214-6980-4547-9f68-47a17cd918c7\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " Jun 05 17:54:24.053146 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.052970 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-oauth-config\") pod \"4a478214-6980-4547-9f68-47a17cd918c7\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " Jun 05 17:54:24.053146 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.052993 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-console-config\") pod \"4a478214-6980-4547-9f68-47a17cd918c7\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " Jun 05 17:54:24.053146 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.053014 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-serving-cert\") pod \"4a478214-6980-4547-9f68-47a17cd918c7\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " Jun 05 17:54:24.053146 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.053044 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-oauth-serving-cert\") pod \"4a478214-6980-4547-9f68-47a17cd918c7\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " Jun 05 17:54:24.053146 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.053082 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9gzt\" (UniqueName: \"kubernetes.io/projected/4a478214-6980-4547-9f68-47a17cd918c7-kube-api-access-f9gzt\") pod \"4a478214-6980-4547-9f68-47a17cd918c7\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " Jun 05 17:54:24.053419 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.053194 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-trusted-ca-bundle\") pod \"4a478214-6980-4547-9f68-47a17cd918c7\" (UID: \"4a478214-6980-4547-9f68-47a17cd918c7\") " Jun 05 17:54:24.053419 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.053317 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "4a478214-6980-4547-9f68-47a17cd918c7" (UID: "4a478214-6980-4547-9f68-47a17cd918c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:24.053576 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.053544 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:24.053734 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.053636 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-console-config" (OuterVolumeSpecName: "console-config") pod "4a478214-6980-4547-9f68-47a17cd918c7" (UID: "4a478214-6980-4547-9f68-47a17cd918c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:24.053734 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.053686 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4a478214-6980-4547-9f68-47a17cd918c7" (UID: "4a478214-6980-4547-9f68-47a17cd918c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:24.053734 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.053696 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4a478214-6980-4547-9f68-47a17cd918c7" (UID: "4a478214-6980-4547-9f68-47a17cd918c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:24.055203 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.055177 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4a478214-6980-4547-9f68-47a17cd918c7" (UID: "4a478214-6980-4547-9f68-47a17cd918c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:24.055292 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.055224 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4a478214-6980-4547-9f68-47a17cd918c7" (UID: "4a478214-6980-4547-9f68-47a17cd918c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:24.055292 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.055262 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a478214-6980-4547-9f68-47a17cd918c7-kube-api-access-f9gzt" (OuterVolumeSpecName: "kube-api-access-f9gzt") pod "4a478214-6980-4547-9f68-47a17cd918c7" (UID: "4a478214-6980-4547-9f68-47a17cd918c7"). InnerVolumeSpecName "kube-api-access-f9gzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:54:24.153993 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.153958 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-trusted-ca-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:24.153993 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.153987 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-oauth-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:24.153993 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.153998 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-console-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:24.154207 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.154007 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a478214-6980-4547-9f68-47a17cd918c7-console-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:24.154207 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.154017 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a478214-6980-4547-9f68-47a17cd918c7-oauth-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:24.154207 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.154025 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9gzt\" (UniqueName: \"kubernetes.io/projected/4a478214-6980-4547-9f68-47a17cd918c7-kube-api-access-f9gzt\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:24.721360 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.721323 2579 generic.go:356] "Generic (PLEG): container finished" podID="4a478214-6980-4547-9f68-47a17cd918c7" containerID="396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85" exitCode=0 Jun 05 17:54:24.721802 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.721369 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bfc844db4-v4rkd" Jun 05 17:54:24.721802 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.721407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bfc844db4-v4rkd" event={"ID":"4a478214-6980-4547-9f68-47a17cd918c7","Type":"ContainerDied","Data":"396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85"} Jun 05 17:54:24.721802 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.721456 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bfc844db4-v4rkd" event={"ID":"4a478214-6980-4547-9f68-47a17cd918c7","Type":"ContainerDied","Data":"4088a31618bb901a69ebe54aed72b60bb3da8a3f6adbb977b5fe07851e3e8cc2"} Jun 05 17:54:24.721802 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.721476 2579 scope.go:117] "RemoveContainer" containerID="396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85" Jun 05 17:54:24.730333 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.730317 2579 scope.go:117] "RemoveContainer" containerID="396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85" Jun 05 17:54:24.730572 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:54:24.730553 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85\": container with ID starting with 396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85 not found: ID does not exist" containerID="396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85" Jun 05 17:54:24.730668 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.730578 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85"} err="failed to get container status \"396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85\": rpc error: code = NotFound desc = could not find container \"396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85\": container with ID starting with 396c454f0a4b0ba24bb2dc74308b5bb2c5630e84876d1255b543cefe85512e85 not found: ID does not exist" Jun 05 17:54:24.745021 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.744998 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bfc844db4-v4rkd"] Jun 05 17:54:24.750230 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:24.750209 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bfc844db4-v4rkd"] Jun 05 17:54:25.531990 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:25.531962 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a478214-6980-4547-9f68-47a17cd918c7" path="/var/lib/kubelet/pods/4a478214-6980-4547-9f68-47a17cd918c7/volumes" Jun 05 17:54:27.736194 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:27.736158 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:27.807588 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:27.807554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:31.210571 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:31.210519 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" podUID="f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" containerName="registry" containerID="cri-o://e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6" gracePeriod=30 Jun 05 17:54:32.462344 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.462318 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:54:32.507027 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.506993 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-ca-trust-extracted\") pod \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " Jun 05 17:54:32.507027 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.507026 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-certificates\") pod \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " Jun 05 17:54:32.507250 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.507057 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79j2q\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-kube-api-access-79j2q\") pod \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " Jun 05 17:54:32.507250 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.507089 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-installation-pull-secrets\") pod \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " Jun 05 17:54:32.507250 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.507122 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-bound-sa-token\") pod \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " Jun 05 17:54:32.507250 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.507147 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") pod \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " Jun 05 17:54:32.507250 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.507219 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-trusted-ca\") pod \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " Jun 05 17:54:32.507475 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.507260 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-image-registry-private-configuration\") pod \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\" (UID: \"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd\") " Jun 05 17:54:32.508010 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.507952 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:32.508134 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.508101 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:54:32.518833 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.512374 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:32.520451 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.520388 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:54:32.520570 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.520428 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:54:32.520570 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.520551 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-kube-api-access-79j2q" (OuterVolumeSpecName: "kube-api-access-79j2q") pod "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd"). InnerVolumeSpecName "kube-api-access-79j2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:54:32.521718 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.521686 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:54:32.524358 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.524329 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" (UID: "f8b0f00e-17d7-4dce-a845-5d4aa3df90cd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:54:32.608160 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.608058 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-ca-trust-extracted\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:32.608160 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.608095 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-certificates\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:32.608160 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.608109 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79j2q\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-kube-api-access-79j2q\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:32.608160 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.608122 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-installation-pull-secrets\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:32.608160 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.608138 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-bound-sa-token\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:32.608160 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.608152 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-registry-tls\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:32.608160 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.608165 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-trusted-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:32.608631 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.608179 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd-image-registry-private-configuration\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:54:32.758102 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.758068 2579 generic.go:356] "Generic (PLEG): container finished" podID="f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" containerID="e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6" exitCode=0 Jun 05 17:54:32.758255 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.758129 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" Jun 05 17:54:32.758255 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.758135 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" event={"ID":"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd","Type":"ContainerDied","Data":"e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6"} Jun 05 17:54:32.758255 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.758177 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76866d48b4-qzn57" event={"ID":"f8b0f00e-17d7-4dce-a845-5d4aa3df90cd","Type":"ContainerDied","Data":"064ac20b1f8880f77367c5f7298f1d03329633e8755d8d47a137007ea99a7fab"} Jun 05 17:54:32.758255 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.758195 2579 scope.go:117] "RemoveContainer" containerID="e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6" Jun 05 17:54:32.767362 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.767343 2579 scope.go:117] "RemoveContainer" containerID="e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6" Jun 05 17:54:32.767708 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:54:32.767680 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6\": container with ID starting with e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6 not found: ID does not exist" containerID="e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6" Jun 05 17:54:32.767777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.767721 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6"} err="failed to get container status \"e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6\": rpc error: code = NotFound desc = could not find container \"e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6\": container with ID starting with e97876e2a29d2e6515864d3f6db0645b4dd5070033e137861d16e67fdf3807a6 not found: ID does not exist" Jun 05 17:54:32.781495 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.781468 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76866d48b4-qzn57"] Jun 05 17:54:32.786447 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:32.786426 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76866d48b4-qzn57"] Jun 05 17:54:33.532917 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:33.532844 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" path="/var/lib/kubelet/pods/f8b0f00e-17d7-4dce-a845-5d4aa3df90cd/volumes" Jun 05 17:54:34.492929 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:34.492892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:34.554852 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:34.554819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:35.321826 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:35.321794 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:35.391334 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:35.391297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:42.733189 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:42.733103 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:42.833422 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:42.833389 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:44.126521 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:44.126486 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:44.224613 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:44.224581 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:57.366811 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.366777 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f7dff96df-xf9bt"] Jun 05 17:54:57.367286 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.367112 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a478214-6980-4547-9f68-47a17cd918c7" containerName="console" Jun 05 17:54:57.367286 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.367124 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a478214-6980-4547-9f68-47a17cd918c7" containerName="console" Jun 05 17:54:57.367286 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.367133 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" containerName="registry" Jun 05 17:54:57.367286 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.367139 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" containerName="registry" Jun 05 17:54:57.367286 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.367154 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb37389b-dbd8-4759-9a19-5ce1df498759" containerName="console" Jun 05 17:54:57.367286 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.367163 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb37389b-dbd8-4759-9a19-5ce1df498759" containerName="console" Jun 05 17:54:57.367286 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.367215 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8b0f00e-17d7-4dce-a845-5d4aa3df90cd" containerName="registry" Jun 05 17:54:57.367286 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.367222 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb37389b-dbd8-4759-9a19-5ce1df498759" containerName="console" Jun 05 17:54:57.367286 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.367233 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a478214-6980-4547-9f68-47a17cd918c7" containerName="console" Jun 05 17:54:57.369923 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.369903 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.380068 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.380043 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7dff96df-xf9bt"] Jun 05 17:54:57.394191 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.394166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-serving-cert\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.394315 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.394210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-config\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.394315 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.394230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-oauth-config\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.394402 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.394317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-trusted-ca-bundle\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.394402 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.394363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-oauth-serving-cert\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.394402 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.394393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4rzs\" (UniqueName: \"kubernetes.io/projected/c82e7432-97d3-48af-afbf-5e8d968e8b72-kube-api-access-g4rzs\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.394509 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.394421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-service-ca\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.456755 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.456728 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:57.494982 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.494953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-serving-cert\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.495128 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.494994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-config\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.495128 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.495013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-oauth-config\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.495252 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.495139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-trusted-ca-bundle\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.495252 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.495193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-oauth-serving-cert\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.495252 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.495221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4rzs\" (UniqueName: \"kubernetes.io/projected/c82e7432-97d3-48af-afbf-5e8d968e8b72-kube-api-access-g4rzs\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.495387 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.495252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-service-ca\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.495811 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.495777 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-config\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.495951 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.495930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-oauth-serving-cert\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.496071 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.496050 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-service-ca\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.496226 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.496210 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-trusted-ca-bundle\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.498047 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.498027 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-serving-cert\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.498144 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.498120 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-oauth-config\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.503857 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.503835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4rzs\" (UniqueName: \"kubernetes.io/projected/c82e7432-97d3-48af-afbf-5e8d968e8b72-kube-api-access-g4rzs\") pod \"console-5f7dff96df-xf9bt\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.556922 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.556887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:57.611702 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.611678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:57.681813 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.681733 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:54:57.731293 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.731262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:57.816139 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.816114 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7dff96df-xf9bt"] Jun 05 17:54:57.818060 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.818033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:57.818283 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:54:57.818257 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82e7432_97d3_48af_afbf_5e8d968e8b72.slice/crio-d6585e4bbb1598fa8b3c0b68a16aab91c452c0e30cd1627774adf97fa8081ea3 WatchSource:0}: Error finding container d6585e4bbb1598fa8b3c0b68a16aab91c452c0e30cd1627774adf97fa8081ea3: Status 404 returned error can't find the container with id d6585e4bbb1598fa8b3c0b68a16aab91c452c0e30cd1627774adf97fa8081ea3 Jun 05 17:54:57.862670 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:57.862644 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7dff96df-xf9bt" event={"ID":"c82e7432-97d3-48af-afbf-5e8d968e8b72","Type":"ContainerStarted","Data":"d6585e4bbb1598fa8b3c0b68a16aab91c452c0e30cd1627774adf97fa8081ea3"} Jun 05 17:54:58.373850 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:58.373803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:54:58.871759 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:58.871719 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7dff96df-xf9bt" event={"ID":"c82e7432-97d3-48af-afbf-5e8d968e8b72","Type":"ContainerStarted","Data":"b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1"} Jun 05 17:54:58.891482 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:54:58.891424 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f7dff96df-xf9bt" podStartSLOduration=1.891401724 podStartE2EDuration="1.891401724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:54:58.890941617 +0000 UTC m=+369.819990658" watchObservedRunningTime="2026-06-05 17:54:58.891401724 +0000 UTC m=+369.820450765" Jun 05 17:55:07.682418 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:07.682375 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:55:07.682840 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:07.682439 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:55:07.687391 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:07.687371 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:55:07.910062 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:07.910033 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:55:07.961800 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:07.961715 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c787c696d-bhhg7"] Jun 05 17:55:08.055702 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:08.055668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:55:08.107475 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:08.107446 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:55:08.161365 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:08.161333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:55:32.856868 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:32.856826 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:55:32.981987 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:32.981943 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c787c696d-bhhg7" podUID="25350199-7a66-4f3c-a06e-6750f0abb9d3" containerName="console" containerID="cri-o://8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858" gracePeriod=15 Jun 05 17:55:33.221781 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.221757 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:55:33.394759 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.394724 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-oauth-config\") pod \"25350199-7a66-4f3c-a06e-6750f0abb9d3\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " Jun 05 17:55:33.394963 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.394769 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-serving-cert\") pod \"25350199-7a66-4f3c-a06e-6750f0abb9d3\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " Jun 05 17:55:33.394963 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.394818 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-config\") pod \"25350199-7a66-4f3c-a06e-6750f0abb9d3\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " Jun 05 17:55:33.394963 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.394901 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-oauth-serving-cert\") pod \"25350199-7a66-4f3c-a06e-6750f0abb9d3\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " Jun 05 17:55:33.394963 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.394926 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmqr2\" (UniqueName: \"kubernetes.io/projected/25350199-7a66-4f3c-a06e-6750f0abb9d3-kube-api-access-hmqr2\") pod \"25350199-7a66-4f3c-a06e-6750f0abb9d3\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " Jun 05 17:55:33.394963 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.394957 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-service-ca\") pod \"25350199-7a66-4f3c-a06e-6750f0abb9d3\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " Jun 05 17:55:33.395232 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.394988 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-trusted-ca-bundle\") pod \"25350199-7a66-4f3c-a06e-6750f0abb9d3\" (UID: \"25350199-7a66-4f3c-a06e-6750f0abb9d3\") " Jun 05 17:55:33.395392 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.395363 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-config" (OuterVolumeSpecName: "console-config") pod "25350199-7a66-4f3c-a06e-6750f0abb9d3" (UID: "25350199-7a66-4f3c-a06e-6750f0abb9d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:55:33.395462 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.395405 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "25350199-7a66-4f3c-a06e-6750f0abb9d3" (UID: "25350199-7a66-4f3c-a06e-6750f0abb9d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:55:33.395462 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.395419 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "25350199-7a66-4f3c-a06e-6750f0abb9d3" (UID: "25350199-7a66-4f3c-a06e-6750f0abb9d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:55:33.395577 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.395462 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "25350199-7a66-4f3c-a06e-6750f0abb9d3" (UID: "25350199-7a66-4f3c-a06e-6750f0abb9d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:55:33.397110 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.397071 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "25350199-7a66-4f3c-a06e-6750f0abb9d3" (UID: "25350199-7a66-4f3c-a06e-6750f0abb9d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:55:33.397110 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.397103 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "25350199-7a66-4f3c-a06e-6750f0abb9d3" (UID: "25350199-7a66-4f3c-a06e-6750f0abb9d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:55:33.397290 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.397183 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25350199-7a66-4f3c-a06e-6750f0abb9d3-kube-api-access-hmqr2" (OuterVolumeSpecName: "kube-api-access-hmqr2") pod "25350199-7a66-4f3c-a06e-6750f0abb9d3" (UID: "25350199-7a66-4f3c-a06e-6750f0abb9d3"). InnerVolumeSpecName "kube-api-access-hmqr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:55:33.495960 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.495925 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-oauth-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:55:33.495960 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.495955 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmqr2\" (UniqueName: \"kubernetes.io/projected/25350199-7a66-4f3c-a06e-6750f0abb9d3-kube-api-access-hmqr2\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:55:33.495960 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.495967 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:55:33.496175 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.495976 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-trusted-ca-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:55:33.496175 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.495984 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-oauth-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:55:33.496175 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.495993 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:55:33.496175 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:33.496000 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25350199-7a66-4f3c-a06e-6750f0abb9d3-console-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:55:34.007923 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:34.007889 2579 generic.go:356] "Generic (PLEG): container finished" podID="25350199-7a66-4f3c-a06e-6750f0abb9d3" containerID="8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858" exitCode=0 Jun 05 17:55:34.008318 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:34.007929 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c787c696d-bhhg7" Jun 05 17:55:34.008318 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:34.007972 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c787c696d-bhhg7" event={"ID":"25350199-7a66-4f3c-a06e-6750f0abb9d3","Type":"ContainerDied","Data":"8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858"} Jun 05 17:55:34.008318 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:34.008027 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c787c696d-bhhg7" event={"ID":"25350199-7a66-4f3c-a06e-6750f0abb9d3","Type":"ContainerDied","Data":"5267c2af5c5b66ba225cdfd69039ba37a0fa1aa6e7027d2adef8c75f0dad91df"} Jun 05 17:55:34.008318 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:34.008050 2579 scope.go:117] "RemoveContainer" containerID="8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858" Jun 05 17:55:34.016418 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:34.016396 2579 scope.go:117] "RemoveContainer" containerID="8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858" Jun 05 17:55:34.016704 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:55:34.016685 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858\": container with ID starting with 8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858 not found: ID does not exist" containerID="8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858" Jun 05 17:55:34.016787 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:34.016713 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858"} err="failed to get container status \"8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858\": rpc error: code = NotFound desc = could not find container \"8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858\": container with ID starting with 8a448ac98951de36b1970a1d7b72a057e518fa691114579f6077bfe285d3b858 not found: ID does not exist" Jun 05 17:55:34.034992 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:34.034971 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c787c696d-bhhg7"] Jun 05 17:55:34.040221 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:34.040195 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c787c696d-bhhg7"] Jun 05 17:55:35.532676 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:35.532637 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25350199-7a66-4f3c-a06e-6750f0abb9d3" path="/var/lib/kubelet/pods/25350199-7a66-4f3c-a06e-6750f0abb9d3/volumes" Jun 05 17:55:49.752199 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:49.752115 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:55:49.851559 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:49.851527 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:55:50.380080 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.380044 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm"] Jun 05 17:55:50.380365 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.380343 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25350199-7a66-4f3c-a06e-6750f0abb9d3" containerName="console" Jun 05 17:55:50.380365 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.380358 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="25350199-7a66-4f3c-a06e-6750f0abb9d3" containerName="console" Jun 05 17:55:50.380553 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.380435 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="25350199-7a66-4f3c-a06e-6750f0abb9d3" containerName="console" Jun 05 17:55:50.383208 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.383190 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.386517 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.386497 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 17:55:50.386634 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.386547 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 17:55:50.387935 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.387918 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b8ngf\"" Jun 05 17:55:50.393069 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.393048 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm"] Jun 05 17:55:50.417429 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.417397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.417543 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.417451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.417543 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.417516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fgrc\" (UniqueName: \"kubernetes.io/projected/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-kube-api-access-7fgrc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.517974 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.517932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fgrc\" (UniqueName: \"kubernetes.io/projected/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-kube-api-access-7fgrc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.518132 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.518015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.518132 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.518086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.518379 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.518360 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.518440 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.518420 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.527869 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.527844 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fgrc\" (UniqueName: \"kubernetes.io/projected/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-kube-api-access-7fgrc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.693136 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.693047 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:55:50.820103 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.820077 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm"] Jun 05 17:55:50.822317 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:55:50.822282 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce122d36_8ee9_44f9_b68b_b1f6dfa24a5b.slice/crio-b6b4b408a81a93d06598db26fd3d0da1ae72d2594fe00d89831ea9c10aac78ca WatchSource:0}: Error finding container b6b4b408a81a93d06598db26fd3d0da1ae72d2594fe00d89831ea9c10aac78ca: Status 404 returned error can't find the container with id b6b4b408a81a93d06598db26fd3d0da1ae72d2594fe00d89831ea9c10aac78ca Jun 05 17:55:50.824263 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:50.824245 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 17:55:51.075154 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:51.075117 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" event={"ID":"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b","Type":"ContainerStarted","Data":"b6b4b408a81a93d06598db26fd3d0da1ae72d2594fe00d89831ea9c10aac78ca"} Jun 05 17:55:58.110921 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:58.110888 2579 generic.go:356] "Generic (PLEG): container finished" podID="ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" containerID="22941467efd1158ebd3ab2b3591e55a1a78d49d1a16c0b07498fe28fcfffde6a" exitCode=0 Jun 05 17:55:58.111294 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:55:58.110980 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" event={"ID":"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b","Type":"ContainerDied","Data":"22941467efd1158ebd3ab2b3591e55a1a78d49d1a16c0b07498fe28fcfffde6a"} Jun 05 17:56:01.125219 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:01.125188 2579 generic.go:356] "Generic (PLEG): container finished" podID="ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" containerID="938e708f0cd8742b882134a84a54922856564b846914ca14739bb1ada95b1f71" exitCode=0 Jun 05 17:56:01.125718 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:01.125245 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" event={"ID":"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b","Type":"ContainerDied","Data":"938e708f0cd8742b882134a84a54922856564b846914ca14739bb1ada95b1f71"} Jun 05 17:56:11.171546 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:11.171506 2579 generic.go:356] "Generic (PLEG): container finished" podID="ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" containerID="d82ebd43aa1c8df0860f3c52eb6eea31afde1c46ac9b4d4fc96d8fe73ebff372" exitCode=0 Jun 05 17:56:11.171975 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:11.171598 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" event={"ID":"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b","Type":"ContainerDied","Data":"d82ebd43aa1c8df0860f3c52eb6eea31afde1c46ac9b4d4fc96d8fe73ebff372"} Jun 05 17:56:12.319212 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:12.319178 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:56:12.407521 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:12.407488 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fgrc\" (UniqueName: \"kubernetes.io/projected/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-kube-api-access-7fgrc\") pod \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " Jun 05 17:56:12.407705 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:12.407543 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-util\") pod \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " Jun 05 17:56:12.407705 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:12.407625 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-bundle\") pod \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\" (UID: \"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b\") " Jun 05 17:56:12.408274 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:12.408245 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-bundle" (OuterVolumeSpecName: "bundle") pod "ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" (UID: "ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:56:12.409842 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:12.409811 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-kube-api-access-7fgrc" (OuterVolumeSpecName: "kube-api-access-7fgrc") pod "ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" (UID: "ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b"). InnerVolumeSpecName "kube-api-access-7fgrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:56:12.411755 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:12.411732 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-util" (OuterVolumeSpecName: "util") pod "ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" (UID: "ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:56:12.508689 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:12.508654 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:56:12.508689 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:12.508686 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fgrc\" (UniqueName: \"kubernetes.io/projected/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-kube-api-access-7fgrc\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:56:12.508689 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:12.508695 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b-util\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:56:13.181928 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:13.181896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" event={"ID":"ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b","Type":"ContainerDied","Data":"b6b4b408a81a93d06598db26fd3d0da1ae72d2594fe00d89831ea9c10aac78ca"} Jun 05 17:56:13.182070 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:13.181943 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6b4b408a81a93d06598db26fd3d0da1ae72d2594fe00d89831ea9c10aac78ca" Jun 05 17:56:13.182070 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:13.181988 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6mgtm" Jun 05 17:56:15.313321 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:15.313255 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:15.372448 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:15.372411 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:16.399098 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:16.399056 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:17.387721 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:17.387681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:18.411789 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.411757 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2"] Jun 05 17:56:18.412156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.412052 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" containerName="extract" Jun 05 17:56:18.412156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.412064 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" containerName="extract" Jun 05 17:56:18.412156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.412084 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" containerName="util" Jun 05 17:56:18.412156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.412089 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" containerName="util" Jun 05 17:56:18.412156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.412097 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" containerName="pull" Jun 05 17:56:18.412156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.412103 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" containerName="pull" Jun 05 17:56:18.412156 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.412154 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce122d36-8ee9-44f9-b68b-b1f6dfa24a5b" containerName="extract" Jun 05 17:56:18.414303 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.414283 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" Jun 05 17:56:18.417241 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.417221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j5vbz\"" Jun 05 17:56:18.417756 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.417737 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 17:56:18.417891 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.417873 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 17:56:18.432231 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.432194 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2"] Jun 05 17:56:18.560583 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.560537 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8eb409b-652b-40fa-a848-7edb0f4dc4d0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mdzt2\" (UID: \"b8eb409b-652b-40fa-a848-7edb0f4dc4d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" Jun 05 17:56:18.560799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.560660 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64ptk\" (UniqueName: \"kubernetes.io/projected/b8eb409b-652b-40fa-a848-7edb0f4dc4d0-kube-api-access-64ptk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mdzt2\" (UID: \"b8eb409b-652b-40fa-a848-7edb0f4dc4d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" Jun 05 17:56:18.661981 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.661871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8eb409b-652b-40fa-a848-7edb0f4dc4d0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mdzt2\" (UID: \"b8eb409b-652b-40fa-a848-7edb0f4dc4d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" Jun 05 17:56:18.662151 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.661993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64ptk\" (UniqueName: \"kubernetes.io/projected/b8eb409b-652b-40fa-a848-7edb0f4dc4d0-kube-api-access-64ptk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mdzt2\" (UID: \"b8eb409b-652b-40fa-a848-7edb0f4dc4d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" Jun 05 17:56:18.662407 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.662382 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8eb409b-652b-40fa-a848-7edb0f4dc4d0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mdzt2\" (UID: \"b8eb409b-652b-40fa-a848-7edb0f4dc4d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" Jun 05 17:56:18.670275 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.670250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64ptk\" (UniqueName: \"kubernetes.io/projected/b8eb409b-652b-40fa-a848-7edb0f4dc4d0-kube-api-access-64ptk\") pod \"cert-manager-operator-controller-manager-57757f7cfc-mdzt2\" (UID: \"b8eb409b-652b-40fa-a848-7edb0f4dc4d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" Jun 05 17:56:18.724152 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.724104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" Jun 05 17:56:18.858618 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:18.858570 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2"] Jun 05 17:56:18.862066 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:56:18.862040 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8eb409b_652b_40fa_a848_7edb0f4dc4d0.slice/crio-83518587feb7ea41323e8853dd3d69a902ed6c1e66b998eca949d76fe32cb1f1 WatchSource:0}: Error finding container 83518587feb7ea41323e8853dd3d69a902ed6c1e66b998eca949d76fe32cb1f1: Status 404 returned error can't find the container with id 83518587feb7ea41323e8853dd3d69a902ed6c1e66b998eca949d76fe32cb1f1 Jun 05 17:56:19.207281 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:19.207246 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" event={"ID":"b8eb409b-652b-40fa-a848-7edb0f4dc4d0","Type":"ContainerStarted","Data":"83518587feb7ea41323e8853dd3d69a902ed6c1e66b998eca949d76fe32cb1f1"} Jun 05 17:56:20.245205 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:20.245165 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:20.339478 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:20.339430 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:21.218279 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:21.218242 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" event={"ID":"b8eb409b-652b-40fa-a848-7edb0f4dc4d0","Type":"ContainerStarted","Data":"1844a567ef0bed26657814dc49fa77c6c4efe24d2133b2e7d0e0ac0d9b51451b"} Jun 05 17:56:21.245456 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:21.245406 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-mdzt2" podStartSLOduration=1.531650617 podStartE2EDuration="3.245390171s" totalImagesPullingTime="1.713739554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:56:21.243239005 +0000 UTC m=+452.172288038" watchObservedRunningTime="2026-06-05 17:56:21.245390171 +0000 UTC m=+452.174439211" Jun 05 17:56:21.251442 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:21.251417 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:21.341577 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:21.341545 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:21.653921 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:21.653893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:21.785072 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:21.785038 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:23.883146 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:23.883113 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5"] Jun 05 17:56:23.885310 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:23.885292 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" Jun 05 17:56:23.889013 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:23.888988 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 17:56:23.889151 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:23.888988 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 17:56:23.890373 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:23.890358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5pfkk\"" Jun 05 17:56:23.896061 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:23.896040 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5"] Jun 05 17:56:24.008998 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.008967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdgzl\" (UniqueName: \"kubernetes.io/projected/fe762787-7565-4656-a4e4-67a787314ec2-kube-api-access-rdgzl\") pod \"cert-manager-webhook-7dc76cbb94-j2bk5\" (UID: \"fe762787-7565-4656-a4e4-67a787314ec2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" Jun 05 17:56:24.009202 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.009018 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe762787-7565-4656-a4e4-67a787314ec2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-j2bk5\" (UID: \"fe762787-7565-4656-a4e4-67a787314ec2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" Jun 05 17:56:24.110014 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.109975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe762787-7565-4656-a4e4-67a787314ec2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-j2bk5\" (UID: \"fe762787-7565-4656-a4e4-67a787314ec2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" Jun 05 17:56:24.110177 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.110043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdgzl\" (UniqueName: \"kubernetes.io/projected/fe762787-7565-4656-a4e4-67a787314ec2-kube-api-access-rdgzl\") pod \"cert-manager-webhook-7dc76cbb94-j2bk5\" (UID: \"fe762787-7565-4656-a4e4-67a787314ec2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" Jun 05 17:56:24.119220 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.119185 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe762787-7565-4656-a4e4-67a787314ec2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-j2bk5\" (UID: \"fe762787-7565-4656-a4e4-67a787314ec2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" Jun 05 17:56:24.119348 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.119236 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdgzl\" (UniqueName: \"kubernetes.io/projected/fe762787-7565-4656-a4e4-67a787314ec2-kube-api-access-rdgzl\") pod \"cert-manager-webhook-7dc76cbb94-j2bk5\" (UID: \"fe762787-7565-4656-a4e4-67a787314ec2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" Jun 05 17:56:24.205432 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.205348 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" Jun 05 17:56:24.336902 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.336868 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5"] Jun 05 17:56:24.340280 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:56:24.340247 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe762787_7565_4656_a4e4_67a787314ec2.slice/crio-cb768731242a2e9639ed7ee43663c8490779ba57319f53933b40cee919fcfd01 WatchSource:0}: Error finding container cb768731242a2e9639ed7ee43663c8490779ba57319f53933b40cee919fcfd01: Status 404 returned error can't find the container with id cb768731242a2e9639ed7ee43663c8490779ba57319f53933b40cee919fcfd01 Jun 05 17:56:24.535436 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.535402 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:24.589518 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.589481 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n"] Jun 05 17:56:24.592232 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.592211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" Jun 05 17:56:24.595141 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.595111 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dfkv7\"" Jun 05 17:56:24.599972 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.599920 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n"] Jun 05 17:56:24.714443 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.714406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfdnf\" (UniqueName: \"kubernetes.io/projected/7c073e00-5499-4a9b-ab89-070d6e605192-kube-api-access-mfdnf\") pod \"cert-manager-cainjector-5d99449ffd-sqg8n\" (UID: \"7c073e00-5499-4a9b-ab89-070d6e605192\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" Jun 05 17:56:24.714443 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.714446 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c073e00-5499-4a9b-ab89-070d6e605192-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-sqg8n\" (UID: \"7c073e00-5499-4a9b-ab89-070d6e605192\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" Jun 05 17:56:24.815404 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.815311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfdnf\" (UniqueName: \"kubernetes.io/projected/7c073e00-5499-4a9b-ab89-070d6e605192-kube-api-access-mfdnf\") pod \"cert-manager-cainjector-5d99449ffd-sqg8n\" (UID: \"7c073e00-5499-4a9b-ab89-070d6e605192\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" Jun 05 17:56:24.815404 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.815356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c073e00-5499-4a9b-ab89-070d6e605192-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-sqg8n\" (UID: \"7c073e00-5499-4a9b-ab89-070d6e605192\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" Jun 05 17:56:24.824856 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.824820 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c073e00-5499-4a9b-ab89-070d6e605192-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-sqg8n\" (UID: \"7c073e00-5499-4a9b-ab89-070d6e605192\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" Jun 05 17:56:24.825023 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.825003 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfdnf\" (UniqueName: \"kubernetes.io/projected/7c073e00-5499-4a9b-ab89-070d6e605192-kube-api-access-mfdnf\") pod \"cert-manager-cainjector-5d99449ffd-sqg8n\" (UID: \"7c073e00-5499-4a9b-ab89-070d6e605192\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" Jun 05 17:56:24.902663 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:24.902627 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" Jun 05 17:56:25.030446 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:25.030419 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n"] Jun 05 17:56:25.032416 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:56:25.032382 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c073e00_5499_4a9b_ab89_070d6e605192.slice/crio-f5a6b34d710ac75b347b2f489f7ca600c0bb9928c6924a07323276133a580cbe WatchSource:0}: Error finding container f5a6b34d710ac75b347b2f489f7ca600c0bb9928c6924a07323276133a580cbe: Status 404 returned error can't find the container with id f5a6b34d710ac75b347b2f489f7ca600c0bb9928c6924a07323276133a580cbe Jun 05 17:56:25.134342 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:25.134272 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:25.243485 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:25.243446 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" event={"ID":"fe762787-7565-4656-a4e4-67a787314ec2","Type":"ContainerStarted","Data":"cb768731242a2e9639ed7ee43663c8490779ba57319f53933b40cee919fcfd01"} Jun 05 17:56:25.244869 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:25.244836 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" event={"ID":"7c073e00-5499-4a9b-ab89-070d6e605192","Type":"ContainerStarted","Data":"f5a6b34d710ac75b347b2f489f7ca600c0bb9928c6924a07323276133a580cbe"} Jun 05 17:56:28.260577 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:28.260535 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" event={"ID":"fe762787-7565-4656-a4e4-67a787314ec2","Type":"ContainerStarted","Data":"1df5e50d004add11004649bdfeb88d2dc41fe040dc47767c2ecad7c959956f60"} Jun 05 17:56:28.261027 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:28.260649 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" Jun 05 17:56:28.262048 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:28.262027 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" event={"ID":"7c073e00-5499-4a9b-ab89-070d6e605192","Type":"ContainerStarted","Data":"aeec99ddede631c328794a7f0749fcdfc315260bdcf024117ddf0eae82e26445"} Jun 05 17:56:28.279796 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:28.279750 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" podStartSLOduration=2.247269055 podStartE2EDuration="5.279733543s" totalImagesPullingTime="3.032464488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:56:28.278386754 +0000 UTC m=+459.207435811" watchObservedRunningTime="2026-06-05 17:56:28.279733543 +0000 UTC m=+459.208782582" Jun 05 17:56:28.297320 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:28.297269 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-sqg8n" podStartSLOduration=1.937196978 podStartE2EDuration="4.297255837s" totalImagesPullingTime="2.360058859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:56:28.29590881 +0000 UTC m=+459.224957849" watchObservedRunningTime="2026-06-05 17:56:28.297255837 +0000 UTC m=+459.226304875" Jun 05 17:56:32.681620 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:32.681574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:32.926924 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:32.926892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:34.269249 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:34.269215 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-j2bk5" Jun 05 17:56:42.087065 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.087025 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-sf75q"] Jun 05 17:56:42.089520 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.089497 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-sf75q" Jun 05 17:56:42.092313 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.092296 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-765jb\"" Jun 05 17:56:42.099566 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.099544 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-sf75q"] Jun 05 17:56:42.160730 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.160699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a661197-5691-4167-b4ac-ecb22d56462e-bound-sa-token\") pod \"cert-manager-59c77684cc-sf75q\" (UID: \"2a661197-5691-4167-b4ac-ecb22d56462e\") " pod="cert-manager/cert-manager-59c77684cc-sf75q" Jun 05 17:56:42.160890 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.160810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf7qf\" (UniqueName: \"kubernetes.io/projected/2a661197-5691-4167-b4ac-ecb22d56462e-kube-api-access-lf7qf\") pod \"cert-manager-59c77684cc-sf75q\" (UID: \"2a661197-5691-4167-b4ac-ecb22d56462e\") " pod="cert-manager/cert-manager-59c77684cc-sf75q" Jun 05 17:56:42.261853 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.261816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a661197-5691-4167-b4ac-ecb22d56462e-bound-sa-token\") pod \"cert-manager-59c77684cc-sf75q\" (UID: \"2a661197-5691-4167-b4ac-ecb22d56462e\") " pod="cert-manager/cert-manager-59c77684cc-sf75q" Jun 05 17:56:42.262018 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.261900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf7qf\" (UniqueName: \"kubernetes.io/projected/2a661197-5691-4167-b4ac-ecb22d56462e-kube-api-access-lf7qf\") pod \"cert-manager-59c77684cc-sf75q\" (UID: \"2a661197-5691-4167-b4ac-ecb22d56462e\") " pod="cert-manager/cert-manager-59c77684cc-sf75q" Jun 05 17:56:42.270705 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.270673 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a661197-5691-4167-b4ac-ecb22d56462e-bound-sa-token\") pod \"cert-manager-59c77684cc-sf75q\" (UID: \"2a661197-5691-4167-b4ac-ecb22d56462e\") " pod="cert-manager/cert-manager-59c77684cc-sf75q" Jun 05 17:56:42.270974 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.270951 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf7qf\" (UniqueName: \"kubernetes.io/projected/2a661197-5691-4167-b4ac-ecb22d56462e-kube-api-access-lf7qf\") pod \"cert-manager-59c77684cc-sf75q\" (UID: \"2a661197-5691-4167-b4ac-ecb22d56462e\") " pod="cert-manager/cert-manager-59c77684cc-sf75q" Jun 05 17:56:42.399435 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.399338 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-sf75q" Jun 05 17:56:42.525702 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:42.525679 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-sf75q"] Jun 05 17:56:42.527687 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:56:42.527656 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a661197_5691_4167_b4ac_ecb22d56462e.slice/crio-d069e8cdd27fbbcc080f0d9af86209c4530c1235bddd2bcdce51cc2e03e2b317 WatchSource:0}: Error finding container d069e8cdd27fbbcc080f0d9af86209c4530c1235bddd2bcdce51cc2e03e2b317: Status 404 returned error can't find the container with id d069e8cdd27fbbcc080f0d9af86209c4530c1235bddd2bcdce51cc2e03e2b317 Jun 05 17:56:43.334251 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:43.334215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-sf75q" event={"ID":"2a661197-5691-4167-b4ac-ecb22d56462e","Type":"ContainerStarted","Data":"872763cf69d00b8b5cd24ed5cf30c6ea9abea72b3942a815409719e66fa526ac"} Jun 05 17:56:43.334681 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:43.334262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-sf75q" event={"ID":"2a661197-5691-4167-b4ac-ecb22d56462e","Type":"ContainerStarted","Data":"d069e8cdd27fbbcc080f0d9af86209c4530c1235bddd2bcdce51cc2e03e2b317"} Jun 05 17:56:43.352341 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:43.352287 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-sf75q" podStartSLOduration=1.35227101 podStartE2EDuration="1.35227101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:56:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:56:43.351540246 +0000 UTC m=+474.280589308" watchObservedRunningTime="2026-06-05 17:56:43.35227101 +0000 UTC m=+474.281320049" Jun 05 17:56:44.151404 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:44.151358 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:44.248327 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:44.248281 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:44.429580 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:44.429472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:50.701233 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:50.701201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:50.802536 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:50.802503 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:52.362290 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.362258 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7"] Jun 05 17:56:52.367042 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.367020 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.370013 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.369992 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 17:56:52.370123 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.370031 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 17:56:52.371300 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.371282 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b8ngf\"" Jun 05 17:56:52.374371 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.374346 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7"] Jun 05 17:56:52.444161 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.444106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.444352 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.444221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.444352 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.444301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b84zd\" (UniqueName: \"kubernetes.io/projected/95c56533-82b6-44eb-b61e-b89db8700f66-kube-api-access-b84zd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.475088 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.475039 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:52.545416 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.545380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.545649 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.545430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.545649 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.545454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b84zd\" (UniqueName: \"kubernetes.io/projected/95c56533-82b6-44eb-b61e-b89db8700f66-kube-api-access-b84zd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.545791 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.545771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.545899 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.545877 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.554792 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.554771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b84zd\" (UniqueName: \"kubernetes.io/projected/95c56533-82b6-44eb-b61e-b89db8700f66-kube-api-access-b84zd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.678079 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.677987 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:52.806661 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:52.806578 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7"] Jun 05 17:56:52.809350 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:56:52.809314 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c56533_82b6_44eb_b61e_b89db8700f66.slice/crio-c85607c7167bc561d0fb3922cde97d40b7278d5f4dc0e194fff59997b6d22b19 WatchSource:0}: Error finding container c85607c7167bc561d0fb3922cde97d40b7278d5f4dc0e194fff59997b6d22b19: Status 404 returned error can't find the container with id c85607c7167bc561d0fb3922cde97d40b7278d5f4dc0e194fff59997b6d22b19 Jun 05 17:56:53.383084 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:53.383046 2579 generic.go:356] "Generic (PLEG): container finished" podID="95c56533-82b6-44eb-b61e-b89db8700f66" containerID="42723ed2ab13c23e69b9981c2cbc80c0a17eccaccdb9637fbf456bb5c2fa8743" exitCode=0 Jun 05 17:56:53.383529 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:53.383118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" event={"ID":"95c56533-82b6-44eb-b61e-b89db8700f66","Type":"ContainerDied","Data":"42723ed2ab13c23e69b9981c2cbc80c0a17eccaccdb9637fbf456bb5c2fa8743"} Jun 05 17:56:53.383529 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:53.383154 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" event={"ID":"95c56533-82b6-44eb-b61e-b89db8700f66","Type":"ContainerStarted","Data":"c85607c7167bc561d0fb3922cde97d40b7278d5f4dc0e194fff59997b6d22b19"} Jun 05 17:56:54.389251 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:54.389216 2579 generic.go:356] "Generic (PLEG): container finished" podID="95c56533-82b6-44eb-b61e-b89db8700f66" containerID="c8b2f179d20ef5ae39354ae90408d112687b4b884df2c1121d3f9549f0583ed5" exitCode=0 Jun 05 17:56:54.389667 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:54.389265 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" event={"ID":"95c56533-82b6-44eb-b61e-b89db8700f66","Type":"ContainerDied","Data":"c8b2f179d20ef5ae39354ae90408d112687b4b884df2c1121d3f9549f0583ed5"} Jun 05 17:56:55.396047 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:55.396016 2579 generic.go:356] "Generic (PLEG): container finished" podID="95c56533-82b6-44eb-b61e-b89db8700f66" containerID="68e6f37cdd9f69727ab3c0695c3ce68f885973f21bc157f6fa1d7ac44952a1ec" exitCode=0 Jun 05 17:56:55.396412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:55.396103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" event={"ID":"95c56533-82b6-44eb-b61e-b89db8700f66","Type":"ContainerDied","Data":"68e6f37cdd9f69727ab3c0695c3ce68f885973f21bc157f6fa1d7ac44952a1ec"} Jun 05 17:56:56.529923 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:56.529896 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:56.581912 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:56.581884 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-bundle\") pod \"95c56533-82b6-44eb-b61e-b89db8700f66\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " Jun 05 17:56:56.582075 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:56.581938 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-util\") pod \"95c56533-82b6-44eb-b61e-b89db8700f66\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " Jun 05 17:56:56.582075 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:56.581985 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b84zd\" (UniqueName: \"kubernetes.io/projected/95c56533-82b6-44eb-b61e-b89db8700f66-kube-api-access-b84zd\") pod \"95c56533-82b6-44eb-b61e-b89db8700f66\" (UID: \"95c56533-82b6-44eb-b61e-b89db8700f66\") " Jun 05 17:56:56.582795 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:56.582758 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-bundle" (OuterVolumeSpecName: "bundle") pod "95c56533-82b6-44eb-b61e-b89db8700f66" (UID: "95c56533-82b6-44eb-b61e-b89db8700f66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:56:56.584106 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:56.584078 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95c56533-82b6-44eb-b61e-b89db8700f66-kube-api-access-b84zd" (OuterVolumeSpecName: "kube-api-access-b84zd") pod "95c56533-82b6-44eb-b61e-b89db8700f66" (UID: "95c56533-82b6-44eb-b61e-b89db8700f66"). InnerVolumeSpecName "kube-api-access-b84zd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:56:56.590532 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:56.590489 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-util" (OuterVolumeSpecName: "util") pod "95c56533-82b6-44eb-b61e-b89db8700f66" (UID: "95c56533-82b6-44eb-b61e-b89db8700f66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:56:56.683388 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:56.683304 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-util\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:56:56.683388 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:56.683333 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b84zd\" (UniqueName: \"kubernetes.io/projected/95c56533-82b6-44eb-b61e-b89db8700f66-kube-api-access-b84zd\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:56:56.683388 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:56.683344 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95c56533-82b6-44eb-b61e-b89db8700f66-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:56:57.349573 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:57.349541 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:57.405172 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:57.405139 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:56:57.407662 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:57.407639 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" Jun 05 17:56:57.407662 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:57.407653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdxmdx7" event={"ID":"95c56533-82b6-44eb-b61e-b89db8700f66","Type":"ContainerDied","Data":"c85607c7167bc561d0fb3922cde97d40b7278d5f4dc0e194fff59997b6d22b19"} Jun 05 17:56:57.407828 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:56:57.407700 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c85607c7167bc561d0fb3922cde97d40b7278d5f4dc0e194fff59997b6d22b19" Jun 05 17:57:00.157433 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:00.157401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:04.646478 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:04.646426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:04.734889 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:04.734850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:08.121229 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:08.121192 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:08.226134 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:08.226100 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:08.705281 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:08.705245 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:09.009796 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.009761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:09.120174 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.120143 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:09.171822 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.171788 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk"] Jun 05 17:57:09.172193 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.172153 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c56533-82b6-44eb-b61e-b89db8700f66" containerName="extract" Jun 05 17:57:09.172193 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.172166 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c56533-82b6-44eb-b61e-b89db8700f66" containerName="extract" Jun 05 17:57:09.172193 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.172174 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c56533-82b6-44eb-b61e-b89db8700f66" containerName="pull" Jun 05 17:57:09.172193 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.172180 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c56533-82b6-44eb-b61e-b89db8700f66" containerName="pull" Jun 05 17:57:09.172193 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.172186 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c56533-82b6-44eb-b61e-b89db8700f66" containerName="util" Jun 05 17:57:09.172193 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.172191 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c56533-82b6-44eb-b61e-b89db8700f66" containerName="util" Jun 05 17:57:09.172372 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.172243 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c56533-82b6-44eb-b61e-b89db8700f66" containerName="extract" Jun 05 17:57:09.175309 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.175290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.180578 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.180555 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 17:57:09.180804 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.180780 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 17:57:09.181005 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.180978 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 17:57:09.181005 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.181011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dj75z\"" Jun 05 17:57:09.181310 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.181295 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 17:57:09.204760 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.204732 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk"] Jun 05 17:57:09.297045 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.296941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.297223 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.297066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-manifests\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.297223 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.297113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.297223 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.297149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5m6\" (UniqueName: \"kubernetes.io/projected/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-kube-api-access-vq5m6\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.297223 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.297168 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-tmp\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.351330 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.351302 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:09.397689 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.397650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5m6\" (UniqueName: \"kubernetes.io/projected/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-kube-api-access-vq5m6\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.397689 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.397691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-tmp\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.397884 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.397823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.397940 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.397912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-manifests\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.397991 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.397944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.398282 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.398254 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-manifests\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.399911 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.399887 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-tmp\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.400163 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.400143 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.400288 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.400271 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.416879 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.416849 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5m6\" (UniqueName: \"kubernetes.io/projected/4567a37b-990d-4fc6-9cf8-f46fee86b5d6-kube-api-access-vq5m6\") pod \"opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk\" (UID: \"4567a37b-990d-4fc6-9cf8-f46fee86b5d6\") " pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.448700 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.448663 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:09.486786 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.486751 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:09.549413 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.549309 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:09.631210 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.631182 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk"] Jun 05 17:57:09.633534 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:57:09.633508 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4567a37b_990d_4fc6_9cf8_f46fee86b5d6.slice/crio-430c4aa5850ab49a884b088f1a90bd05f5af60c84cdc25894fa5da439f97d543 WatchSource:0}: Error finding container 430c4aa5850ab49a884b088f1a90bd05f5af60c84cdc25894fa5da439f97d543: Status 404 returned error can't find the container with id 430c4aa5850ab49a884b088f1a90bd05f5af60c84cdc25894fa5da439f97d543 Jun 05 17:57:09.636363 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.636325 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:09.747679 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.747644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:09.835840 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:09.835737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:10.469717 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:10.469683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" event={"ID":"4567a37b-990d-4fc6-9cf8-f46fee86b5d6","Type":"ContainerStarted","Data":"430c4aa5850ab49a884b088f1a90bd05f5af60c84cdc25894fa5da439f97d543"} Jun 05 17:57:13.486387 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:13.486348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" event={"ID":"4567a37b-990d-4fc6-9cf8-f46fee86b5d6","Type":"ContainerStarted","Data":"ab68cb72ac3fe4d433085efe96ada09610ad0b80d2bb1263bf8a33b80a0f2956"} Jun 05 17:57:14.493167 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:14.493134 2579 generic.go:356] "Generic (PLEG): container finished" podID="4567a37b-990d-4fc6-9cf8-f46fee86b5d6" containerID="ab68cb72ac3fe4d433085efe96ada09610ad0b80d2bb1263bf8a33b80a0f2956" exitCode=0 Jun 05 17:57:14.493556 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:14.493175 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" event={"ID":"4567a37b-990d-4fc6-9cf8-f46fee86b5d6","Type":"ContainerDied","Data":"ab68cb72ac3fe4d433085efe96ada09610ad0b80d2bb1263bf8a33b80a0f2956"} Jun 05 17:57:15.500581 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:15.500546 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" event={"ID":"4567a37b-990d-4fc6-9cf8-f46fee86b5d6","Type":"ContainerStarted","Data":"8c67baf6b6766571efd9db7161985a449afdae25d03554455eb9734f9a4201c6"} Jun 05 17:57:15.500978 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:15.500662 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:15.527045 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:15.526990 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" podStartSLOduration=2.263674551 podStartE2EDuration="6.526971195s" totalImagesPullingTime="3.228214416s" totalInitContainerRuntime="1.035082228s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:15.525341824 +0000 UTC m=+506.454390866" watchObservedRunningTime="2026-06-05 17:57:15.526971195 +0000 UTC m=+506.456020233" Jun 05 17:57:26.508823 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:26.508787 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk" Jun 05 17:57:28.040463 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.040433 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:28.150357 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.150316 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:28.410164 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.410068 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:28.562407 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.562365 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:28.612118 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.612065 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s"] Jun 05 17:57:28.621404 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.621373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:28.626189 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.626164 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 17:57:28.626745 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.626725 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 17:57:28.627013 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.626981 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 17:57:28.627107 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.626981 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 17:57:28.636534 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.636514 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s"] Jun 05 17:57:28.652087 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.652056 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4"] Jun 05 17:57:28.654734 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.654715 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:28.657760 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.657736 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 17:57:28.658582 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.658568 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b8ngf\"" Jun 05 17:57:28.658657 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.658591 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 17:57:28.674493 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.674465 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4"] Jun 05 17:57:28.718974 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.718902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:28.772254 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.772223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:28.772254 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.772264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdf6\" (UniqueName: \"kubernetes.io/projected/2d1cb965-585a-464d-b700-26b81bee86b5-kube-api-access-4hdf6\") pod \"kube-auth-proxy-65bcf5494b-c6h7s\" (UID: \"2d1cb965-585a-464d-b700-26b81bee86b5\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:28.772475 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.772294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d1cb965-585a-464d-b700-26b81bee86b5-tmp\") pod \"kube-auth-proxy-65bcf5494b-c6h7s\" (UID: \"2d1cb965-585a-464d-b700-26b81bee86b5\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:28.772475 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.772335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:28.772475 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.772373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf9kk\" (UniqueName: \"kubernetes.io/projected/45789b1b-b966-4f29-8c08-3c0d4e4af245-kube-api-access-rf9kk\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:28.772475 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.772435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d1cb965-585a-464d-b700-26b81bee86b5-tls-certs\") pod \"kube-auth-proxy-65bcf5494b-c6h7s\" (UID: \"2d1cb965-585a-464d-b700-26b81bee86b5\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:28.873903 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.873863 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9kk\" (UniqueName: \"kubernetes.io/projected/45789b1b-b966-4f29-8c08-3c0d4e4af245-kube-api-access-rf9kk\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:28.874139 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.873928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d1cb965-585a-464d-b700-26b81bee86b5-tls-certs\") pod \"kube-auth-proxy-65bcf5494b-c6h7s\" (UID: \"2d1cb965-585a-464d-b700-26b81bee86b5\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:28.874139 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:57:28.874025 2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 05 17:57:28.874139 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:57:28.874091 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1cb965-585a-464d-b700-26b81bee86b5-tls-certs podName:2d1cb965-585a-464d-b700-26b81bee86b5 nodeName:}" failed. No retries permitted until 2026-06-05 17:57:29.374069582 +0000 UTC m=+520.303118618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2d1cb965-585a-464d-b700-26b81bee86b5-tls-certs") pod "kube-auth-proxy-65bcf5494b-c6h7s" (UID: "2d1cb965-585a-464d-b700-26b81bee86b5") : secret "kube-auth-proxy-tls" not found Jun 05 17:57:28.874139 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.874083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:28.874139 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.874130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdf6\" (UniqueName: \"kubernetes.io/projected/2d1cb965-585a-464d-b700-26b81bee86b5-kube-api-access-4hdf6\") pod \"kube-auth-proxy-65bcf5494b-c6h7s\" (UID: \"2d1cb965-585a-464d-b700-26b81bee86b5\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:28.874542 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.874173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d1cb965-585a-464d-b700-26b81bee86b5-tmp\") pod \"kube-auth-proxy-65bcf5494b-c6h7s\" (UID: \"2d1cb965-585a-464d-b700-26b81bee86b5\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:28.874542 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.874215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:28.874542 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.874504 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:28.874778 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.874540 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:28.877201 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.877174 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d1cb965-585a-464d-b700-26b81bee86b5-tmp\") pod \"kube-auth-proxy-65bcf5494b-c6h7s\" (UID: \"2d1cb965-585a-464d-b700-26b81bee86b5\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:28.888611 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.888576 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdf6\" (UniqueName: \"kubernetes.io/projected/2d1cb965-585a-464d-b700-26b81bee86b5-kube-api-access-4hdf6\") pod \"kube-auth-proxy-65bcf5494b-c6h7s\" (UID: \"2d1cb965-585a-464d-b700-26b81bee86b5\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:28.893199 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.893171 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf9kk\" (UniqueName: \"kubernetes.io/projected/45789b1b-b966-4f29-8c08-3c0d4e4af245-kube-api-access-rf9kk\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:28.910514 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.910484 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hm8xl"] Jun 05 17:57:28.913481 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.913422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" Jun 05 17:57:28.917029 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.917002 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 05 17:57:28.917029 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.917022 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xt295\"" Jun 05 17:57:28.926206 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.926170 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hm8xl"] Jun 05 17:57:28.955486 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.955460 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:28.964109 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:28.964086 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:29.055061 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.055021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:29.080765 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.080725 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh4r8\" (UniqueName: \"kubernetes.io/projected/c50a5142-8cb7-4a14-9624-328bf2dd43a0-kube-api-access-zh4r8\") pod \"odh-model-controller-6dc94f689f-hm8xl\" (UID: \"c50a5142-8cb7-4a14-9624-328bf2dd43a0\") " pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" Jun 05 17:57:29.080971 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.080810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c50a5142-8cb7-4a14-9624-328bf2dd43a0-cert\") pod \"odh-model-controller-6dc94f689f-hm8xl\" (UID: \"c50a5142-8cb7-4a14-9624-328bf2dd43a0\") " pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" Jun 05 17:57:29.129796 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.129741 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4"] Jun 05 17:57:29.132250 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:57:29.132218 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45789b1b_b966_4f29_8c08_3c0d4e4af245.slice/crio-6d9f0b8105ba21cde95035eb236fbcf301304191a6afb86c180d44d15b93da6e WatchSource:0}: Error finding container 6d9f0b8105ba21cde95035eb236fbcf301304191a6afb86c180d44d15b93da6e: Status 404 returned error can't find the container with id 6d9f0b8105ba21cde95035eb236fbcf301304191a6afb86c180d44d15b93da6e Jun 05 17:57:29.154160 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.154141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:29.181708 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.181685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh4r8\" (UniqueName: \"kubernetes.io/projected/c50a5142-8cb7-4a14-9624-328bf2dd43a0-kube-api-access-zh4r8\") pod \"odh-model-controller-6dc94f689f-hm8xl\" (UID: \"c50a5142-8cb7-4a14-9624-328bf2dd43a0\") " pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" Jun 05 17:57:29.181784 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.181743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c50a5142-8cb7-4a14-9624-328bf2dd43a0-cert\") pod \"odh-model-controller-6dc94f689f-hm8xl\" (UID: \"c50a5142-8cb7-4a14-9624-328bf2dd43a0\") " pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" Jun 05 17:57:29.183992 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.183971 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c50a5142-8cb7-4a14-9624-328bf2dd43a0-cert\") pod \"odh-model-controller-6dc94f689f-hm8xl\" (UID: \"c50a5142-8cb7-4a14-9624-328bf2dd43a0\") " pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" Jun 05 17:57:29.196865 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.196841 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh4r8\" (UniqueName: \"kubernetes.io/projected/c50a5142-8cb7-4a14-9624-328bf2dd43a0-kube-api-access-zh4r8\") pod \"odh-model-controller-6dc94f689f-hm8xl\" (UID: \"c50a5142-8cb7-4a14-9624-328bf2dd43a0\") " pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" Jun 05 17:57:29.227628 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.227581 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" Jun 05 17:57:29.251957 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.251922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:29.362355 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.362329 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hm8xl"] Jun 05 17:57:29.364314 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:57:29.364281 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50a5142_8cb7_4a14_9624_328bf2dd43a0.slice/crio-fa2f3df2c1fd715fe02157be5f9463aff2aceeee5e1fc3e2ee1752c6e6ac3cdd WatchSource:0}: Error finding container fa2f3df2c1fd715fe02157be5f9463aff2aceeee5e1fc3e2ee1752c6e6ac3cdd: Status 404 returned error can't find the container with id fa2f3df2c1fd715fe02157be5f9463aff2aceeee5e1fc3e2ee1752c6e6ac3cdd Jun 05 17:57:29.383887 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.383862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d1cb965-585a-464d-b700-26b81bee86b5-tls-certs\") pod \"kube-auth-proxy-65bcf5494b-c6h7s\" (UID: \"2d1cb965-585a-464d-b700-26b81bee86b5\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:29.386388 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.386366 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d1cb965-585a-464d-b700-26b81bee86b5-tls-certs\") pod \"kube-auth-proxy-65bcf5494b-c6h7s\" (UID: \"2d1cb965-585a-464d-b700-26b81bee86b5\") " pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:29.530778 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.530745 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" Jun 05 17:57:29.566679 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.566636 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" event={"ID":"c50a5142-8cb7-4a14-9624-328bf2dd43a0","Type":"ContainerStarted","Data":"fa2f3df2c1fd715fe02157be5f9463aff2aceeee5e1fc3e2ee1752c6e6ac3cdd"} Jun 05 17:57:29.568478 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.568443 2579 generic.go:356] "Generic (PLEG): container finished" podID="45789b1b-b966-4f29-8c08-3c0d4e4af245" containerID="aacfd4a630e9abe5bef03745da0486090e2b962b6b0594a0220bb1338ad49881" exitCode=0 Jun 05 17:57:29.568592 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.568492 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" event={"ID":"45789b1b-b966-4f29-8c08-3c0d4e4af245","Type":"ContainerDied","Data":"aacfd4a630e9abe5bef03745da0486090e2b962b6b0594a0220bb1338ad49881"} Jun 05 17:57:29.568592 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.568536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" event={"ID":"45789b1b-b966-4f29-8c08-3c0d4e4af245","Type":"ContainerStarted","Data":"6d9f0b8105ba21cde95035eb236fbcf301304191a6afb86c180d44d15b93da6e"} Jun 05 17:57:29.675708 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.675676 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4mfcn"] Jun 05 17:57:29.679530 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.679506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:29.681287 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.681263 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s"] Jun 05 17:57:29.685495 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:57:29.685470 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1cb965_585a_464d_b700_26b81bee86b5.slice/crio-f3e10a05767c546da7e4ec764be714447a1be38395cace7005e4918be7da0b1a WatchSource:0}: Error finding container f3e10a05767c546da7e4ec764be714447a1be38395cace7005e4918be7da0b1a: Status 404 returned error can't find the container with id f3e10a05767c546da7e4ec764be714447a1be38395cace7005e4918be7da0b1a Jun 05 17:57:29.687359 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.687336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0447a31-39f9-42e9-8b60-3d26b6be29b6-tls-certs\") pod \"model-serving-api-5dd488fc48-4mfcn\" (UID: \"c0447a31-39f9-42e9-8b60-3d26b6be29b6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:29.687447 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.687372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps5ll\" (UniqueName: \"kubernetes.io/projected/c0447a31-39f9-42e9-8b60-3d26b6be29b6-kube-api-access-ps5ll\") pod \"model-serving-api-5dd488fc48-4mfcn\" (UID: \"c0447a31-39f9-42e9-8b60-3d26b6be29b6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:29.688529 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.688508 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 05 17:57:29.690526 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.690482 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:29.700060 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.700033 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4mfcn"] Jun 05 17:57:29.787797 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.787704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0447a31-39f9-42e9-8b60-3d26b6be29b6-tls-certs\") pod \"model-serving-api-5dd488fc48-4mfcn\" (UID: \"c0447a31-39f9-42e9-8b60-3d26b6be29b6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:29.787797 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.787743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5ll\" (UniqueName: \"kubernetes.io/projected/c0447a31-39f9-42e9-8b60-3d26b6be29b6-kube-api-access-ps5ll\") pod \"model-serving-api-5dd488fc48-4mfcn\" (UID: \"c0447a31-39f9-42e9-8b60-3d26b6be29b6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:29.787978 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:57:29.787868 2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 05 17:57:29.787978 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:57:29.787964 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0447a31-39f9-42e9-8b60-3d26b6be29b6-tls-certs podName:c0447a31-39f9-42e9-8b60-3d26b6be29b6 nodeName:}" failed. No retries permitted until 2026-06-05 17:57:30.287943545 +0000 UTC m=+521.216992570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c0447a31-39f9-42e9-8b60-3d26b6be29b6-tls-certs") pod "model-serving-api-5dd488fc48-4mfcn" (UID: "c0447a31-39f9-42e9-8b60-3d26b6be29b6") : secret "model-serving-api-tls" not found Jun 05 17:57:29.797184 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:29.797156 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps5ll\" (UniqueName: \"kubernetes.io/projected/c0447a31-39f9-42e9-8b60-3d26b6be29b6-kube-api-access-ps5ll\") pod \"model-serving-api-5dd488fc48-4mfcn\" (UID: \"c0447a31-39f9-42e9-8b60-3d26b6be29b6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:30.292631 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:30.292568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0447a31-39f9-42e9-8b60-3d26b6be29b6-tls-certs\") pod \"model-serving-api-5dd488fc48-4mfcn\" (UID: \"c0447a31-39f9-42e9-8b60-3d26b6be29b6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:30.293109 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:57:30.292749 2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 05 17:57:30.293109 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:57:30.292818 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0447a31-39f9-42e9-8b60-3d26b6be29b6-tls-certs podName:c0447a31-39f9-42e9-8b60-3d26b6be29b6 nodeName:}" failed. No retries permitted until 2026-06-05 17:57:31.29279852 +0000 UTC m=+522.221847541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c0447a31-39f9-42e9-8b60-3d26b6be29b6-tls-certs") pod "model-serving-api-5dd488fc48-4mfcn" (UID: "c0447a31-39f9-42e9-8b60-3d26b6be29b6") : secret "model-serving-api-tls" not found Jun 05 17:57:30.577915 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:30.577785 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" event={"ID":"2d1cb965-585a-464d-b700-26b81bee86b5","Type":"ContainerStarted","Data":"f3e10a05767c546da7e4ec764be714447a1be38395cace7005e4918be7da0b1a"} Jun 05 17:57:30.581589 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:30.580517 2579 generic.go:356] "Generic (PLEG): container finished" podID="45789b1b-b966-4f29-8c08-3c0d4e4af245" containerID="a69d39faebcbf2b047fcff59fca3a9f7577b33bda1b534b1767a36587a3c2bfb" exitCode=0 Jun 05 17:57:30.581589 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:30.580679 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" event={"ID":"45789b1b-b966-4f29-8c08-3c0d4e4af245","Type":"ContainerDied","Data":"a69d39faebcbf2b047fcff59fca3a9f7577b33bda1b534b1767a36587a3c2bfb"} Jun 05 17:57:30.632572 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:30.632541 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:31.303953 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:31.303914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0447a31-39f9-42e9-8b60-3d26b6be29b6-tls-certs\") pod \"model-serving-api-5dd488fc48-4mfcn\" (UID: \"c0447a31-39f9-42e9-8b60-3d26b6be29b6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:31.306916 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:31.306874 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0447a31-39f9-42e9-8b60-3d26b6be29b6-tls-certs\") pod \"model-serving-api-5dd488fc48-4mfcn\" (UID: \"c0447a31-39f9-42e9-8b60-3d26b6be29b6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:31.492023 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:31.491984 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:31.589487 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:31.589412 2579 generic.go:356] "Generic (PLEG): container finished" podID="45789b1b-b966-4f29-8c08-3c0d4e4af245" containerID="34f3c856ffe295cef9e8ea94055406e4245f63de0c6c7378f8b875bb591dddec" exitCode=0 Jun 05 17:57:31.589654 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:31.589497 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" event={"ID":"45789b1b-b966-4f29-8c08-3c0d4e4af245","Type":"ContainerDied","Data":"34f3c856ffe295cef9e8ea94055406e4245f63de0c6c7378f8b875bb591dddec"} Jun 05 17:57:33.133023 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.131289 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:33.221206 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.221171 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-util\") pod \"45789b1b-b966-4f29-8c08-3c0d4e4af245\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " Jun 05 17:57:33.221392 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.221227 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-bundle\") pod \"45789b1b-b966-4f29-8c08-3c0d4e4af245\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " Jun 05 17:57:33.221392 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.221258 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf9kk\" (UniqueName: \"kubernetes.io/projected/45789b1b-b966-4f29-8c08-3c0d4e4af245-kube-api-access-rf9kk\") pod \"45789b1b-b966-4f29-8c08-3c0d4e4af245\" (UID: \"45789b1b-b966-4f29-8c08-3c0d4e4af245\") " Jun 05 17:57:33.222278 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.222233 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-bundle" (OuterVolumeSpecName: "bundle") pod "45789b1b-b966-4f29-8c08-3c0d4e4af245" (UID: "45789b1b-b966-4f29-8c08-3c0d4e4af245"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:57:33.224125 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.224096 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45789b1b-b966-4f29-8c08-3c0d4e4af245-kube-api-access-rf9kk" (OuterVolumeSpecName: "kube-api-access-rf9kk") pod "45789b1b-b966-4f29-8c08-3c0d4e4af245" (UID: "45789b1b-b966-4f29-8c08-3c0d4e4af245"). InnerVolumeSpecName "kube-api-access-rf9kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:57:33.227473 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.227447 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-util" (OuterVolumeSpecName: "util") pod "45789b1b-b966-4f29-8c08-3c0d4e4af245" (UID: "45789b1b-b966-4f29-8c08-3c0d4e4af245"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:57:33.322210 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.322171 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-util\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:57:33.322210 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.322206 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45789b1b-b966-4f29-8c08-3c0d4e4af245-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:57:33.322210 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.322217 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf9kk\" (UniqueName: \"kubernetes.io/projected/45789b1b-b966-4f29-8c08-3c0d4e4af245-kube-api-access-rf9kk\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:57:33.602754 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.602720 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" Jun 05 17:57:33.603044 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.602729 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06qm5m4" event={"ID":"45789b1b-b966-4f29-8c08-3c0d4e4af245","Type":"ContainerDied","Data":"6d9f0b8105ba21cde95035eb236fbcf301304191a6afb86c180d44d15b93da6e"} Jun 05 17:57:33.603044 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.602873 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d9f0b8105ba21cde95035eb236fbcf301304191a6afb86c180d44d15b93da6e" Jun 05 17:57:33.759718 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:33.759696 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4mfcn"] Jun 05 17:57:33.762810 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:57:33.762786 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0447a31_39f9_42e9_8b60_3d26b6be29b6.slice/crio-ead4282ae575c7aaf75c4bb21f32f8751f5dc191567a85d093343dafb8969287 WatchSource:0}: Error finding container ead4282ae575c7aaf75c4bb21f32f8751f5dc191567a85d093343dafb8969287: Status 404 returned error can't find the container with id ead4282ae575c7aaf75c4bb21f32f8751f5dc191567a85d093343dafb8969287 Jun 05 17:57:34.611050 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:34.611010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" event={"ID":"2d1cb965-585a-464d-b700-26b81bee86b5","Type":"ContainerStarted","Data":"5e110b5dc46725a868e3311ab05cf00f24372c3e3f6a484d8be1c39bfd17c315"} Jun 05 17:57:34.612554 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:34.612516 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" event={"ID":"c0447a31-39f9-42e9-8b60-3d26b6be29b6","Type":"ContainerStarted","Data":"ead4282ae575c7aaf75c4bb21f32f8751f5dc191567a85d093343dafb8969287"} Jun 05 17:57:34.614251 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:34.614227 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" event={"ID":"c50a5142-8cb7-4a14-9624-328bf2dd43a0","Type":"ContainerStarted","Data":"a6dab5b44ca31d53906a895938e5d7e48a3b6189f6944d144ec10d3627b784df"} Jun 05 17:57:34.614390 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:34.614291 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" Jun 05 17:57:34.630132 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:34.630081 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65bcf5494b-c6h7s" podStartSLOduration=2.687844583 podStartE2EDuration="6.630066044s" totalImagesPullingTime="3.942221461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:34.628713691 +0000 UTC m=+525.557762731" watchObservedRunningTime="2026-06-05 17:57:34.630066044 +0000 UTC m=+525.559115082" Jun 05 17:57:34.650558 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:34.650505 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" podStartSLOduration=2.349018389 podStartE2EDuration="6.650489527s" totalImagesPullingTime="4.301471138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:34.648812893 +0000 UTC m=+525.577861935" watchObservedRunningTime="2026-06-05 17:57:34.650489527 +0000 UTC m=+525.579538565" Jun 05 17:57:35.622891 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:35.622849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" event={"ID":"c0447a31-39f9-42e9-8b60-3d26b6be29b6","Type":"ContainerStarted","Data":"c7e43b8b47291c1aca971985f4e546facbd3dedb01472afac25d5d9d656e288b"} Jun 05 17:57:35.623331 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:35.623078 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:35.648737 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:35.648681 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" podStartSLOduration=4.874045536 podStartE2EDuration="6.64866089s" totalImagesPullingTime="1.774615354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:35.646345483 +0000 UTC m=+526.575394524" watchObservedRunningTime="2026-06-05 17:57:35.64866089 +0000 UTC m=+526.577709929" Jun 05 17:57:39.214499 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.214414 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:39.289036 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.289003 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-m9hjx"] Jun 05 17:57:39.289405 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.289390 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45789b1b-b966-4f29-8c08-3c0d4e4af245" containerName="extract" Jun 05 17:57:39.289451 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.289408 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="45789b1b-b966-4f29-8c08-3c0d4e4af245" containerName="extract" Jun 05 17:57:39.289451 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.289428 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45789b1b-b966-4f29-8c08-3c0d4e4af245" containerName="util" Jun 05 17:57:39.289451 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.289433 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="45789b1b-b966-4f29-8c08-3c0d4e4af245" containerName="util" Jun 05 17:57:39.289451 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.289440 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45789b1b-b966-4f29-8c08-3c0d4e4af245" containerName="pull" Jun 05 17:57:39.289451 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.289446 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="45789b1b-b966-4f29-8c08-3c0d4e4af245" containerName="pull" Jun 05 17:57:39.289622 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.289512 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="45789b1b-b966-4f29-8c08-3c0d4e4af245" containerName="extract" Jun 05 17:57:39.292018 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.292001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" Jun 05 17:57:39.295621 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.295587 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n"] Jun 05 17:57:39.296120 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.296102 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 05 17:57:39.297104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.297087 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hmb86\"" Jun 05 17:57:39.298495 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.298475 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:57:39.301472 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.301455 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-d5wbj\"" Jun 05 17:57:39.301573 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.301480 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 05 17:57:39.309786 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.309764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n"] Jun 05 17:57:39.315355 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.315330 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-m9hjx"] Jun 05 17:57:39.324454 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.324431 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:39.374379 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.374337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c990f2f8-44e1-4997-917d-6be7559ecd12-cert\") pod \"kserve-controller-manager-69fc866d76-m9hjx\" (UID: \"c990f2f8-44e1-4997-917d-6be7559ecd12\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" Jun 05 17:57:39.374379 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.374386 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84cnb\" (UniqueName: \"kubernetes.io/projected/c990f2f8-44e1-4997-917d-6be7559ecd12-kube-api-access-84cnb\") pod \"kserve-controller-manager-69fc866d76-m9hjx\" (UID: \"c990f2f8-44e1-4997-917d-6be7559ecd12\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" Jun 05 17:57:39.374583 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.374414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00fdd83b-f263-4312-b68e-218d5c5d26b9-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7652n\" (UID: \"00fdd83b-f263-4312-b68e-218d5c5d26b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:57:39.374583 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.374488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hwd9\" (UniqueName: \"kubernetes.io/projected/00fdd83b-f263-4312-b68e-218d5c5d26b9-kube-api-access-7hwd9\") pod \"llmisvc-controller-manager-864bfd7bc9-7652n\" (UID: \"00fdd83b-f263-4312-b68e-218d5c5d26b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:57:39.431067 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.431034 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:39.475332 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.475245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c990f2f8-44e1-4997-917d-6be7559ecd12-cert\") pod \"kserve-controller-manager-69fc866d76-m9hjx\" (UID: \"c990f2f8-44e1-4997-917d-6be7559ecd12\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" Jun 05 17:57:39.475332 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.475284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84cnb\" (UniqueName: \"kubernetes.io/projected/c990f2f8-44e1-4997-917d-6be7559ecd12-kube-api-access-84cnb\") pod \"kserve-controller-manager-69fc866d76-m9hjx\" (UID: \"c990f2f8-44e1-4997-917d-6be7559ecd12\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" Jun 05 17:57:39.475332 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.475312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00fdd83b-f263-4312-b68e-218d5c5d26b9-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7652n\" (UID: \"00fdd83b-f263-4312-b68e-218d5c5d26b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:57:39.475558 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.475343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hwd9\" (UniqueName: \"kubernetes.io/projected/00fdd83b-f263-4312-b68e-218d5c5d26b9-kube-api-access-7hwd9\") pod \"llmisvc-controller-manager-864bfd7bc9-7652n\" (UID: \"00fdd83b-f263-4312-b68e-218d5c5d26b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:57:39.475558 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:57:39.475467 2579 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 05 17:57:39.475558 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:57:39.475548 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00fdd83b-f263-4312-b68e-218d5c5d26b9-cert podName:00fdd83b-f263-4312-b68e-218d5c5d26b9 nodeName:}" failed. No retries permitted until 2026-06-05 17:57:39.975527674 +0000 UTC m=+530.904576696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/00fdd83b-f263-4312-b68e-218d5c5d26b9-cert") pod "llmisvc-controller-manager-864bfd7bc9-7652n" (UID: "00fdd83b-f263-4312-b68e-218d5c5d26b9") : secret "llmisvc-webhook-server-cert" not found Jun 05 17:57:39.477713 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.477695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c990f2f8-44e1-4997-917d-6be7559ecd12-cert\") pod \"kserve-controller-manager-69fc866d76-m9hjx\" (UID: \"c990f2f8-44e1-4997-917d-6be7559ecd12\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" Jun 05 17:57:39.537483 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.537456 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84cnb\" (UniqueName: \"kubernetes.io/projected/c990f2f8-44e1-4997-917d-6be7559ecd12-kube-api-access-84cnb\") pod \"kserve-controller-manager-69fc866d76-m9hjx\" (UID: \"c990f2f8-44e1-4997-917d-6be7559ecd12\") " pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" Jun 05 17:57:39.558357 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.558329 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hwd9\" (UniqueName: \"kubernetes.io/projected/00fdd83b-f263-4312-b68e-218d5c5d26b9-kube-api-access-7hwd9\") pod \"llmisvc-controller-manager-864bfd7bc9-7652n\" (UID: \"00fdd83b-f263-4312-b68e-218d5c5d26b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:57:39.603289 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.603259 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" Jun 05 17:57:39.640860 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.640826 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:39.759805 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.759779 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-m9hjx"] Jun 05 17:57:39.762672 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:57:39.762643 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc990f2f8_44e1_4997_917d_6be7559ecd12.slice/crio-70a029e3bd37ebbbee60a221814357df22dcc013bcb0e034f360816700e2f0b0 WatchSource:0}: Error finding container 70a029e3bd37ebbbee60a221814357df22dcc013bcb0e034f360816700e2f0b0: Status 404 returned error can't find the container with id 70a029e3bd37ebbbee60a221814357df22dcc013bcb0e034f360816700e2f0b0 Jun 05 17:57:39.785594 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.785569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:39.895930 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.895897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:39.980718 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.980679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00fdd83b-f263-4312-b68e-218d5c5d26b9-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7652n\" (UID: \"00fdd83b-f263-4312-b68e-218d5c5d26b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:57:39.983086 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:39.983063 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00fdd83b-f263-4312-b68e-218d5c5d26b9-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7652n\" (UID: \"00fdd83b-f263-4312-b68e-218d5c5d26b9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:57:40.212234 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:40.212152 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:57:40.346251 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:40.346225 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n"] Jun 05 17:57:40.347502 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:57:40.347475 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod00fdd83b_f263_4312_b68e_218d5c5d26b9.slice/crio-21fbb842b9b25a6cb17548c568a260ad4d75485c4b2d44fec7a531fda01afdd9 WatchSource:0}: Error finding container 21fbb842b9b25a6cb17548c568a260ad4d75485c4b2d44fec7a531fda01afdd9: Status 404 returned error can't find the container with id 21fbb842b9b25a6cb17548c568a260ad4d75485c4b2d44fec7a531fda01afdd9 Jun 05 17:57:40.649029 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:40.648954 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" event={"ID":"00fdd83b-f263-4312-b68e-218d5c5d26b9","Type":"ContainerStarted","Data":"21fbb842b9b25a6cb17548c568a260ad4d75485c4b2d44fec7a531fda01afdd9"} Jun 05 17:57:40.650426 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:40.650387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" event={"ID":"c990f2f8-44e1-4997-917d-6be7559ecd12","Type":"ContainerStarted","Data":"70a029e3bd37ebbbee60a221814357df22dcc013bcb0e034f360816700e2f0b0"} Jun 05 17:57:41.812858 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:41.812825 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:41.956965 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:41.956917 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:43.060246 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.060205 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h"] Jun 05 17:57:43.064308 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.064284 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.069134 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.069108 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 17:57:43.069517 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.069497 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b8ngf\"" Jun 05 17:57:43.070747 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.070724 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 17:57:43.116126 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.116079 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjx2l\" (UniqueName: \"kubernetes.io/projected/11391bdb-db76-470a-a67b-0f70ee61164d-kube-api-access-sjx2l\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.116306 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.116212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.116306 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.116270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.132029 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.131996 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h"] Jun 05 17:57:43.217271 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.217215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjx2l\" (UniqueName: \"kubernetes.io/projected/11391bdb-db76-470a-a67b-0f70ee61164d-kube-api-access-sjx2l\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.217498 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.217332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.217498 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.217386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.217849 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.217829 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.217909 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.217857 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.270531 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.270465 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjx2l\" (UniqueName: \"kubernetes.io/projected/11391bdb-db76-470a-a67b-0f70ee61164d-kube-api-access-sjx2l\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.375525 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.375442 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:43.470367 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.470326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:43.599809 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.599369 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:43.671301 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.671201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" event={"ID":"c990f2f8-44e1-4997-917d-6be7559ecd12","Type":"ContainerStarted","Data":"1221d2812cef4aec11383b44f253118cd7864b106b6b237c93e6cff0526a5d1a"} Jun 05 17:57:43.671301 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.671280 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" Jun 05 17:57:43.727175 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.727148 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:43.931035 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.930973 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" podStartSLOduration=2.051335252 podStartE2EDuration="4.930951211s" totalImagesPullingTime="2.879615959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:43.70907479 +0000 UTC m=+534.638123829" watchObservedRunningTime="2026-06-05 17:57:43.930951211 +0000 UTC m=+534.860000251" Jun 05 17:57:43.932676 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:43.932652 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h"] Jun 05 17:57:43.934660 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:57:43.934633 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11391bdb_db76_470a_a67b_0f70ee61164d.slice/crio-7b49479d00d1415897b0ce9792befd7f5a430a95a52b6db220e807be8d431b2b WatchSource:0}: Error finding container 7b49479d00d1415897b0ce9792befd7f5a430a95a52b6db220e807be8d431b2b: Status 404 returned error can't find the container with id 7b49479d00d1415897b0ce9792befd7f5a430a95a52b6db220e807be8d431b2b Jun 05 17:57:44.304960 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:44.304928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:44.678320 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:44.678217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" event={"ID":"00fdd83b-f263-4312-b68e-218d5c5d26b9","Type":"ContainerStarted","Data":"336bd138553b2e2c6c5def0dd9010690c6e813558465db2f2410c6105230dc31"} Jun 05 17:57:44.678320 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:44.678292 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:57:44.679859 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:44.679831 2579 generic.go:356] "Generic (PLEG): container finished" podID="11391bdb-db76-470a-a67b-0f70ee61164d" containerID="ca1cbc6adb9593d7ede91ca64f9c57473917c6f9653ebc5dc8f32ed88fbcd8f6" exitCode=0 Jun 05 17:57:44.679990 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:44.679910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" event={"ID":"11391bdb-db76-470a-a67b-0f70ee61164d","Type":"ContainerDied","Data":"ca1cbc6adb9593d7ede91ca64f9c57473917c6f9653ebc5dc8f32ed88fbcd8f6"} Jun 05 17:57:44.679990 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:44.679953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" event={"ID":"11391bdb-db76-470a-a67b-0f70ee61164d","Type":"ContainerStarted","Data":"7b49479d00d1415897b0ce9792befd7f5a430a95a52b6db220e807be8d431b2b"} Jun 05 17:57:44.704296 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:44.704251 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" podStartSLOduration=2.251005569 podStartE2EDuration="5.704233324s" totalImagesPullingTime="3.453227755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:44.701621537 +0000 UTC m=+535.630670570" watchObservedRunningTime="2026-06-05 17:57:44.704233324 +0000 UTC m=+535.633282363" Jun 05 17:57:45.127552 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.127512 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k"] Jun 05 17:57:45.131800 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.131777 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" Jun 05 17:57:45.135321 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.135293 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 05 17:57:45.135321 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.135314 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-p8pwn\"" Jun 05 17:57:45.135813 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.135797 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 05 17:57:45.160107 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.160081 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k"] Jun 05 17:57:45.235050 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.235019 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpglv\" (UniqueName: \"kubernetes.io/projected/a8ed520c-d973-4137-b415-e4dd942aafd3-kube-api-access-lpglv\") pod \"servicemesh-operator3-57f65f65fb-7gx2k\" (UID: \"a8ed520c-d973-4137-b415-e4dd942aafd3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" Jun 05 17:57:45.235242 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.235068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a8ed520c-d973-4137-b415-e4dd942aafd3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7gx2k\" (UID: \"a8ed520c-d973-4137-b415-e4dd942aafd3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" Jun 05 17:57:45.336329 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.336293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpglv\" (UniqueName: \"kubernetes.io/projected/a8ed520c-d973-4137-b415-e4dd942aafd3-kube-api-access-lpglv\") pod \"servicemesh-operator3-57f65f65fb-7gx2k\" (UID: \"a8ed520c-d973-4137-b415-e4dd942aafd3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" Jun 05 17:57:45.336801 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.336348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a8ed520c-d973-4137-b415-e4dd942aafd3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7gx2k\" (UID: \"a8ed520c-d973-4137-b415-e4dd942aafd3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" Jun 05 17:57:45.338942 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.338907 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a8ed520c-d973-4137-b415-e4dd942aafd3-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7gx2k\" (UID: \"a8ed520c-d973-4137-b415-e4dd942aafd3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" Jun 05 17:57:45.350128 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.350100 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpglv\" (UniqueName: \"kubernetes.io/projected/a8ed520c-d973-4137-b415-e4dd942aafd3-kube-api-access-lpglv\") pod \"servicemesh-operator3-57f65f65fb-7gx2k\" (UID: \"a8ed520c-d973-4137-b415-e4dd942aafd3\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" Jun 05 17:57:45.441246 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.441222 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" Jun 05 17:57:45.593772 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.593709 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k"] Jun 05 17:57:45.595558 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:57:45.595534 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ed520c_d973_4137_b415_e4dd942aafd3.slice/crio-ed8830546189116b6e15d4d7b6adb0c6206340650ce20a177737c4bd131caccb WatchSource:0}: Error finding container ed8830546189116b6e15d4d7b6adb0c6206340650ce20a177737c4bd131caccb: Status 404 returned error can't find the container with id ed8830546189116b6e15d4d7b6adb0c6206340650ce20a177737c4bd131caccb Jun 05 17:57:45.625089 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.625057 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-hm8xl" Jun 05 17:57:45.687168 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.687079 2579 generic.go:356] "Generic (PLEG): container finished" podID="11391bdb-db76-470a-a67b-0f70ee61164d" containerID="46c70e726ceae33b790ef6af0c55e8f8725e7f3baf49e99ddfce19368e6ba860" exitCode=0 Jun 05 17:57:45.687168 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.687156 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" event={"ID":"11391bdb-db76-470a-a67b-0f70ee61164d","Type":"ContainerDied","Data":"46c70e726ceae33b790ef6af0c55e8f8725e7f3baf49e99ddfce19368e6ba860"} Jun 05 17:57:45.689005 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:45.688982 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" event={"ID":"a8ed520c-d973-4137-b415-e4dd942aafd3","Type":"ContainerStarted","Data":"ed8830546189116b6e15d4d7b6adb0c6206340650ce20a177737c4bd131caccb"} Jun 05 17:57:46.631778 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:46.631751 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-4mfcn" Jun 05 17:57:46.696256 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:46.696223 2579 generic.go:356] "Generic (PLEG): container finished" podID="11391bdb-db76-470a-a67b-0f70ee61164d" containerID="6d6ad3dcae087c4188e3665e87cbb8bf43e78257d308137d6ffd9ca2043f4605" exitCode=0 Jun 05 17:57:46.696416 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:46.696279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" event={"ID":"11391bdb-db76-470a-a67b-0f70ee61164d","Type":"ContainerDied","Data":"6d6ad3dcae087c4188e3665e87cbb8bf43e78257d308137d6ffd9ca2043f4605"} Jun 05 17:57:47.832211 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:47.832184 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:47.964524 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:47.964439 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-util\") pod \"11391bdb-db76-470a-a67b-0f70ee61164d\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " Jun 05 17:57:47.964524 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:47.964519 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjx2l\" (UniqueName: \"kubernetes.io/projected/11391bdb-db76-470a-a67b-0f70ee61164d-kube-api-access-sjx2l\") pod \"11391bdb-db76-470a-a67b-0f70ee61164d\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " Jun 05 17:57:47.964769 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:47.964587 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-bundle\") pod \"11391bdb-db76-470a-a67b-0f70ee61164d\" (UID: \"11391bdb-db76-470a-a67b-0f70ee61164d\") " Jun 05 17:57:47.965568 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:47.965536 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-bundle" (OuterVolumeSpecName: "bundle") pod "11391bdb-db76-470a-a67b-0f70ee61164d" (UID: "11391bdb-db76-470a-a67b-0f70ee61164d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:57:47.967196 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:47.967166 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11391bdb-db76-470a-a67b-0f70ee61164d-kube-api-access-sjx2l" (OuterVolumeSpecName: "kube-api-access-sjx2l") pod "11391bdb-db76-470a-a67b-0f70ee61164d" (UID: "11391bdb-db76-470a-a67b-0f70ee61164d"). InnerVolumeSpecName "kube-api-access-sjx2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:57:47.971434 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:47.971408 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-util" (OuterVolumeSpecName: "util") pod "11391bdb-db76-470a-a67b-0f70ee61164d" (UID: "11391bdb-db76-470a-a67b-0f70ee61164d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:57:48.066274 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:48.066235 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjx2l\" (UniqueName: \"kubernetes.io/projected/11391bdb-db76-470a-a67b-0f70ee61164d-kube-api-access-sjx2l\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:57:48.066274 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:48.066272 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:57:48.066516 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:48.066287 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11391bdb-db76-470a-a67b-0f70ee61164d-util\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:57:48.709487 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:48.709446 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" event={"ID":"11391bdb-db76-470a-a67b-0f70ee61164d","Type":"ContainerDied","Data":"7b49479d00d1415897b0ce9792befd7f5a430a95a52b6db220e807be8d431b2b"} Jun 05 17:57:48.709487 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:48.709477 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agf25h" Jun 05 17:57:48.709721 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:48.709509 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b49479d00d1415897b0ce9792befd7f5a430a95a52b6db220e807be8d431b2b" Jun 05 17:57:49.716771 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:49.716732 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" event={"ID":"a8ed520c-d973-4137-b415-e4dd942aafd3","Type":"ContainerStarted","Data":"cc32b5b4b4221b50d63677344655406b344b9755d2e49be2bd4bdf34f159639a"} Jun 05 17:57:49.717203 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:49.716848 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" Jun 05 17:57:49.741052 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:49.741000 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" podStartSLOduration=0.733165618 podStartE2EDuration="4.740983221s" totalImagesPullingTime="4.007817603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:57:49.738385877 +0000 UTC m=+540.667434949" watchObservedRunningTime="2026-06-05 17:57:49.740983221 +0000 UTC m=+540.670032259" Jun 05 17:57:54.686232 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:54.686197 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:57:55.716944 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:57:55.716912 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:00.724178 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:00.724151 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7gx2k" Jun 05 17:58:04.475396 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.475356 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-dc4bb59b5-2rvxw"] Jun 05 17:58:04.475964 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.475943 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11391bdb-db76-470a-a67b-0f70ee61164d" containerName="util" Jun 05 17:58:04.475964 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.475965 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11391bdb-db76-470a-a67b-0f70ee61164d" containerName="util" Jun 05 17:58:04.476111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.475983 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11391bdb-db76-470a-a67b-0f70ee61164d" containerName="extract" Jun 05 17:58:04.476111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.475991 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11391bdb-db76-470a-a67b-0f70ee61164d" containerName="extract" Jun 05 17:58:04.476111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.476007 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11391bdb-db76-470a-a67b-0f70ee61164d" containerName="pull" Jun 05 17:58:04.476111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.476013 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11391bdb-db76-470a-a67b-0f70ee61164d" containerName="pull" Jun 05 17:58:04.476111 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.476078 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11391bdb-db76-470a-a67b-0f70ee61164d" containerName="extract" Jun 05 17:58:04.479736 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.479713 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" Jun 05 17:58:04.483144 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.483122 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n486b\"" Jun 05 17:58:04.483244 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.483192 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 17:58:04.487629 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.487580 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dc4bb59b5-2rvxw"] Jun 05 17:58:04.520161 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.520130 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:04.611112 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.611067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5584ece9-f5e3-4d9e-aaf5-3270c9073cae-redirect-config\") pod \"dashboard-redirect-dc4bb59b5-2rvxw\" (UID: \"5584ece9-f5e3-4d9e-aaf5-3270c9073cae\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" Jun 05 17:58:04.611316 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.611238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqw94\" (UniqueName: \"kubernetes.io/projected/5584ece9-f5e3-4d9e-aaf5-3270c9073cae-kube-api-access-wqw94\") pod \"dashboard-redirect-dc4bb59b5-2rvxw\" (UID: \"5584ece9-f5e3-4d9e-aaf5-3270c9073cae\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" Jun 05 17:58:04.712591 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.712549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5584ece9-f5e3-4d9e-aaf5-3270c9073cae-redirect-config\") pod \"dashboard-redirect-dc4bb59b5-2rvxw\" (UID: \"5584ece9-f5e3-4d9e-aaf5-3270c9073cae\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" Jun 05 17:58:04.712803 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.712681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqw94\" (UniqueName: \"kubernetes.io/projected/5584ece9-f5e3-4d9e-aaf5-3270c9073cae-kube-api-access-wqw94\") pod \"dashboard-redirect-dc4bb59b5-2rvxw\" (UID: \"5584ece9-f5e3-4d9e-aaf5-3270c9073cae\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" Jun 05 17:58:04.713262 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.713239 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5584ece9-f5e3-4d9e-aaf5-3270c9073cae-redirect-config\") pod \"dashboard-redirect-dc4bb59b5-2rvxw\" (UID: \"5584ece9-f5e3-4d9e-aaf5-3270c9073cae\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" Jun 05 17:58:04.721994 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.721966 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqw94\" (UniqueName: \"kubernetes.io/projected/5584ece9-f5e3-4d9e-aaf5-3270c9073cae-kube-api-access-wqw94\") pod \"dashboard-redirect-dc4bb59b5-2rvxw\" (UID: \"5584ece9-f5e3-4d9e-aaf5-3270c9073cae\") " pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" Jun 05 17:58:04.793050 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.793022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" Jun 05 17:58:04.927797 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:04.927765 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dc4bb59b5-2rvxw"] Jun 05 17:58:04.929583 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:58:04.929551 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5584ece9_f5e3_4d9e_aaf5_3270c9073cae.slice/crio-23b4bc375569940ca27e273857694f97528ff6b7b4e2c170460482cd8ee39bac WatchSource:0}: Error finding container 23b4bc375569940ca27e273857694f97528ff6b7b4e2c170460482cd8ee39bac: Status 404 returned error can't find the container with id 23b4bc375569940ca27e273857694f97528ff6b7b4e2c170460482cd8ee39bac Jun 05 17:58:05.798777 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:05.798741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" event={"ID":"5584ece9-f5e3-4d9e-aaf5-3270c9073cae","Type":"ContainerStarted","Data":"23b4bc375569940ca27e273857694f97528ff6b7b4e2c170460482cd8ee39bac"} Jun 05 17:58:09.827509 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:09.827470 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" event={"ID":"5584ece9-f5e3-4d9e-aaf5-3270c9073cae","Type":"ContainerStarted","Data":"3d5a7d1aa3bb41e6f37fd74d513b5e91e0608f2c777f1ca6725db9204eb533c4"} Jun 05 17:58:09.847358 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:09.847304 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-dc4bb59b5-2rvxw" podStartSLOduration=2.011349601 podStartE2EDuration="5.847289639s" totalImagesPullingTime="3.835940038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:58:09.845203789 +0000 UTC m=+560.774252853" watchObservedRunningTime="2026-06-05 17:58:09.847289639 +0000 UTC m=+560.776338677" Jun 05 17:58:14.685580 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.685545 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-m9hjx" Jun 05 17:58:14.738817 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.738780 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:14.739562 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.739538 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j"] Jun 05 17:58:14.744594 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.744573 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.747389 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.747364 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 05 17:58:14.747494 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.747375 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2rgrd\"" Jun 05 17:58:14.747585 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.747569 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 17:58:14.747664 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.747590 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 05 17:58:14.747664 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.747592 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 05 17:58:14.753705 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.753683 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j"] Jun 05 17:58:14.798226 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.798194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:14.804555 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.804520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.804731 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.804574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.804731 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.804597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.804731 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.804637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knbdn\" (UniqueName: \"kubernetes.io/projected/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-kube-api-access-knbdn\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.804731 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.804659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.804731 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.804695 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.804900 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.804737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.905325 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.905286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.905508 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.905335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.905508 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.905361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knbdn\" (UniqueName: \"kubernetes.io/projected/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-kube-api-access-knbdn\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.905508 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.905399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.905508 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.905465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.905789 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.905536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.905789 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.905577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.906338 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.906307 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.907948 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.907925 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.908053 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.908033 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.908102 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.908055 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.908267 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.908248 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.914921 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.914891 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:14.915028 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:14.915012 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knbdn\" (UniqueName: \"kubernetes.io/projected/84b0318c-29db-49a8-a8a1-367a7f6ad9f3-kube-api-access-knbdn\") pod \"istiod-openshift-gateway-75c67f8887-nzh9j\" (UID: \"84b0318c-29db-49a8-a8a1-367a7f6ad9f3\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:15.055649 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:15.055592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:15.244057 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:15.244032 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j"] Jun 05 17:58:15.246279 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:58:15.246250 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b0318c_29db_49a8_a8a1_367a7f6ad9f3.slice/crio-18f8a9e0c835fbe7db0e33d4a31ba96ff03963141799f5f78950e6cfa96065bb WatchSource:0}: Error finding container 18f8a9e0c835fbe7db0e33d4a31ba96ff03963141799f5f78950e6cfa96065bb: Status 404 returned error can't find the container with id 18f8a9e0c835fbe7db0e33d4a31ba96ff03963141799f5f78950e6cfa96065bb Jun 05 17:58:15.324237 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:15.324157 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:15.691785 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:15.691703 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7652n" Jun 05 17:58:15.868651 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:15.868616 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" event={"ID":"84b0318c-29db-49a8-a8a1-367a7f6ad9f3","Type":"ContainerStarted","Data":"18f8a9e0c835fbe7db0e33d4a31ba96ff03963141799f5f78950e6cfa96065bb"} Jun 05 17:58:17.805877 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:17.805830 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 17:58:17.806198 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:17.805915 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 17:58:17.882519 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:17.882483 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" event={"ID":"84b0318c-29db-49a8-a8a1-367a7f6ad9f3","Type":"ContainerStarted","Data":"30cb40b589f3164644e1d96185d65c7478c197df160b0951aa7918e366bdfe12"} Jun 05 17:58:17.882659 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:17.882595 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:17.904204 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:17.904152 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" podStartSLOduration=1.3470170430000001 podStartE2EDuration="3.904131534s" totalImagesPullingTime="2.557114491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:58:17.904006253 +0000 UTC m=+568.833055292" watchObservedRunningTime="2026-06-05 17:58:17.904131534 +0000 UTC m=+568.833180574" Jun 05 17:58:18.889815 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:18.889769 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-nzh9j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 05 17:58:18.890180 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:18.889833 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" podUID="84b0318c-29db-49a8-a8a1-367a7f6ad9f3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 17:58:19.090493 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:19.090454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:19.185193 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:19.185025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:19.490410 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:19.490368 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:19.574657 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:19.574595 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:19.674413 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:19.674382 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:21.888332 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:21.888300 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-nzh9j" Jun 05 17:58:22.554962 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:22.554917 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:28.867144 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:28.867107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:29.566590 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:29.566553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:29.657886 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:29.657853 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:29.760471 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:29.760443 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:30.477815 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:30.477777 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:30.679099 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:30.679069 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:31.984726 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:31.984678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:32.045438 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:32.045411 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:42.680196 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:42.680131 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7dff96df-xf9bt"] Jun 05 17:58:42.789738 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:42.789705 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:42.892641 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:42.892592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:42.952644 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:42.952552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:44.612285 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:44.612250 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:44.669501 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:44.669457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:49.523773 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:49.523746 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 17:58:49.524347 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:49.524030 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 17:58:55.292410 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:55.292375 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:58:59.034543 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.034475 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9"] Jun 05 17:58:59.038507 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.038486 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:58:59.041916 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.041889 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8zznq\"" Jun 05 17:58:59.043212 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.043179 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 17:58:59.043212 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.043199 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 17:58:59.055591 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.055568 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9"] Jun 05 17:58:59.207295 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.207254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvkqm\" (UniqueName: \"kubernetes.io/projected/d878dcb2-5ab8-4747-a05e-5882c048e524-kube-api-access-gvkqm\") pod \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" (UID: \"d878dcb2-5ab8-4747-a05e-5882c048e524\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:58:59.307822 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.307727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvkqm\" (UniqueName: \"kubernetes.io/projected/d878dcb2-5ab8-4747-a05e-5882c048e524-kube-api-access-gvkqm\") pod \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" (UID: \"d878dcb2-5ab8-4747-a05e-5882c048e524\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:58:59.320952 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.320917 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvkqm\" (UniqueName: \"kubernetes.io/projected/d878dcb2-5ab8-4747-a05e-5882c048e524-kube-api-access-gvkqm\") pod \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" (UID: \"d878dcb2-5ab8-4747-a05e-5882c048e524\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:58:59.350143 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.350117 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:58:59.503973 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:58:59.503949 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9"] Jun 05 17:58:59.506212 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:58:59.506177 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd878dcb2_5ab8_4747_a05e_5882c048e524.slice/crio-08ce6e9409c55d599d70782531c3b3bbcc767495d575efd73b0b06d02cacb5a4 WatchSource:0}: Error finding container 08ce6e9409c55d599d70782531c3b3bbcc767495d575efd73b0b06d02cacb5a4: Status 404 returned error can't find the container with id 08ce6e9409c55d599d70782531c3b3bbcc767495d575efd73b0b06d02cacb5a4 Jun 05 17:59:00.120585 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:00.120550 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" event={"ID":"d878dcb2-5ab8-4747-a05e-5882c048e524","Type":"ContainerStarted","Data":"08ce6e9409c55d599d70782531c3b3bbcc767495d575efd73b0b06d02cacb5a4"} Jun 05 17:59:00.134945 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:00.134914 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:00.259105 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:00.259077 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:02.132381 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:02.132348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" event={"ID":"d878dcb2-5ab8-4747-a05e-5882c048e524","Type":"ContainerStarted","Data":"48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd"} Jun 05 17:59:02.132864 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:02.132443 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:02.153352 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:02.153286 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" podStartSLOduration=0.963594377 podStartE2EDuration="3.15326412s" totalImagesPullingTime="2.189669743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:59:02.151636318 +0000 UTC m=+613.080685358" watchObservedRunningTime="2026-06-05 17:59:02.15326412 +0000 UTC m=+613.082313160" Jun 05 17:59:05.482294 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:05.482261 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:06.296389 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:06.296358 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:07.700885 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.700842 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f7dff96df-xf9bt" podUID="c82e7432-97d3-48af-afbf-5e8d968e8b72" containerName="console" containerID="cri-o://b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1" gracePeriod=15 Jun 05 17:59:07.967355 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.967290 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:59:07.989957 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.989917 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-serving-cert\") pod \"c82e7432-97d3-48af-afbf-5e8d968e8b72\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " Jun 05 17:59:07.990142 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.989998 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-oauth-serving-cert\") pod \"c82e7432-97d3-48af-afbf-5e8d968e8b72\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " Jun 05 17:59:07.990142 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.990030 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4rzs\" (UniqueName: \"kubernetes.io/projected/c82e7432-97d3-48af-afbf-5e8d968e8b72-kube-api-access-g4rzs\") pod \"c82e7432-97d3-48af-afbf-5e8d968e8b72\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " Jun 05 17:59:07.990142 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.990075 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-config\") pod \"c82e7432-97d3-48af-afbf-5e8d968e8b72\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " Jun 05 17:59:07.990142 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.990102 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-service-ca\") pod \"c82e7432-97d3-48af-afbf-5e8d968e8b72\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " Jun 05 17:59:07.991104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.990442 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c82e7432-97d3-48af-afbf-5e8d968e8b72" (UID: "c82e7432-97d3-48af-afbf-5e8d968e8b72"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:59:07.991104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.990499 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-trusted-ca-bundle\") pod \"c82e7432-97d3-48af-afbf-5e8d968e8b72\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " Jun 05 17:59:07.991104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.990540 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-oauth-config\") pod \"c82e7432-97d3-48af-afbf-5e8d968e8b72\" (UID: \"c82e7432-97d3-48af-afbf-5e8d968e8b72\") " Jun 05 17:59:07.991104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.990889 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-oauth-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:59:07.991104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.990496 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-service-ca" (OuterVolumeSpecName: "service-ca") pod "c82e7432-97d3-48af-afbf-5e8d968e8b72" (UID: "c82e7432-97d3-48af-afbf-5e8d968e8b72"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:59:07.991104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.990789 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-config" (OuterVolumeSpecName: "console-config") pod "c82e7432-97d3-48af-afbf-5e8d968e8b72" (UID: "c82e7432-97d3-48af-afbf-5e8d968e8b72"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:59:07.991104 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.991060 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c82e7432-97d3-48af-afbf-5e8d968e8b72" (UID: "c82e7432-97d3-48af-afbf-5e8d968e8b72"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 17:59:07.993332 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.993305 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c82e7432-97d3-48af-afbf-5e8d968e8b72-kube-api-access-g4rzs" (OuterVolumeSpecName: "kube-api-access-g4rzs") pod "c82e7432-97d3-48af-afbf-5e8d968e8b72" (UID: "c82e7432-97d3-48af-afbf-5e8d968e8b72"). InnerVolumeSpecName "kube-api-access-g4rzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:59:07.993624 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.993563 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c82e7432-97d3-48af-afbf-5e8d968e8b72" (UID: "c82e7432-97d3-48af-afbf-5e8d968e8b72"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:59:07.993967 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:07.993938 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c82e7432-97d3-48af-afbf-5e8d968e8b72" (UID: "c82e7432-97d3-48af-afbf-5e8d968e8b72"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 17:59:08.091851 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.091818 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-trusted-ca-bundle\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:59:08.091851 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.091848 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-oauth-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:59:08.092082 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.091863 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-serving-cert\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:59:08.092082 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.091878 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4rzs\" (UniqueName: \"kubernetes.io/projected/c82e7432-97d3-48af-afbf-5e8d968e8b72-kube-api-access-g4rzs\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:59:08.092082 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.091890 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-console-config\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:59:08.092082 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.091902 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c82e7432-97d3-48af-afbf-5e8d968e8b72-service-ca\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:59:08.164595 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.164555 2579 generic.go:356] "Generic (PLEG): container finished" podID="c82e7432-97d3-48af-afbf-5e8d968e8b72" containerID="b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1" exitCode=0 Jun 05 17:59:08.164595 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.164597 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7dff96df-xf9bt" Jun 05 17:59:08.164858 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.164640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7dff96df-xf9bt" event={"ID":"c82e7432-97d3-48af-afbf-5e8d968e8b72","Type":"ContainerDied","Data":"b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1"} Jun 05 17:59:08.164858 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.164699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7dff96df-xf9bt" event={"ID":"c82e7432-97d3-48af-afbf-5e8d968e8b72","Type":"ContainerDied","Data":"d6585e4bbb1598fa8b3c0b68a16aab91c452c0e30cd1627774adf97fa8081ea3"} Jun 05 17:59:08.164858 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.164720 2579 scope.go:117] "RemoveContainer" containerID="b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1" Jun 05 17:59:08.174512 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.174485 2579 scope.go:117] "RemoveContainer" containerID="b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1" Jun 05 17:59:08.174789 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:08.174770 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1\": container with ID starting with b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1 not found: ID does not exist" containerID="b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1" Jun 05 17:59:08.174869 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.174801 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1"} err="failed to get container status \"b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1\": rpc error: code = NotFound desc = could not find container \"b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1\": container with ID starting with b6b2aeabd4a51049afee890b2b25f2397c5bcc0803de2a78a87230aa838282b1 not found: ID does not exist" Jun 05 17:59:08.197756 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.197725 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7dff96df-xf9bt"] Jun 05 17:59:08.202497 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.202471 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f7dff96df-xf9bt"] Jun 05 17:59:08.907688 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.907650 2579 patch_prober.go:28] interesting pod/console-5f7dff96df-xf9bt container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.26:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 05 17:59:08.908086 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:08.907719 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5f7dff96df-xf9bt" podUID="c82e7432-97d3-48af-afbf-5e8d968e8b72" containerName="console" probeResult="failure" output="Get \"https://10.132.0.26:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jun 05 17:59:09.533823 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:09.533793 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c82e7432-97d3-48af-afbf-5e8d968e8b72" path="/var/lib/kubelet/pods/c82e7432-97d3-48af-afbf-5e8d968e8b72/volumes" Jun 05 17:59:09.724978 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:09.724944 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:11.338899 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.338865 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:11.699065 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.698970 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj"] Jun 05 17:59:11.699458 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.699439 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82e7432-97d3-48af-afbf-5e8d968e8b72" containerName="console" Jun 05 17:59:11.699545 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.699462 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82e7432-97d3-48af-afbf-5e8d968e8b72" containerName="console" Jun 05 17:59:11.699595 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.699547 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c82e7432-97d3-48af-afbf-5e8d968e8b72" containerName="console" Jun 05 17:59:11.702869 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.702850 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj" Jun 05 17:59:11.705833 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.705811 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 17:59:11.706239 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.706223 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-r8q6c\"" Jun 05 17:59:11.713650 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.713627 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj"] Jun 05 17:59:11.825048 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.825007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqhz7\" (UniqueName: \"kubernetes.io/projected/bed4db7f-529a-4010-9a5d-25a81411b124-kube-api-access-jqhz7\") pod \"dns-operator-controller-manager-864dd78c4c-748cj\" (UID: \"bed4db7f-529a-4010-9a5d-25a81411b124\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj" Jun 05 17:59:11.925837 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.925790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhz7\" (UniqueName: \"kubernetes.io/projected/bed4db7f-529a-4010-9a5d-25a81411b124-kube-api-access-jqhz7\") pod \"dns-operator-controller-manager-864dd78c4c-748cj\" (UID: \"bed4db7f-529a-4010-9a5d-25a81411b124\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj" Jun 05 17:59:11.934716 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:11.934683 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqhz7\" (UniqueName: \"kubernetes.io/projected/bed4db7f-529a-4010-9a5d-25a81411b124-kube-api-access-jqhz7\") pod \"dns-operator-controller-manager-864dd78c4c-748cj\" (UID: \"bed4db7f-529a-4010-9a5d-25a81411b124\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj" Jun 05 17:59:12.013799 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:12.013768 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj" Jun 05 17:59:12.157457 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:12.157432 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj"] Jun 05 17:59:12.159372 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:59:12.159337 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed4db7f_529a_4010_9a5d_25a81411b124.slice/crio-8be9fc189b478129e528485797376cc94aa386ed20c12112de986f5586018baa WatchSource:0}: Error finding container 8be9fc189b478129e528485797376cc94aa386ed20c12112de986f5586018baa: Status 404 returned error can't find the container with id 8be9fc189b478129e528485797376cc94aa386ed20c12112de986f5586018baa Jun 05 17:59:12.192038 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:12.192005 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj" event={"ID":"bed4db7f-529a-4010-9a5d-25a81411b124","Type":"ContainerStarted","Data":"8be9fc189b478129e528485797376cc94aa386ed20c12112de986f5586018baa"} Jun 05 17:59:13.140362 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:13.140328 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:13.422497 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:13.422395 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:13.642952 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:13.642923 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:14.191552 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:14.191529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:15.216411 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:15.216360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj" event={"ID":"bed4db7f-529a-4010-9a5d-25a81411b124","Type":"ContainerStarted","Data":"51d967584f7a1aa9468de3c3779118b5dfd0f538db9d6d03ba029d35c7ff5334"} Jun 05 17:59:15.216789 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:15.216456 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj" Jun 05 17:59:15.233454 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:15.233404 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj" podStartSLOduration=2.257965057 podStartE2EDuration="4.233389345s" totalImagesPullingTime="1.975424288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:59:15.232733966 +0000 UTC m=+626.161783028" watchObservedRunningTime="2026-06-05 17:59:15.233389345 +0000 UTC m=+626.162438384" Jun 05 17:59:16.323296 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:16.323259 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:18.289252 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:18.289216 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:18.363011 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:18.362979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:23.601140 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.601101 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf"] Jun 05 17:59:23.604712 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.604696 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:23.608058 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.608033 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-v85fv\"" Jun 05 17:59:23.616334 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.616312 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf"] Jun 05 17:59:23.731412 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.731379 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf"] Jun 05 17:59:23.731695 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:23.731675 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-59m2q], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" podUID="53714237-5757-48b9-b4c3-132fd4f9151c" Jun 05 17:59:23.735575 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.735517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53714237-5757-48b9-b4c3-132fd4f9151c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zqtbf\" (UID: \"53714237-5757-48b9-b4c3-132fd4f9151c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:23.735754 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.735736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59m2q\" (UniqueName: \"kubernetes.io/projected/53714237-5757-48b9-b4c3-132fd4f9151c-kube-api-access-59m2q\") pod \"kuadrant-operator-controller-manager-86878c769f-zqtbf\" (UID: \"53714237-5757-48b9-b4c3-132fd4f9151c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:23.742211 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.742185 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf"] Jun 05 17:59:23.764729 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.764684 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9"] Jun 05 17:59:23.764970 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.764944 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" containerName="manager" containerID="cri-o://48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd" gracePeriod=2 Jun 05 17:59:23.768006 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.767981 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7"] Jun 05 17:59:23.772807 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.772787 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 17:59:23.772909 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.772822 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9"] Jun 05 17:59:23.776468 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:23.776436 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:23.787418 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.786720 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7"] Jun 05 17:59:23.789042 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.789020 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26"] Jun 05 17:59:23.789453 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.789435 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" containerName="manager" Jun 05 17:59:23.789453 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.789451 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" containerName="manager" Jun 05 17:59:23.789565 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.789516 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" containerName="manager" Jun 05 17:59:23.792470 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.792452 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26" Jun 05 17:59:23.810837 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.810806 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26"] Jun 05 17:59:23.812390 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:23.812354 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:23.836704 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.836672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59m2q\" (UniqueName: \"kubernetes.io/projected/53714237-5757-48b9-b4c3-132fd4f9151c-kube-api-access-59m2q\") pod \"kuadrant-operator-controller-manager-86878c769f-zqtbf\" (UID: \"53714237-5757-48b9-b4c3-132fd4f9151c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:23.836842 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.836739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd824379-125d-42a6-ade0-ac7f8cfc017c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b2ps7\" (UID: \"fd824379-125d-42a6-ade0-ac7f8cfc017c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 17:59:23.836842 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.836790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53714237-5757-48b9-b4c3-132fd4f9151c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zqtbf\" (UID: \"53714237-5757-48b9-b4c3-132fd4f9151c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:23.836921 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.836858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdp54\" (UniqueName: \"kubernetes.io/projected/fd824379-125d-42a6-ade0-ac7f8cfc017c-kube-api-access-bdp54\") pod \"kuadrant-operator-controller-manager-86878c769f-b2ps7\" (UID: \"fd824379-125d-42a6-ade0-ac7f8cfc017c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 17:59:23.837333 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.837301 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53714237-5757-48b9-b4c3-132fd4f9151c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zqtbf\" (UID: \"53714237-5757-48b9-b4c3-132fd4f9151c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:23.842959 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:23.842935 2579 projected.go:196] Error preparing data for projected volume kube-api-access-59m2q for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-zqtbf" not found Jun 05 17:59:23.843192 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:23.843177 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53714237-5757-48b9-b4c3-132fd4f9151c-kube-api-access-59m2q podName:53714237-5757-48b9-b4c3-132fd4f9151c nodeName:}" failed. No retries permitted until 2026-06-05 17:59:24.343144451 +0000 UTC m=+635.272193486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-59m2q" (UniqueName: "kubernetes.io/projected/53714237-5757-48b9-b4c3-132fd4f9151c-kube-api-access-59m2q") pod "kuadrant-operator-controller-manager-86878c769f-zqtbf" (UID: "53714237-5757-48b9-b4c3-132fd4f9151c") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-zqtbf" not found Jun 05 17:59:23.938317 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.938277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd824379-125d-42a6-ade0-ac7f8cfc017c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b2ps7\" (UID: \"fd824379-125d-42a6-ade0-ac7f8cfc017c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 17:59:23.938679 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.938650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdp54\" (UniqueName: \"kubernetes.io/projected/fd824379-125d-42a6-ade0-ac7f8cfc017c-kube-api-access-bdp54\") pod \"kuadrant-operator-controller-manager-86878c769f-b2ps7\" (UID: \"fd824379-125d-42a6-ade0-ac7f8cfc017c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 17:59:23.938838 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.938712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbd8v\" (UniqueName: \"kubernetes.io/projected/2ac9a209-cf10-4d57-9083-71b4a610b6e3-kube-api-access-qbd8v\") pod \"limitador-operator-controller-manager-859d7b78bd-gtp26\" (UID: \"2ac9a209-cf10-4d57-9083-71b4a610b6e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26" Jun 05 17:59:23.939047 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.939025 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd824379-125d-42a6-ade0-ac7f8cfc017c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b2ps7\" (UID: \"fd824379-125d-42a6-ade0-ac7f8cfc017c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 17:59:23.948521 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:23.948488 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdp54\" (UniqueName: \"kubernetes.io/projected/fd824379-125d-42a6-ade0-ac7f8cfc017c-kube-api-access-bdp54\") pod \"kuadrant-operator-controller-manager-86878c769f-b2ps7\" (UID: \"fd824379-125d-42a6-ade0-ac7f8cfc017c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 17:59:24.004528 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.004506 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:24.007585 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:24.007554 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:24.040225 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.040191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbd8v\" (UniqueName: \"kubernetes.io/projected/2ac9a209-cf10-4d57-9083-71b4a610b6e3-kube-api-access-qbd8v\") pod \"limitador-operator-controller-manager-859d7b78bd-gtp26\" (UID: \"2ac9a209-cf10-4d57-9083-71b4a610b6e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26" Jun 05 17:59:24.050129 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.050099 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbd8v\" (UniqueName: \"kubernetes.io/projected/2ac9a209-cf10-4d57-9083-71b4a610b6e3-kube-api-access-qbd8v\") pod \"limitador-operator-controller-manager-859d7b78bd-gtp26\" (UID: \"2ac9a209-cf10-4d57-9083-71b4a610b6e3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26" Jun 05 17:59:24.141545 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.141461 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvkqm\" (UniqueName: \"kubernetes.io/projected/d878dcb2-5ab8-4747-a05e-5882c048e524-kube-api-access-gvkqm\") pod \"d878dcb2-5ab8-4747-a05e-5882c048e524\" (UID: \"d878dcb2-5ab8-4747-a05e-5882c048e524\") " Jun 05 17:59:24.143700 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.143675 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d878dcb2-5ab8-4747-a05e-5882c048e524-kube-api-access-gvkqm" (OuterVolumeSpecName: "kube-api-access-gvkqm") pod "d878dcb2-5ab8-4747-a05e-5882c048e524" (UID: "d878dcb2-5ab8-4747-a05e-5882c048e524"). InnerVolumeSpecName "kube-api-access-gvkqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 17:59:24.158822 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.158793 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 17:59:24.164716 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.164690 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26" Jun 05 17:59:24.242670 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.242637 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvkqm\" (UniqueName: \"kubernetes.io/projected/d878dcb2-5ab8-4747-a05e-5882c048e524-kube-api-access-gvkqm\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:59:24.267703 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.267666 2579 generic.go:356] "Generic (PLEG): container finished" podID="d878dcb2-5ab8-4747-a05e-5882c048e524" containerID="48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd" exitCode=0 Jun 05 17:59:24.267858 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.267728 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:24.267858 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.267764 2579 scope.go:117] "RemoveContainer" containerID="48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd" Jun 05 17:59:24.267981 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.267955 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:24.270943 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:24.270905 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:24.273262 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:24.273231 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:24.275487 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:24.275442 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-zqtbf\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="53714237-5757-48b9-b4c3-132fd4f9151c" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:24.279872 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.279537 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:24.280086 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.280023 2579 scope.go:117] "RemoveContainer" containerID="48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd" Jun 05 17:59:24.280410 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:24.280383 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd\": container with ID starting with 48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd not found: ID does not exist" containerID="48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd" Jun 05 17:59:24.280496 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.280425 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd"} err="failed to get container status \"48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd\": rpc error: code = NotFound desc = could not find container \"48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd\": container with ID starting with 48da5928b1a45e8b7141983830ba5a4e0f258d2683696e81d9a5c4851da735cd not found: ID does not exist" Jun 05 17:59:24.282581 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:24.282477 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:24.284743 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:24.284717 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-zqtbf\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="53714237-5757-48b9-b4c3-132fd4f9151c" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:24.287101 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:24.287057 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:24.289379 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:24.289350 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-zqtbf\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="53714237-5757-48b9-b4c3-132fd4f9151c" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:24.333442 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:59:24.333406 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd824379_125d_42a6_ade0_ac7f8cfc017c.slice/crio-9da05cf1bc38674342b78b960d2098e73dac53993cad7a0b3e48210073dcacd9 WatchSource:0}: Error finding container 9da05cf1bc38674342b78b960d2098e73dac53993cad7a0b3e48210073dcacd9: Status 404 returned error can't find the container with id 9da05cf1bc38674342b78b960d2098e73dac53993cad7a0b3e48210073dcacd9 Jun 05 17:59:24.335776 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.335754 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7"] Jun 05 17:59:24.342623 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.342589 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26"] Jun 05 17:59:24.343364 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.343344 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53714237-5757-48b9-b4c3-132fd4f9151c-extensions-socket-volume\") pod \"53714237-5757-48b9-b4c3-132fd4f9151c\" (UID: \"53714237-5757-48b9-b4c3-132fd4f9151c\") " Jun 05 17:59:24.343511 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.343499 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59m2q\" (UniqueName: \"kubernetes.io/projected/53714237-5757-48b9-b4c3-132fd4f9151c-kube-api-access-59m2q\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:59:24.343581 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.343559 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53714237-5757-48b9-b4c3-132fd4f9151c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "53714237-5757-48b9-b4c3-132fd4f9151c" (UID: "53714237-5757-48b9-b4c3-132fd4f9151c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 17:59:24.344143 ip-10-0-139-141 kubenswrapper[2579]: W0605 17:59:24.344127 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac9a209_cf10_4d57_9083_71b4a610b6e3.slice/crio-3b550ed150ae04a0032850d4c7344e2bea7b65d00cb60573af481c8cedcd4944 WatchSource:0}: Error finding container 3b550ed150ae04a0032850d4c7344e2bea7b65d00cb60573af481c8cedcd4944: Status 404 returned error can't find the container with id 3b550ed150ae04a0032850d4c7344e2bea7b65d00cb60573af481c8cedcd4944 Jun 05 17:59:24.444751 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:24.444713 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53714237-5757-48b9-b4c3-132fd4f9151c-extensions-socket-volume\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 17:59:25.277541 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:25.277499 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26" event={"ID":"2ac9a209-cf10-4d57-9083-71b4a610b6e3","Type":"ContainerStarted","Data":"c456afb3011012fdb10f513d5d7c34c3957baf6657bd5f808e1caa9a8a48caf5"} Jun 05 17:59:25.278012 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:25.277557 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26" event={"ID":"2ac9a209-cf10-4d57-9083-71b4a610b6e3","Type":"ContainerStarted","Data":"3b550ed150ae04a0032850d4c7344e2bea7b65d00cb60573af481c8cedcd4944"} Jun 05 17:59:25.278012 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:25.277637 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26" Jun 05 17:59:25.278975 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:25.278958 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:25.279106 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:25.278982 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" event={"ID":"fd824379-125d-42a6-ade0-ac7f8cfc017c","Type":"ContainerStarted","Data":"9da05cf1bc38674342b78b960d2098e73dac53993cad7a0b3e48210073dcacd9"} Jun 05 17:59:25.280658 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:25.280624 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:25.283245 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:25.283215 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-zqtbf\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="53714237-5757-48b9-b4c3-132fd4f9151c" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:25.305504 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:25.305442 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26" podStartSLOduration=2.305422745 podStartE2EDuration="2.305422745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:59:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:59:25.30487884 +0000 UTC m=+636.233927882" watchObservedRunningTime="2026-06-05 17:59:25.305422745 +0000 UTC m=+636.234471785" Jun 05 17:59:25.307451 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:25.307300 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2bzr9\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2bzr9" Jun 05 17:59:25.310654 ip-10-0-139-141 kubenswrapper[2579]: E0605 17:59:25.310595 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-zqtbf\" is forbidden: User \"system:node:ip-10-0-139-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-141.ec2.internal' and this object" podUID="53714237-5757-48b9-b4c3-132fd4f9151c" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zqtbf" Jun 05 17:59:25.535099 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:25.535018 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53714237-5757-48b9-b4c3-132fd4f9151c" path="/var/lib/kubelet/pods/53714237-5757-48b9-b4c3-132fd4f9151c/volumes" Jun 05 17:59:25.535251 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:25.535240 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d878dcb2-5ab8-4747-a05e-5882c048e524" path="/var/lib/kubelet/pods/d878dcb2-5ab8-4747-a05e-5882c048e524/volumes" Jun 05 17:59:26.224640 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:26.224585 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-748cj" Jun 05 17:59:27.328794 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:27.328746 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:27.426571 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:27.426537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:27.529000 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:27.528960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:29.304584 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:29.304551 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" event={"ID":"fd824379-125d-42a6-ade0-ac7f8cfc017c","Type":"ContainerStarted","Data":"e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959"} Jun 05 17:59:29.304992 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:29.304667 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 17:59:29.328282 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:29.328230 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" podStartSLOduration=2.355377874 podStartE2EDuration="6.328215634s" totalImagesPullingTime="3.97283776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 17:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 17:59:29.324703348 +0000 UTC m=+640.253752407" watchObservedRunningTime="2026-06-05 17:59:29.328215634 +0000 UTC m=+640.257264672" Jun 05 17:59:29.765358 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:29.765322 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:29.856037 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:29.856005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:34.075625 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:34.075572 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:34.176728 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:34.176696 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:36.286921 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:36.286890 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gtp26" Jun 05 17:59:36.326988 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:36.326953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:36.426313 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:36.426282 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:40.312978 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:40.312951 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 17:59:45.046480 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:45.046436 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:45.147285 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:45.147253 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:47.500191 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:47.500153 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:47.562394 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:47.562361 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:48.195481 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:48.195448 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:51.844980 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:51.844949 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:51.940619 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:51.940563 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:55.658131 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:55.658103 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:55.762952 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:55.762914 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:56.656935 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:56.656902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:56.754421 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:56.754387 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 17:59:57.370143 ip-10-0-139-141 kubenswrapper[2579]: I0605 17:59:57.370107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:00.383254 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:00.383211 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:00.972367 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:00.972332 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:01.060090 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:01.060060 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:01.157049 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:01.157008 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:01.800399 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:01.800366 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:01.861400 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:01.861362 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:05.641172 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:05.641141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:05.740253 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:05.740219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:05.796338 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:05.796307 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:08.096714 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:08.096683 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:08.195881 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:08.195841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:21.958332 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:21.958284 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:31.520099 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:31.520055 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:31.610549 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:31.610501 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:31.749003 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:31.748970 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:55.572871 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:55.572835 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:55.673057 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:55.673023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:00:55.979629 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:55.979535 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 18:00:55.983004 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:55.982988 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 18:00:55.986206 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:55.986183 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 18:00:55.986386 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:55.986372 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 18:00:55.987584 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:55.987567 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 18:00:55.987707 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:55.987675 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-f28z6\"" Jun 05 18:00:55.993417 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:55.993394 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 18:00:56.076144 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:56.076113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxnlh\" (UniqueName: \"kubernetes.io/projected/90ed4506-ae9a-4b33-8be5-cfc4e8110ecd-kube-api-access-qxnlh\") pod \"maas-keycloak-0\" (UID: \"90ed4506-ae9a-4b33-8be5-cfc4e8110ecd\") " pod="keycloak-system/maas-keycloak-0" Jun 05 18:00:56.177136 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:56.177083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxnlh\" (UniqueName: \"kubernetes.io/projected/90ed4506-ae9a-4b33-8be5-cfc4e8110ecd-kube-api-access-qxnlh\") pod \"maas-keycloak-0\" (UID: \"90ed4506-ae9a-4b33-8be5-cfc4e8110ecd\") " pod="keycloak-system/maas-keycloak-0" Jun 05 18:00:56.186647 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:56.186617 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxnlh\" (UniqueName: \"kubernetes.io/projected/90ed4506-ae9a-4b33-8be5-cfc4e8110ecd-kube-api-access-qxnlh\") pod \"maas-keycloak-0\" (UID: \"90ed4506-ae9a-4b33-8be5-cfc4e8110ecd\") " pod="keycloak-system/maas-keycloak-0" Jun 05 18:00:56.293855 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:56.293820 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 18:00:56.431122 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:56.431093 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 18:00:56.433129 ip-10-0-139-141 kubenswrapper[2579]: W0605 18:00:56.433085 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ed4506_ae9a_4b33_8be5_cfc4e8110ecd.slice/crio-8e4f3c59d1b77da10d8902b4b85a5bda79a1196e9fff290e8d1ca0e7f35960fa WatchSource:0}: Error finding container 8e4f3c59d1b77da10d8902b4b85a5bda79a1196e9fff290e8d1ca0e7f35960fa: Status 404 returned error can't find the container with id 8e4f3c59d1b77da10d8902b4b85a5bda79a1196e9fff290e8d1ca0e7f35960fa Jun 05 18:00:56.434417 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:56.434401 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 18:00:56.794009 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:00:56.793978 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"90ed4506-ae9a-4b33-8be5-cfc4e8110ecd","Type":"ContainerStarted","Data":"8e4f3c59d1b77da10d8902b4b85a5bda79a1196e9fff290e8d1ca0e7f35960fa"} Jun 05 18:01:01.832092 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:01.832042 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"90ed4506-ae9a-4b33-8be5-cfc4e8110ecd","Type":"ContainerStarted","Data":"af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a"} Jun 05 18:01:01.853700 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:01.853638 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.673370426 podStartE2EDuration="6.853579669s" totalImagesPullingTime="5.180209243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:01:01.853491089 +0000 UTC m=+732.782540149" watchObservedRunningTime="2026-06-05 18:01:01.853579669 +0000 UTC m=+732.782628700" Jun 05 18:01:02.294745 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:02.294701 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 18:01:02.296423 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:02.296386 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:03.294334 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:03.294275 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:04.295023 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:04.294972 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:05.294955 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:05.294901 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:06.295043 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:06.294997 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 18:01:06.295581 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:06.295265 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:07.294978 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:07.294933 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:08.294530 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:08.294470 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:09.294431 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:09.294387 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:10.294461 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:10.294411 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:11.294580 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:11.294529 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:12.294662 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:12.294590 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:13.294371 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:13.294324 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:14.294408 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:14.294357 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.49:9000/health/started\": dial tcp 10.132.0.49:9000: connect: connection refused" Jun 05 18:01:15.394203 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:15.394161 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 18:01:15.410740 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:15.410700 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 18:01:16.047568 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:16.047518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:01:16.108964 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:16.108897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:01:25.400221 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:25.400188 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 18:01:26.033146 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:26.033101 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:01:26.361722 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:26.361596 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:01:32.017543 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:32.017506 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:01:32.118573 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:32.118540 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:01:32.210754 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:32.210723 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:01:32.272468 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:32.272392 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:01:35.626923 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:35.626889 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:01:35.725790 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:01:35.725757 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:02:06.090062 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:06.090020 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:02:06.646426 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:06.646388 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:02:06.745315 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:06.745283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:02:07.405476 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:07.405444 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:02:20.142862 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:20.142820 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 18:02:20.143351 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:20.143072 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" containerID="cri-o://af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a" gracePeriod=30 Jun 05 18:02:22.198548 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.198523 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:22.280994 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.280959 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxnlh\" (UniqueName: \"kubernetes.io/projected/90ed4506-ae9a-4b33-8be5-cfc4e8110ecd-kube-api-access-qxnlh\") pod \"90ed4506-ae9a-4b33-8be5-cfc4e8110ecd\" (UID: \"90ed4506-ae9a-4b33-8be5-cfc4e8110ecd\") " Jun 05 18:02:22.283167 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.283134 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ed4506-ae9a-4b33-8be5-cfc4e8110ecd-kube-api-access-qxnlh" (OuterVolumeSpecName: "kube-api-access-qxnlh") pod "90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" (UID: "90ed4506-ae9a-4b33-8be5-cfc4e8110ecd"). InnerVolumeSpecName "kube-api-access-qxnlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:02:22.328015 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.327931 2579 generic.go:356] "Generic (PLEG): container finished" podID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerID="af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a" exitCode=143 Jun 05 18:02:22.328015 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.327974 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:22.328237 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.328018 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"90ed4506-ae9a-4b33-8be5-cfc4e8110ecd","Type":"ContainerDied","Data":"af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a"} Jun 05 18:02:22.328237 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.328103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"90ed4506-ae9a-4b33-8be5-cfc4e8110ecd","Type":"ContainerDied","Data":"8e4f3c59d1b77da10d8902b4b85a5bda79a1196e9fff290e8d1ca0e7f35960fa"} Jun 05 18:02:22.328237 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.328132 2579 scope.go:117] "RemoveContainer" containerID="af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a" Jun 05 18:02:22.339115 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.339098 2579 scope.go:117] "RemoveContainer" containerID="af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a" Jun 05 18:02:22.339396 ip-10-0-139-141 kubenswrapper[2579]: E0605 18:02:22.339378 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a\": container with ID starting with af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a not found: ID does not exist" containerID="af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a" Jun 05 18:02:22.339446 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.339405 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a"} err="failed to get container status \"af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a\": rpc error: code = NotFound desc = could not find container \"af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a\": container with ID starting with af4ec05ef32bdf51a0d2f194d78761077f0bd813b5e6bbd78a83cb8726bad77a not found: ID does not exist" Jun 05 18:02:22.353582 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.353558 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 18:02:22.355640 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.355616 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 18:02:22.377069 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.377042 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 18:02:22.377512 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.377494 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" Jun 05 18:02:22.377512 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.377512 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" Jun 05 18:02:22.377651 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.377587 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" containerName="keycloak" Jun 05 18:02:22.380492 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.380478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:22.381817 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.381796 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxnlh\" (UniqueName: \"kubernetes.io/projected/90ed4506-ae9a-4b33-8be5-cfc4e8110ecd-kube-api-access-qxnlh\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 18:02:22.383574 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.383556 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 18:02:22.383744 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.383721 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 18:02:22.383892 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.383804 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 05 18:02:22.383892 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.383791 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 18:02:22.384041 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.383942 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-f28z6\"" Jun 05 18:02:22.393687 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.393664 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 18:02:22.482633 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.482587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sljmt\" (UniqueName: \"kubernetes.io/projected/55fec815-7a5e-44e8-ad57-77db3f0d6803-kube-api-access-sljmt\") pod \"maas-keycloak-0\" (UID: \"55fec815-7a5e-44e8-ad57-77db3f0d6803\") " pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:22.482818 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.482659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/55fec815-7a5e-44e8-ad57-77db3f0d6803-test-realms\") pod \"maas-keycloak-0\" (UID: \"55fec815-7a5e-44e8-ad57-77db3f0d6803\") " pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:22.584113 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.584024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/55fec815-7a5e-44e8-ad57-77db3f0d6803-test-realms\") pod \"maas-keycloak-0\" (UID: \"55fec815-7a5e-44e8-ad57-77db3f0d6803\") " pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:22.584113 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.584102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sljmt\" (UniqueName: \"kubernetes.io/projected/55fec815-7a5e-44e8-ad57-77db3f0d6803-kube-api-access-sljmt\") pod \"maas-keycloak-0\" (UID: \"55fec815-7a5e-44e8-ad57-77db3f0d6803\") " pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:22.584818 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.584794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/55fec815-7a5e-44e8-ad57-77db3f0d6803-test-realms\") pod \"maas-keycloak-0\" (UID: \"55fec815-7a5e-44e8-ad57-77db3f0d6803\") " pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:22.593512 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.593486 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sljmt\" (UniqueName: \"kubernetes.io/projected/55fec815-7a5e-44e8-ad57-77db3f0d6803-kube-api-access-sljmt\") pod \"maas-keycloak-0\" (UID: \"55fec815-7a5e-44e8-ad57-77db3f0d6803\") " pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:22.691173 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.691134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:22.831986 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:22.831960 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 18:02:23.338688 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:23.338648 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"55fec815-7a5e-44e8-ad57-77db3f0d6803","Type":"ContainerStarted","Data":"9b07c244b79f37f48a66f5207e068a1898a3145d1a36f1f74c0d1350a6787a42"} Jun 05 18:02:23.339225 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:23.339197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"55fec815-7a5e-44e8-ad57-77db3f0d6803","Type":"ContainerStarted","Data":"ddabf1d4826da8daf3967e1ff758501a1a15f2b3ee8399b2e7d9acae592f999a"} Jun 05 18:02:23.361719 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:23.361661 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.06622699 podStartE2EDuration="1.361643945s" totalImagesPullingTime="295.416955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:02:23.359308985 +0000 UTC m=+814.288358043" watchObservedRunningTime="2026-06-05 18:02:23.361643945 +0000 UTC m=+814.290692984" Jun 05 18:02:23.535260 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:23.535221 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90ed4506-ae9a-4b33-8be5-cfc4e8110ecd" path="/var/lib/kubelet/pods/90ed4506-ae9a-4b33-8be5-cfc4e8110ecd/volumes" Jun 05 18:02:23.691671 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:23.691639 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:23.693335 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:23.693300 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:24.691860 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:24.691806 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:25.691579 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:25.691529 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:26.692331 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:26.692271 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:27.692679 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:27.692626 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:28.692564 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:28.692507 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:29.691875 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:29.691823 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:30.692113 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:30.692066 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:31.691809 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:31.691765 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:32.692092 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:32.692034 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:32.692636 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:32.692510 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:33.691859 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:33.691811 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:34.691931 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:34.691881 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:35.692435 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:35.692394 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 05 18:02:36.791939 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:36.791898 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 18:02:36.810153 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:36.810105 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 18:02:44.676428 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:44.676367 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:02:44.776824 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:44.776776 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:02:46.796147 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:46.796088 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="55fec815-7a5e-44e8-ad57-77db3f0d6803" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 18:02:56.797687 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:02:56.797640 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 18:03:09.036934 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:09.036888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:03:10.501263 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:10.501233 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:03:15.077730 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.077668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:03:15.178711 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.178680 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:03:15.700895 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.700860 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn"] Jun 05 18:03:15.703705 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.703686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.708226 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.708201 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zmfcl\"" Jun 05 18:03:15.708354 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.708206 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 18:03:15.708354 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.708236 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 18:03:15.708354 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.708206 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 05 18:03:15.715801 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.715774 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn"] Jun 05 18:03:15.723859 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.723828 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:03:15.896543 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.896503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.896752 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.896635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddm7r\" (UniqueName: \"kubernetes.io/projected/a6c3e4bb-5797-4504-8d5e-93798ed757ca-kube-api-access-ddm7r\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.896752 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.896680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.896752 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.896712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.896888 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.896752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c3e4bb-5797-4504-8d5e-93798ed757ca-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.896888 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.896777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.998186 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.998157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddm7r\" (UniqueName: \"kubernetes.io/projected/a6c3e4bb-5797-4504-8d5e-93798ed757ca-kube-api-access-ddm7r\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.998370 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.998193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.998370 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.998230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.998370 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.998267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c3e4bb-5797-4504-8d5e-93798ed757ca-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.998370 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.998302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.998370 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.998333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.998655 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.998628 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.998718 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.998696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:15.998755 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:15.998717 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:16.000684 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:16.000657 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c3e4bb-5797-4504-8d5e-93798ed757ca-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:16.000922 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:16.000904 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c3e4bb-5797-4504-8d5e-93798ed757ca-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:16.007370 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:16.007344 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddm7r\" (UniqueName: \"kubernetes.io/projected/a6c3e4bb-5797-4504-8d5e-93798ed757ca-kube-api-access-ddm7r\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn\" (UID: \"a6c3e4bb-5797-4504-8d5e-93798ed757ca\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:16.014925 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:16.014901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:16.166392 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:16.166351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn"] Jun 05 18:03:16.167575 ip-10-0-139-141 kubenswrapper[2579]: W0605 18:03:16.167548 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c3e4bb_5797_4504_8d5e_93798ed757ca.slice/crio-d1e84e3c8192687403e8560edf8a516c09e904d8d8df480824ffc77ab3015f8f WatchSource:0}: Error finding container d1e84e3c8192687403e8560edf8a516c09e904d8d8df480824ffc77ab3015f8f: Status 404 returned error can't find the container with id d1e84e3c8192687403e8560edf8a516c09e904d8d8df480824ffc77ab3015f8f Jun 05 18:03:16.688684 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:16.688589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" event={"ID":"a6c3e4bb-5797-4504-8d5e-93798ed757ca","Type":"ContainerStarted","Data":"d1e84e3c8192687403e8560edf8a516c09e904d8d8df480824ffc77ab3015f8f"} Jun 05 18:03:20.715844 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:20.715744 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" event={"ID":"a6c3e4bb-5797-4504-8d5e-93798ed757ca","Type":"ContainerStarted","Data":"9626cf02105f46007f598bd038d150c71eb96f3e7370955f9d8fa31ec0b428d9"} Jun 05 18:03:22.727965 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.727926 2579 generic.go:356] "Generic (PLEG): container finished" podID="a6c3e4bb-5797-4504-8d5e-93798ed757ca" containerID="9626cf02105f46007f598bd038d150c71eb96f3e7370955f9d8fa31ec0b428d9" exitCode=0 Jun 05 18:03:22.728388 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.728000 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" event={"ID":"a6c3e4bb-5797-4504-8d5e-93798ed757ca","Type":"ContainerDied","Data":"9626cf02105f46007f598bd038d150c71eb96f3e7370955f9d8fa31ec0b428d9"} Jun 05 18:03:22.890900 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.890859 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj"] Jun 05 18:03:22.893645 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.893618 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:22.896727 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.896702 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 05 18:03:22.906157 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.906133 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj"] Jun 05 18:03:22.918119 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.918095 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:03:22.956464 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.956425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:22.956677 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.956657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:22.956866 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.956836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1fe4661-3c81-4083-b13d-8dd9717d09e7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:22.957065 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.957042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:22.957472 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.957181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrczz\" (UniqueName: \"kubernetes.io/projected/a1fe4661-3c81-4083-b13d-8dd9717d09e7-kube-api-access-vrczz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:22.957472 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:22.957248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.058107 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.058069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.058293 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.058146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.058293 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.058183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1fe4661-3c81-4083-b13d-8dd9717d09e7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.058293 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.058275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.058475 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.058305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrczz\" (UniqueName: \"kubernetes.io/projected/a1fe4661-3c81-4083-b13d-8dd9717d09e7-kube-api-access-vrczz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.058475 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.058334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.058582 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.058523 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.058704 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.058676 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.060457 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.060432 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.061354 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.061329 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1fe4661-3c81-4083-b13d-8dd9717d09e7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.062442 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.062418 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1fe4661-3c81-4083-b13d-8dd9717d09e7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.070464 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.070435 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrczz\" (UniqueName: \"kubernetes.io/projected/a1fe4661-3c81-4083-b13d-8dd9717d09e7-kube-api-access-vrczz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7bdcj\" (UID: \"a1fe4661-3c81-4083-b13d-8dd9717d09e7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.205285 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.205240 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:03:23.596441 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:23.596406 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj"] Jun 05 18:03:23.858730 ip-10-0-139-141 kubenswrapper[2579]: W0605 18:03:23.858696 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1fe4661_3c81_4083_b13d_8dd9717d09e7.slice/crio-911be3dcef1fbc5a92bd7175944ba6e851e9f4e34214dde2cc2cc059f5cbf77c WatchSource:0}: Error finding container 911be3dcef1fbc5a92bd7175944ba6e851e9f4e34214dde2cc2cc059f5cbf77c: Status 404 returned error can't find the container with id 911be3dcef1fbc5a92bd7175944ba6e851e9f4e34214dde2cc2cc059f5cbf77c Jun 05 18:03:24.742053 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:24.742009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" event={"ID":"a6c3e4bb-5797-4504-8d5e-93798ed757ca","Type":"ContainerStarted","Data":"f06ac8bf5a031ea0b28ef74224923005fa3bb5c32df820d450f9714177c15ebc"} Jun 05 18:03:24.743435 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:24.743411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" event={"ID":"a1fe4661-3c81-4083-b13d-8dd9717d09e7","Type":"ContainerStarted","Data":"36b3dcdba524a530eac45de046719c53c3ebc5138a1c9460ee50357a035fd097"} Jun 05 18:03:24.743565 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:24.743450 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" event={"ID":"a1fe4661-3c81-4083-b13d-8dd9717d09e7","Type":"ContainerStarted","Data":"911be3dcef1fbc5a92bd7175944ba6e851e9f4e34214dde2cc2cc059f5cbf77c"} Jun 05 18:03:24.763874 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:24.763822 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" podStartSLOduration=2.919614239 podStartE2EDuration="9.7638064s" totalImagesPullingTime="5.277785482s" totalInitContainerRuntime="1.566406679s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:03:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:03:24.761595193 +0000 UTC m=+875.690644258" watchObservedRunningTime="2026-06-05 18:03:24.7638064 +0000 UTC m=+875.692855438" Jun 05 18:03:26.015805 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:26.015766 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:26.016193 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:26.015838 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:26.028635 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:26.028584 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:26.766557 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:26.766530 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn" Jun 05 18:03:44.999062 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:44.998977 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt"] Jun 05 18:03:45.028070 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.028037 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt"] Jun 05 18:03:45.028240 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.028160 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.031283 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.031255 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 05 18:03:45.095378 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.095350 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:03:45.169724 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.169687 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.169897 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.169734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.169897 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.169753 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.169897 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.169777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bzzb\" (UniqueName: \"kubernetes.io/projected/509d07eb-49e9-4fad-8861-e9a853506f5b-kube-api-access-9bzzb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.169897 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.169869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/509d07eb-49e9-4fad-8861-e9a853506f5b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.170052 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.169902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.271324 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.271230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.271324 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.271274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.271324 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.271295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.271636 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.271347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzzb\" (UniqueName: \"kubernetes.io/projected/509d07eb-49e9-4fad-8861-e9a853506f5b-kube-api-access-9bzzb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.271636 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.271422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/509d07eb-49e9-4fad-8861-e9a853506f5b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.271636 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.271458 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.271803 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.271718 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.271872 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.271850 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.271936 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.271863 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.273856 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.273835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/509d07eb-49e9-4fad-8861-e9a853506f5b-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.274163 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.274143 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/509d07eb-49e9-4fad-8861-e9a853506f5b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.279854 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.279832 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bzzb\" (UniqueName: \"kubernetes.io/projected/509d07eb-49e9-4fad-8861-e9a853506f5b-kube-api-access-9bzzb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt\" (UID: \"509d07eb-49e9-4fad-8861-e9a853506f5b\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.340855 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.340821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:45.488080 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.488056 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt"] Jun 05 18:03:45.489595 ip-10-0-139-141 kubenswrapper[2579]: W0605 18:03:45.489562 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509d07eb_49e9_4fad_8861_e9a853506f5b.slice/crio-6fbb42502587bccd0cbc5f9ce8f07b624897bf1a8b41347e3c4cbad999716865 WatchSource:0}: Error finding container 6fbb42502587bccd0cbc5f9ce8f07b624897bf1a8b41347e3c4cbad999716865: Status 404 returned error can't find the container with id 6fbb42502587bccd0cbc5f9ce8f07b624897bf1a8b41347e3c4cbad999716865 Jun 05 18:03:45.867307 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.867209 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" event={"ID":"509d07eb-49e9-4fad-8861-e9a853506f5b","Type":"ContainerStarted","Data":"ca11bdd161a751ba49ae6d181b94efb0cf32e72d9bb5648d49e684d94e9e2f42"} Jun 05 18:03:45.867307 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:45.867284 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" event={"ID":"509d07eb-49e9-4fad-8861-e9a853506f5b","Type":"ContainerStarted","Data":"6fbb42502587bccd0cbc5f9ce8f07b624897bf1a8b41347e3c4cbad999716865"} Jun 05 18:03:47.880273 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:47.880235 2579 generic.go:356] "Generic (PLEG): container finished" podID="509d07eb-49e9-4fad-8861-e9a853506f5b" containerID="ca11bdd161a751ba49ae6d181b94efb0cf32e72d9bb5648d49e684d94e9e2f42" exitCode=0 Jun 05 18:03:47.880764 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:47.880311 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" event={"ID":"509d07eb-49e9-4fad-8861-e9a853506f5b","Type":"ContainerDied","Data":"ca11bdd161a751ba49ae6d181b94efb0cf32e72d9bb5648d49e684d94e9e2f42"} Jun 05 18:03:48.888721 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:48.888688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" event={"ID":"509d07eb-49e9-4fad-8861-e9a853506f5b","Type":"ContainerStarted","Data":"d3608059a38683bb791da4c46141e760e876a747415fe110cec24822600617c3"} Jun 05 18:03:48.910980 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:48.910920 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" podStartSLOduration=2.966699434 podStartE2EDuration="4.910904955s" totalImagesPullingTime="314.231233ms" totalInitContainerRuntime="1.629974288s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:03:48.909256754 +0000 UTC m=+899.838305793" watchObservedRunningTime="2026-06-05 18:03:48.910904955 +0000 UTC m=+899.839953994" Jun 05 18:03:49.561210 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:49.561180 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:03:49.563634 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:49.563588 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:03:55.001188 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.001156 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj"] Jun 05 18:03:55.005291 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.005275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.010974 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.010954 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 05 18:03:55.017257 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.017235 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj"] Jun 05 18:03:55.032293 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.032266 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:03:55.073472 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.073434 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.073472 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.073475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.073669 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.073539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w44vb\" (UniqueName: \"kubernetes.io/projected/7cb31999-db83-4980-a4e7-4a0d194dd433-kube-api-access-w44vb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.073669 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.073634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cb31999-db83-4980-a4e7-4a0d194dd433-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.073783 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.073671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.073783 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.073760 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.175121 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.175084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cb31999-db83-4980-a4e7-4a0d194dd433-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.175410 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.175139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.175410 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.175197 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.175410 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.175243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.175410 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.175271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.175410 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.175309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w44vb\" (UniqueName: \"kubernetes.io/projected/7cb31999-db83-4980-a4e7-4a0d194dd433-kube-api-access-w44vb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.175852 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.175791 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.176067 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.176038 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.176181 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.176123 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.178082 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.178053 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cb31999-db83-4980-a4e7-4a0d194dd433-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.178716 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.178695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cb31999-db83-4980-a4e7-4a0d194dd433-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.185007 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.184989 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w44vb\" (UniqueName: \"kubernetes.io/projected/7cb31999-db83-4980-a4e7-4a0d194dd433-kube-api-access-w44vb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj\" (UID: \"7cb31999-db83-4980-a4e7-4a0d194dd433\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.316536 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.316390 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:03:55.341732 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.341701 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:55.341860 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.341775 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:55.354597 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.354572 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:55.465899 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.465875 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj"] Jun 05 18:03:55.467965 ip-10-0-139-141 kubenswrapper[2579]: W0605 18:03:55.467936 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb31999_db83_4980_a4e7_4a0d194dd433.slice/crio-0109ee67b10a07500000b62c7ab7bca8d5e3f5d1f90b2d38af248b5512a1ec9d WatchSource:0}: Error finding container 0109ee67b10a07500000b62c7ab7bca8d5e3f5d1f90b2d38af248b5512a1ec9d: Status 404 returned error can't find the container with id 0109ee67b10a07500000b62c7ab7bca8d5e3f5d1f90b2d38af248b5512a1ec9d Jun 05 18:03:55.928893 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.928766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" event={"ID":"7cb31999-db83-4980-a4e7-4a0d194dd433","Type":"ContainerStarted","Data":"a87fabd5c48a5274d65752a7cc9dbc4154374824b865967e54b85031d54d7e25"} Jun 05 18:03:55.928893 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.928852 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" event={"ID":"7cb31999-db83-4980-a4e7-4a0d194dd433","Type":"ContainerStarted","Data":"0109ee67b10a07500000b62c7ab7bca8d5e3f5d1f90b2d38af248b5512a1ec9d"} Jun 05 18:03:55.941138 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:55.941110 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt" Jun 05 18:03:56.936574 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:56.936536 2579 generic.go:356] "Generic (PLEG): container finished" podID="7cb31999-db83-4980-a4e7-4a0d194dd433" containerID="a87fabd5c48a5274d65752a7cc9dbc4154374824b865967e54b85031d54d7e25" exitCode=0 Jun 05 18:03:56.936980 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:56.936633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" event={"ID":"7cb31999-db83-4980-a4e7-4a0d194dd433","Type":"ContainerDied","Data":"a87fabd5c48a5274d65752a7cc9dbc4154374824b865967e54b85031d54d7e25"} Jun 05 18:03:57.512631 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:57.512528 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:03:57.945380 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:57.945291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" event={"ID":"7cb31999-db83-4980-a4e7-4a0d194dd433","Type":"ContainerStarted","Data":"3c878fa186799f04275dd5e42ec9f97ba819835199bc61a7a11c1cbae255878e"} Jun 05 18:03:57.967661 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:03:57.967596 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" podStartSLOduration=2.300618246 podStartE2EDuration="3.967579087s" totalImagesPullingTime="325.074096ms" totalInitContainerRuntime="1.341886745s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:03:57.966632135 +0000 UTC m=+908.895681175" watchObservedRunningTime="2026-06-05 18:03:57.967579087 +0000 UTC m=+908.896628126" Jun 05 18:04:05.317048 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:05.317019 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:04:05.317434 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:05.317120 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:04:05.330356 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:05.330332 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:04:06.007837 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:06.007799 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj" Jun 05 18:04:13.897844 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.897811 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9"] Jun 05 18:04:13.901547 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.901526 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:13.904627 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.904590 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 05 18:04:13.918543 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.914341 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9"] Jun 05 18:04:13.935439 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.935390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:04:13.956756 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.956716 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:13.956944 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.956759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:13.956944 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.956887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4r8x\" (UniqueName: \"kubernetes.io/projected/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-kube-api-access-g4r8x\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:13.956944 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.956926 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:13.957119 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.956955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:13.957119 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:13.957047 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.058712 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.058661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.058924 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.058764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.058924 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.058797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.058924 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.058875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4r8x\" (UniqueName: \"kubernetes.io/projected/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-kube-api-access-g4r8x\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.059104 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.058925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.059104 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.058953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.059201 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.059181 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.059257 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.059238 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.059304 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.059290 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.061287 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.061255 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.061828 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.061806 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.068592 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.068568 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4r8x\" (UniqueName: \"kubernetes.io/projected/ae9e1946-07ae-4a7c-a888-b3bb5c94b702-kube-api-access-g4r8x\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j48q9\" (UID: \"ae9e1946-07ae-4a7c-a888-b3bb5c94b702\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.212887 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.212800 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:14.355112 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:14.355082 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9"] Jun 05 18:04:14.356673 ip-10-0-139-141 kubenswrapper[2579]: W0605 18:04:14.356642 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9e1946_07ae_4a7c_a888_b3bb5c94b702.slice/crio-d3751c963bdc4599b8215e7ba9c94b64f03c7f84a9c52fca1fd67d2284ae15ea WatchSource:0}: Error finding container d3751c963bdc4599b8215e7ba9c94b64f03c7f84a9c52fca1fd67d2284ae15ea: Status 404 returned error can't find the container with id d3751c963bdc4599b8215e7ba9c94b64f03c7f84a9c52fca1fd67d2284ae15ea Jun 05 18:04:15.052788 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:15.052749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" event={"ID":"ae9e1946-07ae-4a7c-a888-b3bb5c94b702","Type":"ContainerStarted","Data":"8527637e50a896b4f678d92669d92af92452b87860282f58ed2bf006aa1b8aaa"} Jun 05 18:04:15.052788 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:15.052793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" event={"ID":"ae9e1946-07ae-4a7c-a888-b3bb5c94b702","Type":"ContainerStarted","Data":"d3751c963bdc4599b8215e7ba9c94b64f03c7f84a9c52fca1fd67d2284ae15ea"} Jun 05 18:04:18.073272 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:18.073232 2579 generic.go:356] "Generic (PLEG): container finished" podID="ae9e1946-07ae-4a7c-a888-b3bb5c94b702" containerID="8527637e50a896b4f678d92669d92af92452b87860282f58ed2bf006aa1b8aaa" exitCode=0 Jun 05 18:04:18.073703 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:18.073301 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" event={"ID":"ae9e1946-07ae-4a7c-a888-b3bb5c94b702","Type":"ContainerDied","Data":"8527637e50a896b4f678d92669d92af92452b87860282f58ed2bf006aa1b8aaa"} Jun 05 18:04:18.074851 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:18.074830 2579 generic.go:356] "Generic (PLEG): container finished" podID="a1fe4661-3c81-4083-b13d-8dd9717d09e7" containerID="36b3dcdba524a530eac45de046719c53c3ebc5138a1c9460ee50357a035fd097" exitCode=0 Jun 05 18:04:18.074931 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:18.074908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" event={"ID":"a1fe4661-3c81-4083-b13d-8dd9717d09e7","Type":"ContainerDied","Data":"36b3dcdba524a530eac45de046719c53c3ebc5138a1c9460ee50357a035fd097"} Jun 05 18:04:19.082364 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:19.082327 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" event={"ID":"ae9e1946-07ae-4a7c-a888-b3bb5c94b702","Type":"ContainerStarted","Data":"b37b75785aca9f1785dc8c59c29f974dc708f6b04b00dd45f0af57689137c898"} Jun 05 18:04:19.084306 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:19.084272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" event={"ID":"a1fe4661-3c81-4083-b13d-8dd9717d09e7","Type":"ContainerStarted","Data":"525a146e86d1f1af72532285fa4444d733d6de10158c9e110cf5b817912ec296"} Jun 05 18:04:19.105748 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:19.105700 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" podStartSLOduration=2.707623167 podStartE2EDuration="6.105686273s" totalImagesPullingTime="240.817213ms" totalInitContainerRuntime="3.157245893s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:04:19.103471701 +0000 UTC m=+930.032520736" watchObservedRunningTime="2026-06-05 18:04:19.105686273 +0000 UTC m=+930.034735311" Jun 05 18:04:19.127130 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:19.127079 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" podStartSLOduration=3.159082782 podStartE2EDuration="57.127064258s" totalImagesPullingTime="280.522239ms" totalInitContainerRuntime="53.687459237s" isStatefulPod=false podCreationTimestamp="2026-06-05 18:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:04:19.125491257 +0000 UTC m=+930.054540308" watchObservedRunningTime="2026-06-05 18:04:19.127064258 +0000 UTC m=+930.056113296" Jun 05 18:04:23.205574 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:23.205530 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:04:23.205980 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:23.205618 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:04:23.218584 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:23.218558 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:04:24.123718 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:24.123688 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7bdcj" Jun 05 18:04:24.213839 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:24.213809 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:24.214256 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:24.213865 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:24.226434 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:24.226406 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:04:25.129465 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:04:25.129431 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j48q9" Jun 05 18:05:20.816899 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:05:20.816853 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:05:20.918572 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:05:20.918539 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:05:21.869099 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:05:21.869038 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:05:21.971173 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:05:21.971142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:06:08.037140 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:06:08.037109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:06:08.130985 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:06:08.130949 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:06:13.962756 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:06:13.962674 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:06:22.568958 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:06:22.568917 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:06:24.621782 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:06:24.621748 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:06:49.283593 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:06:49.283512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:06:51.228577 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:06:51.228508 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:07:31.242447 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:07:31.242408 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:07:31.334993 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:07:31.334956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:07:39.762404 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:07:39.762363 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:07:46.608502 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:07:46.608472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:07:46.741196 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:07:46.741163 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:08:18.848014 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:18.847976 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:08:20.124101 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:20.124055 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:08:42.814141 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:42.814103 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:08:49.327725 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:49.327685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:08:49.435883 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:49.435850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:08:49.538830 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:49.538793 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:08:49.598823 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:49.598737 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:08:49.605091 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:49.605055 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:08:49.698179 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:49.698144 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:08:49.794381 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:49.794333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:08:57.114628 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:57.114571 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:08:57.177839 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:08:57.177796 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:06.221814 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:06.221774 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:06.321381 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:06.321340 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:06.421664 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:06.421613 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:12.499673 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:12.499633 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:12.601724 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:12.601688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:20.670466 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:20.670433 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:20.769727 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:20.769693 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:20.872722 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:20.872685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:20.969672 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:20.969537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:37.375229 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:37.375193 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:37.485763 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:37.485730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:37.586750 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:37.586719 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:43.445826 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:43.445741 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:09:43.546384 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:09:43.546317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:10:03.808029 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:10:03.807993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:10:03.903329 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:10:03.903295 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:10:04.033681 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:10:04.033646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:10:09.775007 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:10:09.774971 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:10:09.891098 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:10:09.891056 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:10:09.979719 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:10:09.979672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:10:10.131274 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:10:10.131177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:10:15.960644 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:10:15.960614 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:10:16.025320 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:10:16.025283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:12:02.988498 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:12:02.988460 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:12:03.072943 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:12:03.072908 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:12:31.317482 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:12:31.317427 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:13:49.644397 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:13:49.644371 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:13:49.653248 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:13:49.653228 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:15:45.331707 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:15:45.331598 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:17:19.248238 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.248196 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7"] Jun 05 18:17:19.249053 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.248506 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" podUID="fd824379-125d-42a6-ade0-ac7f8cfc017c" containerName="manager" containerID="cri-o://e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959" gracePeriod=10 Jun 05 18:17:19.508212 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.508149 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 18:17:19.552433 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.552405 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdp54\" (UniqueName: \"kubernetes.io/projected/fd824379-125d-42a6-ade0-ac7f8cfc017c-kube-api-access-bdp54\") pod \"fd824379-125d-42a6-ade0-ac7f8cfc017c\" (UID: \"fd824379-125d-42a6-ade0-ac7f8cfc017c\") " Jun 05 18:17:19.552588 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.552453 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd824379-125d-42a6-ade0-ac7f8cfc017c-extensions-socket-volume\") pod \"fd824379-125d-42a6-ade0-ac7f8cfc017c\" (UID: \"fd824379-125d-42a6-ade0-ac7f8cfc017c\") " Jun 05 18:17:19.552912 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.552889 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd824379-125d-42a6-ade0-ac7f8cfc017c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd824379-125d-42a6-ade0-ac7f8cfc017c" (UID: "fd824379-125d-42a6-ade0-ac7f8cfc017c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 18:17:19.554581 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.554555 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd824379-125d-42a6-ade0-ac7f8cfc017c-kube-api-access-bdp54" (OuterVolumeSpecName: "kube-api-access-bdp54") pod "fd824379-125d-42a6-ade0-ac7f8cfc017c" (UID: "fd824379-125d-42a6-ade0-ac7f8cfc017c"). InnerVolumeSpecName "kube-api-access-bdp54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 18:17:19.654012 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.653974 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdp54\" (UniqueName: \"kubernetes.io/projected/fd824379-125d-42a6-ade0-ac7f8cfc017c-kube-api-access-bdp54\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 18:17:19.654012 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.654004 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd824379-125d-42a6-ade0-ac7f8cfc017c-extensions-socket-volume\") on node \"ip-10-0-139-141.ec2.internal\" DevicePath \"\"" Jun 05 18:17:19.705455 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.705416 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd824379-125d-42a6-ade0-ac7f8cfc017c" containerID="e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959" exitCode=0 Jun 05 18:17:19.705641 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.705470 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" Jun 05 18:17:19.705641 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.705504 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" event={"ID":"fd824379-125d-42a6-ade0-ac7f8cfc017c","Type":"ContainerDied","Data":"e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959"} Jun 05 18:17:19.705641 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.705562 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7" event={"ID":"fd824379-125d-42a6-ade0-ac7f8cfc017c","Type":"ContainerDied","Data":"9da05cf1bc38674342b78b960d2098e73dac53993cad7a0b3e48210073dcacd9"} Jun 05 18:17:19.705641 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.705589 2579 scope.go:117] "RemoveContainer" containerID="e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959" Jun 05 18:17:19.716012 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.715996 2579 scope.go:117] "RemoveContainer" containerID="e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959" Jun 05 18:17:19.716283 ip-10-0-139-141 kubenswrapper[2579]: E0605 18:17:19.716265 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959\": container with ID starting with e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959 not found: ID does not exist" containerID="e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959" Jun 05 18:17:19.716331 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.716299 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959"} err="failed to get container status \"e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959\": rpc error: code = NotFound desc = could not find container \"e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959\": container with ID starting with e1b17f3475ade5bc886af789deb38505001d22992026adb62caf11f192bcd959 not found: ID does not exist" Jun 05 18:17:19.732129 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.732101 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7"] Jun 05 18:17:19.737153 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:19.737127 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b2ps7"] Jun 05 18:17:21.534303 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:21.534271 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd824379-125d-42a6-ade0-ac7f8cfc017c" path="/var/lib/kubelet/pods/fd824379-125d-42a6-ade0-ac7f8cfc017c/volumes" Jun 05 18:17:22.435674 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:22.435644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:17:22.519937 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:17:22.519891 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:18:49.681384 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:18:49.681356 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:18:49.699689 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:18:49.699661 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:23:41.598828 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:23:41.598788 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:23:49.728729 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:23:49.728700 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:23:49.745155 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:23:49.745130 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:26:14.939092 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:26:14.939050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:26:15.028108 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:26:15.028069 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:26:17.760393 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:26:17.760358 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:27:10.878979 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:27:10.878936 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:27:16.224165 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:27:16.224134 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:27:40.477782 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:27:40.477696 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:27:53.519938 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:27:53.519903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:27:55.207818 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:27:55.207780 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:27:55.310848 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:27:55.310813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:27:55.419638 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:27:55.419529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:27:58.808336 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:27:58.808270 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:01.418126 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:01.418091 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:01.601404 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:01.601370 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:01.691936 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:01.691847 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:03.526808 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:03.526755 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:07.519353 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:07.519316 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:07.620477 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:07.620446 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:07.742350 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:07.742306 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:07.799917 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:07.799841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:07.904198 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:07.904159 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:07.997094 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:07.997041 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:11.142096 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:11.142066 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:13.979377 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:13.979349 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:15.128834 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:15.128779 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:15.219009 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:15.218953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:16.569044 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:16.569016 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:21.030813 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:21.030775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:21.131110 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:21.131073 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:32.847036 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:32.847004 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dc4bb59b5-2rvxw_5584ece9-f5e3-4d9e-aaf5-3270c9073cae/nginx/0.log" Jun 05 18:28:33.078214 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:33.078179 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-m9hjx_c990f2f8-44e1-4997-917d-6be7559ecd12/manager/0.log" Jun 05 18:28:33.194188 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:33.194101 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7652n_00fdd83b-f263-4312-b68e-218d5c5d26b9/manager/0.log" Jun 05 18:28:33.657428 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:33.657402 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-4mfcn_c0447a31-39f9-42e9-8b60-3d26b6be29b6/server/0.log" Jun 05 18:28:33.773192 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:33.773165 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hm8xl_c50a5142-8cb7-4a14-9624-328bf2dd43a0/manager/0.log" Jun 05 18:28:34.004043 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:34.004017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk_4567a37b-990d-4fc6-9cf8-f46fee86b5d6/copy-manifests/0.log" Jun 05 18:28:34.010641 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:34.010591 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk_4567a37b-990d-4fc6-9cf8-f46fee86b5d6/manager/0.log" Jun 05 18:28:35.681896 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:35.681866 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-748cj_bed4db7f-529a-4010-9a5d-25a81411b124/manager/0.log" Jun 05 18:28:36.231689 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:36.231655 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gtp26_2ac9a209-cf10-4d57-9083-71b4a610b6e3/manager/0.log" Jun 05 18:28:36.688255 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:36.688228 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nzh9j_84b0318c-29db-49a8-a8a1-367a7f6ad9f3/discovery/0.log" Jun 05 18:28:36.905494 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:36.905468 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcf5494b-c6h7s_2d1cb965-585a-464d-b700-26b81bee86b5/kube-auth-proxy/0.log" Jun 05 18:28:37.704144 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:37.704112 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn_a6c3e4bb-5797-4504-8d5e-93798ed757ca/storage-initializer/0.log" Jun 05 18:28:37.711670 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:37.711639 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-qdwqn_a6c3e4bb-5797-4504-8d5e-93798ed757ca/main/0.log" Jun 05 18:28:37.822993 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:37.822966 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-7bdcj_a1fe4661-3c81-4083-b13d-8dd9717d09e7/storage-initializer/0.log" Jun 05 18:28:37.831485 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:37.831460 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-7bdcj_a1fe4661-3c81-4083-b13d-8dd9717d09e7/main/0.log" Jun 05 18:28:37.938388 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:37.938360 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt_509d07eb-49e9-4fad-8861-e9a853506f5b/storage-initializer/0.log" Jun 05 18:28:37.946053 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:37.946032 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4vmvt_509d07eb-49e9-4fad-8861-e9a853506f5b/main/0.log" Jun 05 18:28:38.054179 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:38.054149 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj_7cb31999-db83-4980-a4e7-4a0d194dd433/main/0.log" Jun 05 18:28:38.061010 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:38.060987 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c4zjcj_7cb31999-db83-4980-a4e7-4a0d194dd433/storage-initializer/0.log" Jun 05 18:28:38.292026 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:38.291997 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-j48q9_ae9e1946-07ae-4a7c-a888-b3bb5c94b702/storage-initializer/0.log" Jun 05 18:28:38.299071 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:38.299049 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-j48q9_ae9e1946-07ae-4a7c-a888-b3bb5c94b702/main/0.log" Jun 05 18:28:41.949300 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:41.949267 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:42.016843 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:42.016812 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:28:45.050458 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:45.050426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q4k7f_3db2f471-0ac4-4179-8c24-5a8ef8c0fba0/global-pull-secret-syncer/0.log" Jun 05 18:28:45.093053 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:45.093024 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" Jun 05 18:28:45.196231 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:45.196202 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-141.ec2.internal_321216ca1922a00cb94cc622220890fa/haproxy/0.log" Jun 05 18:28:49.293244 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:49.293209 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-7gx2k_a8ed520c-d973-4137-b415-e4dd942aafd3/sail-operator/0.log" Jun 05 18:28:49.766129 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:49.766102 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:28:49.784015 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:49.783987 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:28:50.410739 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:50.410705 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-748cj_bed4db7f-529a-4010-9a5d-25a81411b124/manager/0.log" Jun 05 18:28:50.621653 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:50.621618 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gtp26_2ac9a209-cf10-4d57-9083-71b4a610b6e3/manager/0.log" Jun 05 18:28:52.335769 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.335742 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-cdwtn_023fec53-f003-4d05-a0bc-ee08bc365f6f/kube-state-metrics/0.log" Jun 05 18:28:52.361524 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.361495 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-cdwtn_023fec53-f003-4d05-a0bc-ee08bc365f6f/kube-rbac-proxy-main/0.log" Jun 05 18:28:52.381259 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.381231 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-cdwtn_023fec53-f003-4d05-a0bc-ee08bc365f6f/kube-rbac-proxy-self/0.log" Jun 05 18:28:52.409257 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.409230 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d59948bdd-klhmr_79965f85-651c-40b6-9e83-ad46ece8ebea/metrics-server/0.log" Jun 05 18:28:52.627812 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.627733 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-stgmm_d2fc76e6-f0e9-4abe-9073-979464b72ddc/node-exporter/0.log" Jun 05 18:28:52.648065 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.648041 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-stgmm_d2fc76e6-f0e9-4abe-9073-979464b72ddc/kube-rbac-proxy/0.log" Jun 05 18:28:52.674622 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.674575 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-stgmm_d2fc76e6-f0e9-4abe-9073-979464b72ddc/init-textfile/0.log" Jun 05 18:28:52.700564 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.700538 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hnb4n_22e6b257-c7d2-4593-90c7-0ff247d5207c/kube-rbac-proxy-main/0.log" Jun 05 18:28:52.722129 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.722106 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hnb4n_22e6b257-c7d2-4593-90c7-0ff247d5207c/kube-rbac-proxy-self/0.log" Jun 05 18:28:52.743590 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.743563 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hnb4n_22e6b257-c7d2-4593-90c7-0ff247d5207c/openshift-state-metrics/0.log" Jun 05 18:28:52.963632 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.963534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xgln5_a11869d5-2571-44d4-b7b6-163522f712e0/prometheus-operator/0.log" Jun 05 18:28:52.982730 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:52.982703 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xgln5_a11869d5-2571-44d4-b7b6-163522f712e0/kube-rbac-proxy/0.log" Jun 05 18:28:53.013646 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:53.013592 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-b28x6_801ea9b4-06bc-4318-b38b-42ef11599e7b/prometheus-operator-admission-webhook/0.log" Jun 05 18:28:54.660922 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:54.660895 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-srsjl_7d2181de-2880-4b30-bdc6-4c3c99f2d7ab/networking-console-plugin/0.log" Jun 05 18:28:55.287563 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:55.287533 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/1.log" Jun 05 18:28:55.294032 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:55.294014 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-59fjp_3e337b0e-8777-4211-b9b1-d295dd381440/console-operator/2.log" Jun 05 18:28:55.992527 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:55.992500 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-tmf5r_1c9ce558-fe57-4bd3-a057-ce76a0f10769/download-server/0.log" Jun 05 18:28:57.065310 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.065273 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc"] Jun 05 18:28:57.065784 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.065769 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd824379-125d-42a6-ade0-ac7f8cfc017c" containerName="manager" Jun 05 18:28:57.065836 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.065786 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd824379-125d-42a6-ade0-ac7f8cfc017c" containerName="manager" Jun 05 18:28:57.065872 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.065867 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd824379-125d-42a6-ade0-ac7f8cfc017c" containerName="manager" Jun 05 18:28:57.069174 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.069156 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.072201 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.072172 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm5wr\"/\"kube-root-ca.crt\"" Jun 05 18:28:57.072201 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.072191 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hm5wr\"/\"default-dockercfg-b572z\"" Jun 05 18:28:57.073475 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.073455 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm5wr\"/\"openshift-service-ca.crt\"" Jun 05 18:28:57.079020 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.078997 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc"] Jun 05 18:28:57.147690 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.147659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt5w5\" (UniqueName: \"kubernetes.io/projected/c9006737-d5f1-4d5a-96df-bea89161e108-kube-api-access-dt5w5\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.147876 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.147744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-proc\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.147876 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.147764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-podres\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.147876 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.147783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-lib-modules\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.148001 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.147933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-sys\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.248958 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.248925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-sys\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.249127 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.248974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5w5\" (UniqueName: \"kubernetes.io/projected/c9006737-d5f1-4d5a-96df-bea89161e108-kube-api-access-dt5w5\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.249127 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.249024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-proc\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.249127 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.249043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-podres\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.249127 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.249058 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-sys\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.249127 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.249076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-lib-modules\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.249127 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.249111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-proc\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.249381 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.249180 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-lib-modules\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.249381 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.249252 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c9006737-d5f1-4d5a-96df-bea89161e108-podres\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.257361 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.257334 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt5w5\" (UniqueName: \"kubernetes.io/projected/c9006737-d5f1-4d5a-96df-bea89161e108-kube-api-access-dt5w5\") pod \"perf-node-gather-daemonset-75dqc\" (UID: \"c9006737-d5f1-4d5a-96df-bea89161e108\") " pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.381313 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.381225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.518544 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.518515 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc"] Jun 05 18:28:57.523724 ip-10-0-139-141 kubenswrapper[2579]: W0605 18:28:57.523308 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc9006737_d5f1_4d5a_96df_bea89161e108.slice/crio-1df163b456b7e2dea3c24c0c9d21f28c1d06d916204939c6cccd703c2a8994b3 WatchSource:0}: Error finding container 1df163b456b7e2dea3c24c0c9d21f28c1d06d916204939c6cccd703c2a8994b3: Status 404 returned error can't find the container with id 1df163b456b7e2dea3c24c0c9d21f28c1d06d916204939c6cccd703c2a8994b3 Jun 05 18:28:57.748313 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.748276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" event={"ID":"c9006737-d5f1-4d5a-96df-bea89161e108","Type":"ContainerStarted","Data":"3a54e43ff096a3fc20845a76eb58defca74809b3e0e724d4d7bad630deb54da2"} Jun 05 18:28:57.748509 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.748340 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:28:57.748509 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.748360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" event={"ID":"c9006737-d5f1-4d5a-96df-bea89161e108","Type":"ContainerStarted","Data":"1df163b456b7e2dea3c24c0c9d21f28c1d06d916204939c6cccd703c2a8994b3"} Jun 05 18:28:57.765526 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.765478 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" podStartSLOduration=0.765463958 podStartE2EDuration="765.463958ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 18:28:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 18:28:57.764450433 +0000 UTC m=+2408.693499464" watchObservedRunningTime="2026-06-05 18:28:57.765463958 +0000 UTC m=+2408.694513043" Jun 05 18:28:57.984925 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:57.984897 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nmpjh_4fda909c-c3d9-4e7b-929a-4226cd4df135/dns/0.log" Jun 05 18:28:58.006726 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:58.006701 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nmpjh_4fda909c-c3d9-4e7b-929a-4226cd4df135/kube-rbac-proxy/0.log" Jun 05 18:28:58.098062 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:58.098032 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ptprv_d4a9dc88-1354-44a8-9e1b-b2333eb4aaef/dns-node-resolver/0.log" Jun 05 18:28:58.665784 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:58.665757 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fvqnk_601e5e3a-9aab-4925-8397-6e07d29e761f/node-ca/0.log" Jun 05 18:28:59.722861 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:59.722829 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nzh9j_84b0318c-29db-49a8-a8a1-367a7f6ad9f3/discovery/0.log" Jun 05 18:28:59.767098 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:28:59.767071 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcf5494b-c6h7s_2d1cb965-585a-464d-b700-26b81bee86b5/kube-auth-proxy/0.log" Jun 05 18:29:00.591762 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:00.591731 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fz9zj_ec5314a2-68ff-40b9-8eec-b90afd721fe8/serve-healthcheck-canary/0.log" Jun 05 18:29:01.127806 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:01.127779 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-5cgw9_6be1f372-fce4-4128-a3be-60be3efb2fb3/insights-operator/0.log" Jun 05 18:29:01.128636 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:01.128624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-5cgw9_6be1f372-fce4-4128-a3be-60be3efb2fb3/insights-operator/1.log" Jun 05 18:29:01.224126 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:01.224102 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hgsfj_11c3f739-7ab2-4145-9033-1647ccd03065/kube-rbac-proxy/0.log" Jun 05 18:29:01.248766 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:01.248738 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hgsfj_11c3f739-7ab2-4145-9033-1647ccd03065/exporter/0.log" Jun 05 18:29:01.269623 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:01.269573 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hgsfj_11c3f739-7ab2-4145-9033-1647ccd03065/extractor/0.log" Jun 05 18:29:03.590588 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:03.590557 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dc4bb59b5-2rvxw_5584ece9-f5e3-4d9e-aaf5-3270c9073cae/nginx/0.log" Jun 05 18:29:03.638325 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:03.638268 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-m9hjx_c990f2f8-44e1-4997-917d-6be7559ecd12/manager/0.log" Jun 05 18:29:03.722261 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:03.722229 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7652n_00fdd83b-f263-4312-b68e-218d5c5d26b9/manager/0.log" Jun 05 18:29:03.764476 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:03.764449 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hm5wr/perf-node-gather-daemonset-75dqc" Jun 05 18:29:03.898695 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:03.898598 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-4mfcn_c0447a31-39f9-42e9-8b60-3d26b6be29b6/server/0.log" Jun 05 18:29:03.948752 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:03.948713 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hm8xl_c50a5142-8cb7-4a14-9624-328bf2dd43a0/manager/0.log" Jun 05 18:29:04.027676 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:04.027649 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk_4567a37b-990d-4fc6-9cf8-f46fee86b5d6/manager/0.log" Jun 05 18:29:04.050154 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:04.050127 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54f5f4b6cb-mdzhk_4567a37b-990d-4fc6-9cf8-f46fee86b5d6/copy-manifests/0.log" Jun 05 18:29:05.168203 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:05.168171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mmgl_fccb9ffa-b845-4dda-b341-8e57947f0a19/konnectivity-agent/0.log" limit=1024 Jun 05 18:29:10.172829 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:10.172799 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nzh9j_84b0318c-29db-49a8-a8a1-367a7f6ad9f3/discovery/0.log" Jun 05 18:29:10.197025 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:10.197000 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcf5494b-c6h7s_2d1cb965-585a-464d-b700-26b81bee86b5/kube-auth-proxy/0.log" Jun 05 18:29:11.375766 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:11.375741 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-z64rt_16ad1a55-cdcc-483f-87ec-e7455c7d54aa/migrator/0.log" Jun 05 18:29:11.396894 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:11.396858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-z64rt_16ad1a55-cdcc-483f-87ec-e7455c7d54aa/graceful-termination/0.log" Jun 05 18:29:11.599176 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:11.599134 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nzh9j_84b0318c-29db-49a8-a8a1-367a7f6ad9f3/discovery/0.log" Jun 05 18:29:11.623651 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:11.623627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcf5494b-c6h7s_2d1cb965-585a-464d-b700-26b81bee86b5/kube-auth-proxy/0.log" Jun 05 18:29:11.913684 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:11.913652 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-qrkcw_c3e220ca-335c-4845-8acc-ecf81256e56f/kube-storage-version-migrator-operator/1.log" Jun 05 18:29:11.914858 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:11.914827 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-qrkcw_c3e220ca-335c-4845-8acc-ecf81256e56f/kube-storage-version-migrator-operator/0.log" Jun 05 18:29:12.992540 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:12.992511 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5vlgq_978fa5ec-4162-4e32-9d8c-c1820792f000/kube-multus/0.log" Jun 05 18:29:13.016736 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.016713 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phbl5_fd615d88-cab4-4bdf-a3e7-b5af561ce166/kube-multus-additional-cni-plugins/0.log" Jun 05 18:29:13.036638 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.036596 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phbl5_fd615d88-cab4-4bdf-a3e7-b5af561ce166/egress-router-binary-copy/0.log" Jun 05 18:29:13.059330 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.059306 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phbl5_fd615d88-cab4-4bdf-a3e7-b5af561ce166/cni-plugins/0.log" Jun 05 18:29:13.077889 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.077867 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phbl5_fd615d88-cab4-4bdf-a3e7-b5af561ce166/bond-cni-plugin/0.log" Jun 05 18:29:13.098158 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.098138 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phbl5_fd615d88-cab4-4bdf-a3e7-b5af561ce166/routeoverride-cni/0.log" Jun 05 18:29:13.118669 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.118647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phbl5_fd615d88-cab4-4bdf-a3e7-b5af561ce166/whereabouts-cni-bincopy/0.log" Jun 05 18:29:13.137988 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.137961 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phbl5_fd615d88-cab4-4bdf-a3e7-b5af561ce166/whereabouts-cni/0.log" Jun 05 18:29:13.456673 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.456536 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-nzh9j_84b0318c-29db-49a8-a8a1-367a7f6ad9f3/discovery/0.log" Jun 05 18:29:13.477430 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.477397 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65bcf5494b-c6h7s_2d1cb965-585a-464d-b700-26b81bee86b5/kube-auth-proxy/0.log" Jun 05 18:29:13.594200 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.594167 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kpv87_ecd92b6d-f844-48c9-917a-0c65a7b05adb/network-metrics-daemon/0.log" Jun 05 18:29:13.614791 ip-10-0-139-141 kubenswrapper[2579]: I0605 18:29:13.614757 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kpv87_ecd92b6d-f844-48c9-917a-0c65a7b05adb/kube-rbac-proxy/0.log"