Jun 14 14:54:55.982509 ip-10-0-134-188 systemd[1]: Starting Kubernetes Kubelet... Jun 14 14:54:56.434726 ip-10-0-134-188 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:54:56.434726 ip-10-0-134-188 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 14:54:56.434726 ip-10-0-134-188 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:54:56.434726 ip-10-0-134-188 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 14:54:56.434726 ip-10-0-134-188 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:54:56.436990 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.436903 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 14:54:56.441841 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441825 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:54:56.441841 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441841 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441845 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441849 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441852 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441855 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441858 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441861 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441863 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441866 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441869 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441879 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441882 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441885 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441887 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441890 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441893 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441895 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441898 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441900 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441903 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:54:56.441912 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441905 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441908 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441910 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441913 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441916 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441919 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441921 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441924 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441927 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441929 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441932 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441934 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441936 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441939 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441941 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441944 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441946 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441950 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441952 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:54:56.442402 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441955 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441957 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441960 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441963 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441965 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441967 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441970 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441972 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441975 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441977 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441980 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441982 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441985 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441987 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441990 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441993 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441996 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.441999 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442001 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:54:56.442888 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442004 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442008 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442011 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442016 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442019 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442022 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442025 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442028 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442032 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442035 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442038 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442040 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442043 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442046 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442048 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442050 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442053 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442055 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442058 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442060 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:54:56.443364 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442062 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442065 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442067 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442070 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442072 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442074 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442077 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442079 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442082 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442085 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442088 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442090 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442092 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442095 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442097 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442100 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442102 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442106 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442109 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442112 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:54:56.443926 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442807 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442814 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442817 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442820 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442823 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442826 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442829 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442831 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442834 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442836 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442839 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442842 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442844 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442847 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442849 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442852 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442854 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442857 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442859 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442863 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:54:56.444460 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442865 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442868 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442871 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442873 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442876 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442878 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442881 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442883 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442887 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442889 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442892 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442895 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442898 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442900 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442903 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442905 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442908 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442910 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442913 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442916 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:54:56.444982 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442919 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442921 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442924 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442927 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442930 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442932 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442935 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442937 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442940 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442942 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442945 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442948 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442951 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442953 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442956 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442959 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442961 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442963 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442966 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442968 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:54:56.445500 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442971 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442973 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442976 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442978 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442980 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442983 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442985 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442987 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442991 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442994 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.442997 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443000 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443005 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443008 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443011 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443013 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443016 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443018 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443021 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:54:56.445984 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443023 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443025 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443028 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443030 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443033 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443036 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443040 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443044 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443046 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443049 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443052 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443054 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443056 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443059 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443061 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443064 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443066 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443069 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443072 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:54:56.446464 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443074 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443456 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443460 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443463 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443466 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443469 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443472 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443474 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443477 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443479 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443482 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443485 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443487 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443489 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443492 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443494 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443497 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443500 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443503 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:54:56.446943 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443505 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443508 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443510 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443513 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443516 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443519 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443521 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443523 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443526 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443528 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443531 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443533 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443536 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443539 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443541 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443544 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443546 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443549 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443551 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443555 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:54:56.447420 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443559 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443561 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443564 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443567 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443570 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443572 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443575 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443577 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443580 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443586 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443589 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443591 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443594 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443596 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443599 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443601 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443604 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443606 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443609 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443611 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:54:56.447892 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443613 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443616 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443618 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443621 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443624 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443628 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443632 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443635 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443638 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443640 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443643 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443646 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443649 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443652 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443655 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443658 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443660 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443663 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443666 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:54:56.448385 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443668 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443672 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443677 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443680 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443683 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443685 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443688 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443690 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443693 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443696 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443698 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443700 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443703 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443705 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443708 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443710 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443713 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443715 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443718 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:54:56.448836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443722 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443724 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.443726 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443797 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443803 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443809 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443821 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443826 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443829 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443833 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443837 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443840 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443843 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443846 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443850 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443854 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443857 2561 flags.go:64] FLAG: --cgroup-root="" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443860 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443863 2561 flags.go:64] FLAG: --client-ca-file="" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443866 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443868 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443873 2561 flags.go:64] FLAG: --cluster-domain="" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443876 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443879 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 14:54:56.449327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443882 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443885 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443888 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443891 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443894 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443897 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443900 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443903 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443907 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443910 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443913 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443917 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443920 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443922 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443925 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443928 2561 flags.go:64] FLAG: --enable-server="true" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443931 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443935 2561 flags.go:64] FLAG: --event-burst="100" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443938 2561 flags.go:64] FLAG: --event-qps="50" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443941 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443944 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443947 2561 flags.go:64] FLAG: --eviction-hard="" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443950 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443954 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443957 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 14:54:56.449918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443960 2561 flags.go:64] FLAG: --eviction-soft="" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443962 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443965 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443968 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443971 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443974 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443976 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443979 2561 flags.go:64] FLAG: --feature-gates="" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443982 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443985 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443988 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443991 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443994 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443997 2561 flags.go:64] FLAG: --help="false" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.443999 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444003 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444006 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444009 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444013 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444016 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444018 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444021 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444024 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 14:54:56.450568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444026 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444029 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444032 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444035 2561 flags.go:64] FLAG: --kube-reserved="" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444038 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444040 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444043 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444047 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444049 2561 flags.go:64] FLAG: --lock-file="" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444052 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444055 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444057 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444062 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444065 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444068 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444070 2561 flags.go:64] FLAG: --logging-format="text" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444073 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444076 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444078 2561 flags.go:64] FLAG: --manifest-url="" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444081 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444085 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444088 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444092 2561 flags.go:64] FLAG: --max-pods="110" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444095 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444099 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 14:54:56.451181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444101 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444104 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444107 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444110 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444113 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444119 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444122 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444125 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444128 2561 flags.go:64] FLAG: --pod-cidr="" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444131 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444136 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444139 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444141 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444144 2561 flags.go:64] FLAG: --port="10250" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444147 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444151 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f25b969ceed1b5d" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444153 2561 flags.go:64] FLAG: --qos-reserved="" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444156 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444159 2561 flags.go:64] FLAG: --register-node="true" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444162 2561 flags.go:64] FLAG: --register-with-taints="" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444165 2561 flags.go:64] FLAG: --registry-burst="10" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444168 2561 flags.go:64] FLAG: --registry-qps="5" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444171 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444173 2561 flags.go:64] FLAG: --reserved-memory="" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444177 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 14:54:56.451877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444180 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444183 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444205 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444208 2561 flags.go:64] FLAG: --runonce="false" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444211 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444214 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444218 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444221 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444224 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444226 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444229 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444232 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444235 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444237 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444240 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444242 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444245 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444249 2561 flags.go:64] FLAG: --system-cgroups="" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444252 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444257 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444260 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444262 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444268 2561 flags.go:64] FLAG: --tls-min-version="" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444271 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444273 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 14:54:56.452577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444276 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444279 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444281 2561 flags.go:64] FLAG: --v="2" Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444285 2561 flags.go:64] FLAG: --version="false" Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444288 2561 flags.go:64] FLAG: --vmodule="" Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444292 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.444295 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444408 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444412 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444415 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444418 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444420 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444423 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444427 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444430 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444433 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444436 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444440 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444443 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444447 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444451 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:54:56.453283 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444453 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444456 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444458 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444461 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444464 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444467 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444469 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444472 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444475 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444477 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444480 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444482 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444484 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444487 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444489 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444492 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444494 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444496 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444499 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444501 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:54:56.453849 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444504 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444506 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444508 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444511 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444514 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444516 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444519 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444521 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444524 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444526 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444529 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444531 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444534 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444536 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444538 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444541 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444543 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444547 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444549 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444552 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:54:56.454505 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444554 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444557 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444560 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444563 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444565 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444567 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444570 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444572 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444575 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444577 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444579 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444582 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444584 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444586 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444589 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444592 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444594 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444596 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444599 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444601 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:54:56.455061 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444603 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444606 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444608 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444610 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444613 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444615 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444618 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444620 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444624 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444627 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444633 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444636 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444638 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444641 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444643 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444646 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444648 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444651 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444653 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:54:56.455594 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444655 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444658 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444660 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444662 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444665 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.444667 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.445446 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.453436 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.453458 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.454327 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.454335 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454404 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454409 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454413 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:54:56.456064 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454417 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454420 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454422 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454425 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454427 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454430 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454433 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454435 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454438 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454441 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454443 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454446 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454448 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454451 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454453 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454456 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454458 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454461 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454463 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454466 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:54:56.456442 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454469 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454471 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454475 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454479 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454482 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454484 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454494 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454497 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454499 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454502 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454505 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454507 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454510 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454513 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454515 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454518 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454521 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454523 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454528 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:54:56.456920 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454531 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454534 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454537 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454540 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454542 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454544 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454547 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454550 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454552 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454555 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454557 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454559 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454562 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454565 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454567 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454570 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454572 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454575 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454577 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454581 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:54:56.457411 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454589 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454591 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454594 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454596 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454599 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454601 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454604 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454606 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454610 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454613 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454616 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454619 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454622 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454624 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454627 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454629 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454632 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454635 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454637 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:54:56.457891 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454639 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454642 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454645 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454648 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454650 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454652 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454655 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454658 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454660 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454662 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454665 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454667 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454670 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454672 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454685 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454688 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454690 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:54:56.458405 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454692 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.454698 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454864 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454872 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454875 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454877 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454880 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454882 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454885 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454887 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454889 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454892 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454894 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454897 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:54:56.458820 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454899 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454902 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454904 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454907 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454910 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454912 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454914 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454917 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454921 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454924 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454926 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454930 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454933 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454937 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454939 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454942 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454950 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454953 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454955 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454958 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:54:56.459170 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454960 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454962 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454965 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454967 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454969 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454972 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454974 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454976 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454978 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454981 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454983 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454985 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454988 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454990 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454992 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454995 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.454997 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455001 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455004 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:54:56.459680 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455007 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455009 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455017 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455020 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455022 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455025 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455027 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455030 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455032 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455034 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455043 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455045 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455048 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455050 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455052 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455055 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455057 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455059 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455062 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455064 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:54:56.460134 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455067 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455071 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455074 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455077 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455080 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455083 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455085 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455088 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455090 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455093 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455095 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455098 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455100 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455102 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455105 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455107 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455110 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455112 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455115 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:54:56.460636 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455117 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455120 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455122 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455124 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455132 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455135 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455137 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455139 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:56.455142 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.455147 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.455298 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 14:54:56.461079 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.459422 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 14:54:56.461384 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.461098 2561 server.go:1019] "Starting client certificate rotation" Jun 14 14:54:56.461384 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.461221 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:54:56.461384 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.461270 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:54:56.463971 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.463957 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:54:56.475501 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.475440 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:54:56.487695 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.487676 2561 log.go:25] "Validated CRI v1 runtime API" Jun 14 14:54:56.491774 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.491756 2561 log.go:25] "Validated CRI v1 image API" Jun 14 14:54:56.492526 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.492511 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 14:54:56.495149 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.495128 2561 fs.go:135] Filesystem UUIDs: map[62584f9f-4d34-4956-ac2e-cc16b354ae43:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e2172e89-f09c-4090-85e7-8484fa70e99d:/dev/nvme0n1p3] Jun 14 14:54:56.495224 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.495149 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 14:54:56.498967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.498950 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:54:56.501588 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.501360 2561 manager.go:216] Machine: {Timestamp:2026-06-14 14:54:56.499909249 +0000 UTC m=+0.389134657 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099441 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25a7a868a1223bf51005b5885f866a SystemUUID:ec25a7a8-68a1-223b-f510-05b5885f866a BootID:96e55daa-455c-4075-ab9b-e1c66b89daa4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a5:4e:e5:b6:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a5:4e:e5:b6:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:4d:21:2d:22:e8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 14:54:56.501588 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.501585 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 14:54:56.501711 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.501699 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 14:54:56.505348 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.505326 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 14:54:56.505487 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.505352 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-188.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 14:54:56.506944 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.506934 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 14:54:56.506982 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.506947 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 14:54:56.506982 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.506955 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:54:56.507648 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.507637 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:54:56.509604 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.509593 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 14:54:56.514315 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.514303 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:54:56.514428 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.514418 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 14:54:56.514463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.514449 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 14 14:54:56.514463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.514460 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 14:54:56.514517 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.514474 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 14:54:56.514517 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.514483 2561 kubelet.go:398] "Adding apiserver pod source" Jun 14 14:54:56.514517 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.514492 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 14:54:56.525546 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.514889 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:54:56.525546 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.514911 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:54:56.526517 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.526487 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 14:54:56.526517 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.526482 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 14:54:56.526715 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.526701 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 14:54:56.529344 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.529328 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 14:54:56.529395 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.529362 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 14:54:56.530228 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530216 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 14:54:56.530271 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530236 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 14:54:56.530271 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530245 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 14:54:56.530271 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530253 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 14:54:56.530358 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530270 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 14:54:56.530358 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530283 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 14:54:56.530358 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530299 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 14:54:56.530358 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530311 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 14:54:56.530358 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530336 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 14:54:56.530358 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530348 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 14:54:56.530517 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530364 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 14:54:56.530517 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.530375 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 14:54:56.531334 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.531322 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 14:54:56.531371 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.531334 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 14:54:56.534621 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.534609 2561 server.go:1268] "Started kubelet" Jun 14 14:54:56.534727 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.534693 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 14:54:56.538808 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.538772 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 14:54:56.538968 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.538949 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 14:54:56.539772 ip-10-0-134-188 systemd[1]: Started Kubernetes Kubelet. Jun 14 14:54:56.540536 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.540520 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 14 14:54:56.541847 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.541826 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 14:54:56.544707 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.544687 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-188.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 14:54:56.545817 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.544702 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-188.ec2.internal.18b8fa553774863e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-188.ec2.internal,UID:ip-10-0-134-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-188.ec2.internal,},FirstTimestamp:2026-06-14 14:54:56.53457875 +0000 UTC m=+0.423804141,LastTimestamp:2026-06-14 14:54:56.53457875 +0000 UTC m=+0.423804141,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-188.ec2.internal,}" Jun 14 14:54:56.546460 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.546443 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 14:54:56.548914 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.548896 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 14:54:56.548997 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.548910 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 14:54:56.549059 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.549000 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-188.ec2.internal\" not found" Jun 14 14:54:56.549779 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.549713 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 14:54:56.549779 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.549731 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 14:54:56.549779 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.549719 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 14:54:56.550129 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.549877 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 14 14:54:56.550129 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.549888 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 14 14:54:56.550129 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.549880 2561 factory.go:55] Registering systemd factory Jun 14 14:54:56.550129 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.549908 2561 factory.go:223] Registration of the systemd container factory successfully Jun 14 14:54:56.550333 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.550141 2561 factory.go:153] Registering CRI-O factory Jun 14 14:54:56.550333 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.550155 2561 factory.go:223] Registration of the crio container factory successfully Jun 14 14:54:56.550333 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.550253 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 14:54:56.550333 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.550279 2561 factory.go:103] Registering Raw factory Jun 14 14:54:56.550333 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.550295 2561 manager.go:1196] Started watching for new ooms in manager Jun 14 14:54:56.550778 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.550662 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnv2h" Jun 14 14:54:56.550778 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.550728 2561 manager.go:349] Starting recovery of all containers Jun 14 14:54:56.552035 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.552006 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 14:54:56.552133 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.552107 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 14:54:56.560052 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.560028 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnv2h" Jun 14 14:54:56.560698 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.560683 2561 manager.go:354] Recovery completed Jun 14 14:54:56.561892 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.561872 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 14 14:54:56.564943 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.564925 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:54:56.566816 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.566796 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:54:56.566881 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.566826 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:54:56.566881 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.566835 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:54:56.567375 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.567360 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 14:54:56.567375 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.567372 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 14:54:56.567487 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.567375 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:54:56.567487 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.567391 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:54:56.568089 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.568076 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:54:56.568126 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.568101 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:54:56.568126 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.568111 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:54:56.568793 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.568722 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-188.ec2.internal.18b8fa5539606a76 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-188.ec2.internal,UID:ip-10-0-134-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-188.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-188.ec2.internal,},FirstTimestamp:2026-06-14 14:54:56.56681535 +0000 UTC m=+0.456040741,LastTimestamp:2026-06-14 14:54:56.56681535 +0000 UTC m=+0.456040741,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-188.ec2.internal,}" Jun 14 14:54:56.569463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.569449 2561 policy_none.go:49] "None policy: Start" Jun 14 14:54:56.569508 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.569467 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 14:54:56.569508 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.569478 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 14:54:56.571423 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.571411 2561 policy_none.go:47] "Start" Jun 14 14:54:56.604480 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.604464 2561 manager.go:337] "Starting Device Plugin manager" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.604563 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.604577 2561 server.go:87] "Starting device plugin registration server" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.604819 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.604830 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.604905 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.604991 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.605000 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.605527 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.605580 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-188.ec2.internal\" not found" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.619137 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.620415 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.620447 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.620465 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.620496 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 14:54:56.627629 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.622671 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:54:56.705153 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.705048 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:54:56.706208 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.706171 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:54:56.706327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.706218 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:54:56.706327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.706233 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:54:56.706327 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.706263 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.716331 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.716316 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.716396 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.716338 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-188.ec2.internal\": node \"ip-10-0-134-188.ec2.internal\" not found" Jun 14 14:54:56.720626 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.720607 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal"] Jun 14 14:54:56.720694 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.720670 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:54:56.722112 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.722098 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:54:56.722163 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.722124 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:54:56.722163 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.722133 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:54:56.724364 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.724352 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:54:56.724529 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.724515 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.724563 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.724545 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:54:56.725014 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.725001 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:54:56.725063 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.725013 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:54:56.725063 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.725030 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:54:56.725063 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.725036 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:54:56.725063 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.725041 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:54:56.725063 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.725051 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:54:56.727312 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.727295 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.727394 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.727326 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:54:56.727958 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.727939 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:54:56.728051 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.727973 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:54:56.728051 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.727990 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:54:56.739689 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.739671 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-188.ec2.internal\" not found" Jun 14 14:54:56.745834 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.745820 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-188.ec2.internal\" not found" node="ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.750261 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.750246 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-188.ec2.internal\" not found" node="ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.751227 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.751205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ceb315acd6d802f9b9d0b94fadd4ba4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-188.ec2.internal\" (UID: \"8ceb315acd6d802f9b9d0b94fadd4ba4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.751323 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.751234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fcf380b108e952633937340e196633bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal\" (UID: \"fcf380b108e952633937340e196633bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.751323 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.751250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcf380b108e952633937340e196633bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal\" (UID: \"fcf380b108e952633937340e196633bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.840260 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.840235 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-188.ec2.internal\" not found" Jun 14 14:54:56.851598 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.851577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fcf380b108e952633937340e196633bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal\" (UID: \"fcf380b108e952633937340e196633bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.851713 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.851610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcf380b108e952633937340e196633bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal\" (UID: \"fcf380b108e952633937340e196633bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.851713 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.851634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ceb315acd6d802f9b9d0b94fadd4ba4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-188.ec2.internal\" (UID: \"8ceb315acd6d802f9b9d0b94fadd4ba4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.851713 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.851675 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fcf380b108e952633937340e196633bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal\" (UID: \"fcf380b108e952633937340e196633bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.851713 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.851680 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ceb315acd6d802f9b9d0b94fadd4ba4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-188.ec2.internal\" (UID: \"8ceb315acd6d802f9b9d0b94fadd4ba4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.851713 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:56.851684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcf380b108e952633937340e196633bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal\" (UID: \"fcf380b108e952633937340e196633bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" Jun 14 14:54:56.940790 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:56.940748 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-188.ec2.internal\" not found" Jun 14 14:54:57.041566 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.041491 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-188.ec2.internal\" not found" Jun 14 14:54:57.049687 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.049663 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" Jun 14 14:54:57.054700 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.054488 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal" Jun 14 14:54:57.142363 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.142326 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-188.ec2.internal\" not found" Jun 14 14:54:57.242940 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.242904 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-188.ec2.internal\" not found" Jun 14 14:54:57.343504 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.343425 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-188.ec2.internal\" not found" Jun 14 14:54:57.361918 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.361889 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:54:57.367421 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.367404 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:54:57.449541 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.449512 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" Jun 14 14:54:57.459993 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.459971 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 14:54:57.460146 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.460100 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:54:57.460146 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.460129 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:54:57.460256 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.460149 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:54:57.460256 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.460167 2561 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a08721121c8b74b9c9250d90f915194d-7c835ebc808bc4d3.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.134.188:35138->3.230.60.163:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" Jun 14 14:54:57.460256 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.460207 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal" Jun 14 14:54:57.478202 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.478179 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:54:57.507535 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.507510 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:54:57.515330 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.515302 2561 apiserver.go:52] "Watching apiserver" Jun 14 14:54:57.524775 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.524755 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 14:54:57.525114 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.525094 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-msmgc","kube-system/konnectivity-agent-8pvk9","kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6","openshift-image-registry/node-ca-vt5jr","openshift-multus/multus-additional-cni-plugins-ccg99","openshift-multus/multus-g7qbp","openshift-multus/network-metrics-daemon-9j2l2","openshift-network-diagnostics/network-check-target-jnqxb","kube-system/global-pull-secret-syncer-hrhnq","openshift-cluster-node-tuning-operator/tuned-nhk8c","openshift-dns/node-resolver-qddgd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal","openshift-network-operator/iptables-alerter-p59wq"] Jun 14 14:54:57.527638 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.527620 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.529618 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.529600 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.529990 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.529969 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 14:54:57.530089 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.529972 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 14:54:57.530216 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.530183 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 14:54:57.530289 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.530218 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 14:54:57.530289 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.530234 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mrsst\"" Jun 14 14:54:57.531824 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.531809 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:54:57.532237 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.532221 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 14:54:57.532446 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.532430 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dgkxr\"" Jun 14 14:54:57.532446 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.532441 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.534572 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.534550 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.534668 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.534588 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rjjt4\"" Jun 14 14:54:57.534726 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.534594 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 14:54:57.534776 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.534728 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 14:54:57.534776 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.534730 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:54:57.536675 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.536650 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 14:54:57.536753 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.536655 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 14:54:57.536753 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.536736 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.537110 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.536935 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-prw7m\"" Jun 14 14:54:57.537226 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.537211 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 14:54:57.538815 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.538797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:54:57.538916 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.538866 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:54:57.539036 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.538921 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 14:54:57.539036 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.538992 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 14:54:57.539036 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.539010 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 14:54:57.539156 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.539076 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xg7xj\"" Jun 14 14:54:57.541076 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.541060 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.543516 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.543499 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 14:54:57.543516 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.543511 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 14:54:57.543654 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.543549 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 14:54:57.543654 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.543559 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lhsg6\"" Jun 14 14:54:57.543654 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.543507 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 14:54:57.543654 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.543617 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 14:54:57.543835 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.543659 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 14:54:57.543892 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.543879 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:54:57.545894 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.545879 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 14:54:57.546126 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.546108 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 14:54:57.546213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.546129 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gnd96\"" Jun 14 14:54:57.546213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.546172 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:57.546323 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.546247 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:54:57.549084 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.549064 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 14:54:57.549084 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.549079 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:54:57.549220 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.549152 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:54:57.551732 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.551710 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.554381 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.554347 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 14:54:57.554481 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.554421 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.554559 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.554501 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9dxjr\"" Jun 14 14:54:57.554616 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.554553 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 14:54:57.556409 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64c9f8a5-ea6c-4120-b6eb-0f6328d5d127-host\") pod \"node-ca-vt5jr\" (UID: \"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127\") " pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.556512 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpnlt\" (UniqueName: \"kubernetes.io/projected/9721353a-571b-44da-86f9-498e489257f1-kube-api-access-hpnlt\") pod \"iptables-alerter-p59wq\" (UID: \"9721353a-571b-44da-86f9-498e489257f1\") " pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.556512 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.556512 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:54:57.556512 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-cni-dir\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.556688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-var-lib-cni-bin\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.556688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-var-lib-kubelet\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.556688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556554 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zgnw7\"" Jun 14 14:54:57.556688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-sys-fs\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.556688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcttb\" (UniqueName: \"kubernetes.io/projected/64c9f8a5-ea6c-4120-b6eb-0f6328d5d127-kube-api-access-kcttb\") pod \"node-ca-vt5jr\" (UID: \"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127\") " pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.556688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-systemd-units\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.556688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-cni-netd\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.556688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-var-lib-kubelet\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.556688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556676 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-run-openvswitch\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-run-ovn-kubernetes\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-run-multus-certs\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-system-cni-dir\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-hostroot\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-registration-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556832 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-modprobe-d\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556872 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-systemd\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e857945d-1621-4831-a695-4a057e309bbf-tmp\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-run-netns\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.556964 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556961 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-kubernetes\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.556983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-cni-bin\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc266\" (UniqueName: \"kubernetes.io/projected/18d2357f-e492-4696-ac06-bbcd4106f338-kube-api-access-vc266\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-run-netns\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557045 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/18d2357f-e492-4696-ac06-bbcd4106f338-ovnkube-config\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557082 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/18d2357f-e492-4696-ac06-bbcd4106f338-ovnkube-script-lib\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-socket-dir-parent\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557167 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjvmq\" (UniqueName: \"kubernetes.io/projected/a359273f-3646-4342-8e04-13ca25961257-kube-api-access-fjvmq\") pod \"node-resolver-qddgd\" (UID: \"a359273f-3646-4342-8e04-13ca25961257\") " pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e857945d-1621-4831-a695-4a057e309bbf-etc-tuned\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557254 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-socket-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-run-ovn\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-node-log\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-etc-kubernetes\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-log-socket\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557377 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kprh6\" (UniqueName: \"kubernetes.io/projected/957dd036-9848-4139-ae9b-00cf5f7f9ae3-kube-api-access-kprh6\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.557463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-sysctl-conf\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9721353a-571b-44da-86f9-498e489257f1-iptables-alerter-script\") pod \"iptables-alerter-p59wq\" (UID: \"9721353a-571b-44da-86f9-498e489257f1\") " pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qqxh\" (UniqueName: \"kubernetes.io/projected/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-kube-api-access-4qqxh\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb586a37-c589-4617-9967-804838c873b8-kubelet-config\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557447 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-run-k8s-cni-cncf-io\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-daemon-config\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-device-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmlpz\" (UniqueName: \"kubernetes.io/projected/fa2d1037-187f-4b35-a752-59bfae3a464e-kube-api-access-dmlpz\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-var-lib-openvswitch\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/18d2357f-e492-4696-ac06-bbcd4106f338-env-overrides\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557549 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-var-lib-cni-multus\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvm5l\" (UniqueName: \"kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l\") pod \"network-check-target-jnqxb\" (UID: \"a866bad3-7c32-4079-aeb6-40b04800c470\") " pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-sys\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9721353a-571b-44da-86f9-498e489257f1-host-slash\") pod \"iptables-alerter-p59wq\" (UID: \"9721353a-571b-44da-86f9-498e489257f1\") " pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-slash\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-etc-openvswitch\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.557967 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/18d2357f-e492-4696-ac06-bbcd4106f338-ovn-node-metrics-cert\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-os-release\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557767 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/547b5340-60ab-4196-8d72-bc9e6e3d67ad-agent-certs\") pod \"konnectivity-agent-8pvk9\" (UID: \"547b5340-60ab-4196-8d72-bc9e6e3d67ad\") " pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557792 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/547b5340-60ab-4196-8d72-bc9e6e3d67ad-konnectivity-ca\") pod \"konnectivity-agent-8pvk9\" (UID: \"547b5340-60ab-4196-8d72-bc9e6e3d67ad\") " pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557810 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-sysctl-d\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-run\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-cnibin\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb586a37-c589-4617-9967-804838c873b8-dbus\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-lib-modules\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557889 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tx9z\" (UniqueName: \"kubernetes.io/projected/e857945d-1621-4831-a695-4a057e309bbf-kube-api-access-4tx9z\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64c9f8a5-ea6c-4120-b6eb-0f6328d5d127-serviceca\") pod \"node-ca-vt5jr\" (UID: \"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127\") " pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557936 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-run-systemd\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a359273f-3646-4342-8e04-13ca25961257-tmp-dir\") pod \"node-resolver-qddgd\" (UID: \"a359273f-3646-4342-8e04-13ca25961257\") " pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-cni-binary-copy\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.557987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a359273f-3646-4342-8e04-13ca25961257-hosts-file\") pod \"node-resolver-qddgd\" (UID: \"a359273f-3646-4342-8e04-13ca25961257\") " pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.558002 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-sysconfig\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.558015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-host\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.558484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.558027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.559020 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.558046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-kubelet\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.559020 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.558071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-conf-dir\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.559020 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.558092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:57.563202 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.563168 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:54:57.566181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.566146 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 14:49:56 +0000 UTC" deadline="2027-12-31 23:46:24.31468049 +0000 UTC" Jun 14 14:54:57.566181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.566180 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13568h51m26.748503097s" Jun 14 14:54:57.591134 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.591117 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9n665" Jun 14 14:54:57.600619 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.600569 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9n665" Jun 14 14:54:57.650402 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.650384 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 14:54:57.658803 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-sysctl-d\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.658909 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658824 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-run\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.658909 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658843 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-cnibin\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.658909 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb586a37-c589-4617-9967-804838c873b8-dbus\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:57.658909 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658872 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-lib-modules\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.658909 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tx9z\" (UniqueName: \"kubernetes.io/projected/e857945d-1621-4831-a695-4a057e309bbf-kube-api-access-4tx9z\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658913 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64c9f8a5-ea6c-4120-b6eb-0f6328d5d127-serviceca\") pod \"node-ca-vt5jr\" (UID: \"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127\") " pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658920 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-run\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658938 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-sysctl-d\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658920 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-cnibin\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-run-systemd\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.658994 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-lib-modules\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659000 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eb586a37-c589-4617-9967-804838c873b8-dbus\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659000 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-run-systemd\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a359273f-3646-4342-8e04-13ca25961257-tmp-dir\") pod \"node-resolver-qddgd\" (UID: \"a359273f-3646-4342-8e04-13ca25961257\") " pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659061 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-cni-binary-copy\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659087 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20b3c648-3a69-49fe-8902-497a1cd44d97-cni-binary-copy\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659113 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a359273f-3646-4342-8e04-13ca25961257-hosts-file\") pod \"node-resolver-qddgd\" (UID: \"a359273f-3646-4342-8e04-13ca25961257\") " pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.659143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659127 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-sysconfig\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659181 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-sysconfig\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659225 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-host\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a359273f-3646-4342-8e04-13ca25961257-hosts-file\") pod \"node-resolver-qddgd\" (UID: \"a359273f-3646-4342-8e04-13ca25961257\") " pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-kubelet\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659291 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-host\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-kubelet\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-conf-dir\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659353 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-etc-selinux\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-os-release\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659388 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a359273f-3646-4342-8e04-13ca25961257-tmp-dir\") pod \"node-resolver-qddgd\" (UID: \"a359273f-3646-4342-8e04-13ca25961257\") " pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64c9f8a5-ea6c-4120-b6eb-0f6328d5d127-host\") pod \"node-ca-vt5jr\" (UID: \"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127\") " pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659439 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpnlt\" (UniqueName: \"kubernetes.io/projected/9721353a-571b-44da-86f9-498e489257f1-kube-api-access-hpnlt\") pod \"iptables-alerter-p59wq\" (UID: \"9721353a-571b-44da-86f9-498e489257f1\") " pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.659459 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659475 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64c9f8a5-ea6c-4120-b6eb-0f6328d5d127-host\") pod \"node-ca-vt5jr\" (UID: \"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127\") " pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.659781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64c9f8a5-ea6c-4120-b6eb-0f6328d5d127-serviceca\") pod \"node-ca-vt5jr\" (UID: \"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127\") " pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659404 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-conf-dir\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659534 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.659540 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret podName:eb586a37-c589-4617-9967-804838c873b8 nodeName:}" failed. No retries permitted until 2026-06-14 14:54:58.159505855 +0000 UTC m=+2.048731234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret") pod "global-pull-secret-syncer-hrhnq" (UID: "eb586a37-c589-4617-9967-804838c873b8") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.659566 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-cni-dir\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.659618 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs podName:fa2d1037-187f-4b35-a752-59bfae3a464e nodeName:}" failed. No retries permitted until 2026-06-14 14:54:58.159603122 +0000 UTC m=+2.048828508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs") pod "network-metrics-daemon-9j2l2" (UID: "fa2d1037-187f-4b35-a752-59bfae3a464e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659628 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-cni-dir\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-var-lib-cni-bin\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-var-lib-kubelet\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659676 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-cni-binary-copy\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-sys-fs\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659705 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-var-lib-cni-bin\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcttb\" (UniqueName: \"kubernetes.io/projected/64c9f8a5-ea6c-4120-b6eb-0f6328d5d127-kube-api-access-kcttb\") pod \"node-ca-vt5jr\" (UID: \"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127\") " pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659719 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-var-lib-kubelet\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-systemd-units\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.660627 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-cni-netd\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-var-lib-kubelet\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659771 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-sys-fs\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-systemd-units\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659806 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-cni-netd\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659818 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-var-lib-kubelet\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-run-openvswitch\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659850 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-run-openvswitch\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-run-ovn-kubernetes\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-run-multus-certs\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659905 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-run-ovn-kubernetes\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659927 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-run-multus-certs\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20b3c648-3a69-49fe-8902-497a1cd44d97-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659970 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.659998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-system-cni-dir\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660010 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.661471 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-hostroot\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660031 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-hostroot\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660036 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-system-cni-dir\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-registration-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660071 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-registration-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-modprobe-d\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660108 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-systemd\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e857945d-1621-4831-a695-4a057e309bbf-tmp\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-run-netns\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-kubernetes\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660179 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-modprobe-d\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-systemd\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660226 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-run-netns\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-cni-bin\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-kubernetes\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660260 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc266\" (UniqueName: \"kubernetes.io/projected/18d2357f-e492-4696-ac06-bbcd4106f338-kube-api-access-vc266\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-run-netns\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660307 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-cni-bin\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.662319 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660346 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-run-netns\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/18d2357f-e492-4696-ac06-bbcd4106f338-ovnkube-config\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/18d2357f-e492-4696-ac06-bbcd4106f338-ovnkube-script-lib\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-socket-dir-parent\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-system-cni-dir\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660433 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660479 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjvmq\" (UniqueName: \"kubernetes.io/projected/a359273f-3646-4342-8e04-13ca25961257-kube-api-access-fjvmq\") pod \"node-resolver-qddgd\" (UID: \"a359273f-3646-4342-8e04-13ca25961257\") " pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660488 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-socket-dir-parent\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e857945d-1621-4831-a695-4a057e309bbf-etc-tuned\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-socket-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-run-ovn\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-node-log\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-etc-kubernetes\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-log-socket\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660650 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kprh6\" (UniqueName: \"kubernetes.io/projected/957dd036-9848-4139-ae9b-00cf5f7f9ae3-kube-api-access-kprh6\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-sysctl-conf\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9721353a-571b-44da-86f9-498e489257f1-iptables-alerter-script\") pod \"iptables-alerter-p59wq\" (UID: \"9721353a-571b-44da-86f9-498e489257f1\") " pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660715 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-node-log\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.663374 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qqxh\" (UniqueName: \"kubernetes.io/projected/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-kube-api-access-4qqxh\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb586a37-c589-4617-9967-804838c873b8-kubelet-config\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-run-k8s-cni-cncf-io\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-daemon-config\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20b3c648-3a69-49fe-8902-497a1cd44d97-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660808 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-socket-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660827 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/18d2357f-e492-4696-ac06-bbcd4106f338-ovnkube-config\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-device-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660855 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-etc-kubernetes\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmlpz\" (UniqueName: \"kubernetes.io/projected/fa2d1037-187f-4b35-a752-59bfae3a464e-kube-api-access-dmlpz\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660892 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-run-ovn\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-var-lib-openvswitch\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660904 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/18d2357f-e492-4696-ac06-bbcd4106f338-ovnkube-script-lib\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660916 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-var-lib-openvswitch\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660929 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/18d2357f-e492-4696-ac06-bbcd4106f338-env-overrides\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-var-lib-cni-multus\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvm5l\" (UniqueName: \"kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l\") pod \"network-check-target-jnqxb\" (UID: \"a866bad3-7c32-4079-aeb6-40b04800c470\") " pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:54:57.664215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-sys\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661041 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9721353a-571b-44da-86f9-498e489257f1-host-slash\") pod \"iptables-alerter-p59wq\" (UID: \"9721353a-571b-44da-86f9-498e489257f1\") " pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-slash\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661049 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-log-socket\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-etc-openvswitch\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661120 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eb586a37-c589-4617-9967-804838c873b8-kubelet-config\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.660905 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/957dd036-9848-4139-ae9b-00cf5f7f9ae3-device-dir\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661166 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-run-k8s-cni-cncf-io\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-etc-openvswitch\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661302 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-host-var-lib-cni-multus\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661465 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/18d2357f-e492-4696-ac06-bbcd4106f338-env-overrides\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661581 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-sys\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e857945d-1621-4831-a695-4a057e309bbf-etc-sysctl-conf\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-cnibin\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bq82\" (UniqueName: \"kubernetes.io/projected/20b3c648-3a69-49fe-8902-497a1cd44d97-kube-api-access-6bq82\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661651 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9721353a-571b-44da-86f9-498e489257f1-host-slash\") pod \"iptables-alerter-p59wq\" (UID: \"9721353a-571b-44da-86f9-498e489257f1\") " pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/18d2357f-e492-4696-ac06-bbcd4106f338-ovn-node-metrics-cert\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.664688 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-os-release\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661697 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18d2357f-e492-4696-ac06-bbcd4106f338-host-slash\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661722 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-multus-daemon-config\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/547b5340-60ab-4196-8d72-bc9e6e3d67ad-agent-certs\") pod \"konnectivity-agent-8pvk9\" (UID: \"547b5340-60ab-4196-8d72-bc9e6e3d67ad\") " pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661808 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/547b5340-60ab-4196-8d72-bc9e6e3d67ad-konnectivity-ca\") pod \"konnectivity-agent-8pvk9\" (UID: \"547b5340-60ab-4196-8d72-bc9e6e3d67ad\") " pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.661899 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-os-release\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.662223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9721353a-571b-44da-86f9-498e489257f1-iptables-alerter-script\") pod \"iptables-alerter-p59wq\" (UID: \"9721353a-571b-44da-86f9-498e489257f1\") " pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.662425 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/547b5340-60ab-4196-8d72-bc9e6e3d67ad-konnectivity-ca\") pod \"konnectivity-agent-8pvk9\" (UID: \"547b5340-60ab-4196-8d72-bc9e6e3d67ad\") " pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.663150 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e857945d-1621-4831-a695-4a057e309bbf-etc-tuned\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.663564 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e857945d-1621-4831-a695-4a057e309bbf-tmp\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.664064 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/18d2357f-e492-4696-ac06-bbcd4106f338-ovn-node-metrics-cert\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.665213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.664373 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/547b5340-60ab-4196-8d72-bc9e6e3d67ad-agent-certs\") pod \"konnectivity-agent-8pvk9\" (UID: \"547b5340-60ab-4196-8d72-bc9e6e3d67ad\") " pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:54:57.675779 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.675752 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:54:57.675881 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.675783 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:54:57.675881 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.675798 2561 projected.go:196] Error preparing data for projected volume kube-api-access-kvm5l for pod openshift-network-diagnostics/network-check-target-jnqxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:54:57.675881 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:57.675861 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l podName:a866bad3-7c32-4079-aeb6-40b04800c470 nodeName:}" failed. No retries permitted until 2026-06-14 14:54:58.175843584 +0000 UTC m=+2.065068980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kvm5l" (UniqueName: "kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l") pod "network-check-target-jnqxb" (UID: "a866bad3-7c32-4079-aeb6-40b04800c470") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:54:57.676899 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.676798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcttb\" (UniqueName: \"kubernetes.io/projected/64c9f8a5-ea6c-4120-b6eb-0f6328d5d127-kube-api-access-kcttb\") pod \"node-ca-vt5jr\" (UID: \"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127\") " pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.677049 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.677015 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tx9z\" (UniqueName: \"kubernetes.io/projected/e857945d-1621-4831-a695-4a057e309bbf-kube-api-access-4tx9z\") pod \"tuned-nhk8c\" (UID: \"e857945d-1621-4831-a695-4a057e309bbf\") " pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.677949 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.677835 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc266\" (UniqueName: \"kubernetes.io/projected/18d2357f-e492-4696-ac06-bbcd4106f338-kube-api-access-vc266\") pod \"ovnkube-node-msmgc\" (UID: \"18d2357f-e492-4696-ac06-bbcd4106f338\") " pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.678790 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.678739 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpnlt\" (UniqueName: \"kubernetes.io/projected/9721353a-571b-44da-86f9-498e489257f1-kube-api-access-hpnlt\") pod \"iptables-alerter-p59wq\" (UID: \"9721353a-571b-44da-86f9-498e489257f1\") " pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.678908 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.678884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qqxh\" (UniqueName: \"kubernetes.io/projected/0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234-kube-api-access-4qqxh\") pod \"multus-g7qbp\" (UID: \"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234\") " pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.679734 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.679709 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kprh6\" (UniqueName: \"kubernetes.io/projected/957dd036-9848-4139-ae9b-00cf5f7f9ae3-kube-api-access-kprh6\") pod \"aws-ebs-csi-driver-node-bzws6\" (UID: \"957dd036-9848-4139-ae9b-00cf5f7f9ae3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.680715 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.680694 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmlpz\" (UniqueName: \"kubernetes.io/projected/fa2d1037-187f-4b35-a752-59bfae3a464e-kube-api-access-dmlpz\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:54:57.681146 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.681128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjvmq\" (UniqueName: \"kubernetes.io/projected/a359273f-3646-4342-8e04-13ca25961257-kube-api-access-fjvmq\") pod \"node-resolver-qddgd\" (UID: \"a359273f-3646-4342-8e04-13ca25961257\") " pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.738141 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.738097 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ceb315acd6d802f9b9d0b94fadd4ba4.slice/crio-9fa700e0bd0a952e7cbfba166c111473b3c8afcef911c1e41e02882987ff0bdd WatchSource:0}: Error finding container 9fa700e0bd0a952e7cbfba166c111473b3c8afcef911c1e41e02882987ff0bdd: Status 404 returned error can't find the container with id 9fa700e0bd0a952e7cbfba166c111473b3c8afcef911c1e41e02882987ff0bdd Jun 14 14:54:57.738613 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.738593 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf380b108e952633937340e196633bc.slice/crio-2a7a7787c75f417218547ee99fee435ce0a9c4fe98081066dc38f5ea4a59c207 WatchSource:0}: Error finding container 2a7a7787c75f417218547ee99fee435ce0a9c4fe98081066dc38f5ea4a59c207: Status 404 returned error can't find the container with id 2a7a7787c75f417218547ee99fee435ce0a9c4fe98081066dc38f5ea4a59c207 Jun 14 14:54:57.744548 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.744532 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:54:57.762453 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762554 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20b3c648-3a69-49fe-8902-497a1cd44d97-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762554 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762493 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-system-cni-dir\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762554 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20b3c648-3a69-49fe-8902-497a1cd44d97-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762691 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-cnibin\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762691 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762618 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-cnibin\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762691 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762622 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-system-cni-dir\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762691 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762642 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762691 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bq82\" (UniqueName: \"kubernetes.io/projected/20b3c648-3a69-49fe-8902-497a1cd44d97-kube-api-access-6bq82\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762691 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20b3c648-3a69-49fe-8902-497a1cd44d97-cni-binary-copy\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762953 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-os-release\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.762953 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.762811 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20b3c648-3a69-49fe-8902-497a1cd44d97-os-release\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.763018 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.763006 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20b3c648-3a69-49fe-8902-497a1cd44d97-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.763053 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.763005 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20b3c648-3a69-49fe-8902-497a1cd44d97-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.763121 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.763103 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20b3c648-3a69-49fe-8902-497a1cd44d97-cni-binary-copy\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.790377 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.790356 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bq82\" (UniqueName: \"kubernetes.io/projected/20b3c648-3a69-49fe-8902-497a1cd44d97-kube-api-access-6bq82\") pod \"multus-additional-cni-plugins-ccg99\" (UID: \"20b3c648-3a69-49fe-8902-497a1cd44d97\") " pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.854301 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.854236 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g7qbp" Jun 14 14:54:57.863758 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.863730 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcb91a9_1fc2_4ef5_b7ca_1959bdc85234.slice/crio-a898bc9f08fb7fba883ba5d7a02a0b00a028e5bb57f458d7908f047fdebb8932 WatchSource:0}: Error finding container a898bc9f08fb7fba883ba5d7a02a0b00a028e5bb57f458d7908f047fdebb8932: Status 404 returned error can't find the container with id a898bc9f08fb7fba883ba5d7a02a0b00a028e5bb57f458d7908f047fdebb8932 Jun 14 14:54:57.875044 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.875015 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" Jun 14 14:54:57.883656 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.883628 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode857945d_1621_4831_a695_4a057e309bbf.slice/crio-4cffc3cfbc01292f93eb3854201c67d8715fe2c5c8fddd8ed64fedd6fc109ee3 WatchSource:0}: Error finding container 4cffc3cfbc01292f93eb3854201c67d8715fe2c5c8fddd8ed64fedd6fc109ee3: Status 404 returned error can't find the container with id 4cffc3cfbc01292f93eb3854201c67d8715fe2c5c8fddd8ed64fedd6fc109ee3 Jun 14 14:54:57.889768 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.889749 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p59wq" Jun 14 14:54:57.890858 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.890840 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" Jun 14 14:54:57.899729 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.899575 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9721353a_571b_44da_86f9_498e489257f1.slice/crio-d69a333bffec81af4867c72e2ce03f576801ed11250f5264af83a83e360d9513 WatchSource:0}: Error finding container d69a333bffec81af4867c72e2ce03f576801ed11250f5264af83a83e360d9513: Status 404 returned error can't find the container with id d69a333bffec81af4867c72e2ce03f576801ed11250f5264af83a83e360d9513 Jun 14 14:54:57.902668 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.902643 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957dd036_9848_4139_ae9b_00cf5f7f9ae3.slice/crio-943ea74359182919e06c5a1571997b91de9af3ceb1269b19568a1bd016161619 WatchSource:0}: Error finding container 943ea74359182919e06c5a1571997b91de9af3ceb1269b19568a1bd016161619: Status 404 returned error can't find the container with id 943ea74359182919e06c5a1571997b91de9af3ceb1269b19568a1bd016161619 Jun 14 14:54:57.907675 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.907653 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vt5jr" Jun 14 14:54:57.917021 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.917000 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c9f8a5_ea6c_4120_b6eb_0f6328d5d127.slice/crio-386a309ffa5a9ccffd3af16b83b6ff33106ccc461954ebc04c6aa0ff46690855 WatchSource:0}: Error finding container 386a309ffa5a9ccffd3af16b83b6ff33106ccc461954ebc04c6aa0ff46690855: Status 404 returned error can't find the container with id 386a309ffa5a9ccffd3af16b83b6ff33106ccc461954ebc04c6aa0ff46690855 Jun 14 14:54:57.920968 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.920950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:54:57.928573 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.928555 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d2357f_e492_4696_ac06_bbcd4106f338.slice/crio-0922d290c06d170bb4eef938bf95ec1a198cbc6f9b253b592f3f333358079a40 WatchSource:0}: Error finding container 0922d290c06d170bb4eef938bf95ec1a198cbc6f9b253b592f3f333358079a40: Status 404 returned error can't find the container with id 0922d290c06d170bb4eef938bf95ec1a198cbc6f9b253b592f3f333358079a40 Jun 14 14:54:57.931794 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.931778 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:54:57.939319 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.939297 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod547b5340_60ab_4196_8d72_bc9e6e3d67ad.slice/crio-e6a286e7c90b15f789ff4826b81d2687375e2411eefe6cbfa0a056e098f4adcc WatchSource:0}: Error finding container e6a286e7c90b15f789ff4826b81d2687375e2411eefe6cbfa0a056e098f4adcc: Status 404 returned error can't find the container with id e6a286e7c90b15f789ff4826b81d2687375e2411eefe6cbfa0a056e098f4adcc Jun 14 14:54:57.947527 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.947510 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qddgd" Jun 14 14:54:57.952238 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:57.952215 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ccg99" Jun 14 14:54:57.955257 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.955239 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda359273f_3646_4342_8e04_13ca25961257.slice/crio-c468373f7b961f27dbeac58330e6487ee33fd222672cccab7b6df4125ed42184 WatchSource:0}: Error finding container c468373f7b961f27dbeac58330e6487ee33fd222672cccab7b6df4125ed42184: Status 404 returned error can't find the container with id c468373f7b961f27dbeac58330e6487ee33fd222672cccab7b6df4125ed42184 Jun 14 14:54:57.960271 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:54:57.960253 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b3c648_3a69_49fe_8902_497a1cd44d97.slice/crio-72f94b3bc196f2b5889485d7515f8930284c7949b527286fa2145f1dd6b9a0e8 WatchSource:0}: Error finding container 72f94b3bc196f2b5889485d7515f8930284c7949b527286fa2145f1dd6b9a0e8: Status 404 returned error can't find the container with id 72f94b3bc196f2b5889485d7515f8930284c7949b527286fa2145f1dd6b9a0e8 Jun 14 14:54:58.166568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.166487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:58.166568 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.166518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:54:58.166750 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:58.166629 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:54:58.166750 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:58.166629 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:54:58.166750 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:58.166688 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret podName:eb586a37-c589-4617-9967-804838c873b8 nodeName:}" failed. No retries permitted until 2026-06-14 14:54:59.166670988 +0000 UTC m=+3.055896367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret") pod "global-pull-secret-syncer-hrhnq" (UID: "eb586a37-c589-4617-9967-804838c873b8") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:54:58.166750 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:58.166705 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs podName:fa2d1037-187f-4b35-a752-59bfae3a464e nodeName:}" failed. No retries permitted until 2026-06-14 14:54:59.166695861 +0000 UTC m=+3.055921239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs") pod "network-metrics-daemon-9j2l2" (UID: "fa2d1037-187f-4b35-a752-59bfae3a464e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:54:58.267581 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.267547 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvm5l\" (UniqueName: \"kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l\") pod \"network-check-target-jnqxb\" (UID: \"a866bad3-7c32-4079-aeb6-40b04800c470\") " pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:54:58.267759 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:58.267744 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:54:58.267823 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:58.267766 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:54:58.267823 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:58.267780 2561 projected.go:196] Error preparing data for projected volume kube-api-access-kvm5l for pod openshift-network-diagnostics/network-check-target-jnqxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:54:58.267892 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:58.267837 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l podName:a866bad3-7c32-4079-aeb6-40b04800c470 nodeName:}" failed. No retries permitted until 2026-06-14 14:54:59.267818911 +0000 UTC m=+3.157044295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvm5l" (UniqueName: "kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l") pod "network-check-target-jnqxb" (UID: "a866bad3-7c32-4079-aeb6-40b04800c470") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:54:58.539594 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.539461 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:54:58.603481 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.603439 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:49:57 +0000 UTC" deadline="2028-02-03 10:58:13.502556712 +0000 UTC" Jun 14 14:54:58.603481 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.603480 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14372h3m14.899081683s" Jun 14 14:54:58.648748 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.648692 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" event={"ID":"e857945d-1621-4831-a695-4a057e309bbf","Type":"ContainerStarted","Data":"4cffc3cfbc01292f93eb3854201c67d8715fe2c5c8fddd8ed64fedd6fc109ee3"} Jun 14 14:54:58.674256 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.674222 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal" event={"ID":"8ceb315acd6d802f9b9d0b94fadd4ba4","Type":"ContainerStarted","Data":"9fa700e0bd0a952e7cbfba166c111473b3c8afcef911c1e41e02882987ff0bdd"} Jun 14 14:54:58.710969 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.710770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccg99" event={"ID":"20b3c648-3a69-49fe-8902-497a1cd44d97","Type":"ContainerStarted","Data":"72f94b3bc196f2b5889485d7515f8930284c7949b527286fa2145f1dd6b9a0e8"} Jun 14 14:54:58.732453 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.732398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qddgd" event={"ID":"a359273f-3646-4342-8e04-13ca25961257","Type":"ContainerStarted","Data":"c468373f7b961f27dbeac58330e6487ee33fd222672cccab7b6df4125ed42184"} Jun 14 14:54:58.753220 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.753165 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8pvk9" event={"ID":"547b5340-60ab-4196-8d72-bc9e6e3d67ad","Type":"ContainerStarted","Data":"e6a286e7c90b15f789ff4826b81d2687375e2411eefe6cbfa0a056e098f4adcc"} Jun 14 14:54:58.768331 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.768297 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" event={"ID":"18d2357f-e492-4696-ac06-bbcd4106f338","Type":"ContainerStarted","Data":"0922d290c06d170bb4eef938bf95ec1a198cbc6f9b253b592f3f333358079a40"} Jun 14 14:54:58.789431 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.789358 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" event={"ID":"957dd036-9848-4139-ae9b-00cf5f7f9ae3","Type":"ContainerStarted","Data":"943ea74359182919e06c5a1571997b91de9af3ceb1269b19568a1bd016161619"} Jun 14 14:54:58.812316 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.812034 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p59wq" event={"ID":"9721353a-571b-44da-86f9-498e489257f1","Type":"ContainerStarted","Data":"d69a333bffec81af4867c72e2ce03f576801ed11250f5264af83a83e360d9513"} Jun 14 14:54:58.832989 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.832949 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g7qbp" event={"ID":"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234","Type":"ContainerStarted","Data":"a898bc9f08fb7fba883ba5d7a02a0b00a028e5bb57f458d7908f047fdebb8932"} Jun 14 14:54:58.864247 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.864209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" event={"ID":"fcf380b108e952633937340e196633bc","Type":"ContainerStarted","Data":"2a7a7787c75f417218547ee99fee435ce0a9c4fe98081066dc38f5ea4a59c207"} Jun 14 14:54:58.883922 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:58.883832 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vt5jr" event={"ID":"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127","Type":"ContainerStarted","Data":"386a309ffa5a9ccffd3af16b83b6ff33106ccc461954ebc04c6aa0ff46690855"} Jun 14 14:54:59.119875 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:59.119786 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:54:59.174459 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:59.174396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:59.174459 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:59.174442 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:54:59.174712 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.174555 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:54:59.174712 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.174580 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:54:59.174712 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.174629 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret podName:eb586a37-c589-4617-9967-804838c873b8 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:01.174609802 +0000 UTC m=+5.063835187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret") pod "global-pull-secret-syncer-hrhnq" (UID: "eb586a37-c589-4617-9967-804838c873b8") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:54:59.174712 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.174652 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs podName:fa2d1037-187f-4b35-a752-59bfae3a464e nodeName:}" failed. No retries permitted until 2026-06-14 14:55:01.174642253 +0000 UTC m=+5.063867635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs") pod "network-metrics-daemon-9j2l2" (UID: "fa2d1037-187f-4b35-a752-59bfae3a464e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:54:59.274947 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:59.274911 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvm5l\" (UniqueName: \"kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l\") pod \"network-check-target-jnqxb\" (UID: \"a866bad3-7c32-4079-aeb6-40b04800c470\") " pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:54:59.275131 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.275113 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:54:59.275210 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.275134 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:54:59.275210 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.275146 2561 projected.go:196] Error preparing data for projected volume kube-api-access-kvm5l for pod openshift-network-diagnostics/network-check-target-jnqxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:54:59.275313 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.275250 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l podName:a866bad3-7c32-4079-aeb6-40b04800c470 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:01.275227531 +0000 UTC m=+5.164452924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvm5l" (UniqueName: "kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l") pod "network-check-target-jnqxb" (UID: "a866bad3-7c32-4079-aeb6-40b04800c470") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:54:59.603866 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:59.603755 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:49:57 +0000 UTC" deadline="2028-03-15 23:20:37.260617324 +0000 UTC" Jun 14 14:54:59.603866 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:59.603817 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15368h25m37.656804036s" Jun 14 14:54:59.621273 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:59.621247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:54:59.621424 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.621368 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:54:59.621794 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:59.621776 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:54:59.621895 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.621876 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:54:59.621955 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:59.621940 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:54:59.622026 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:54:59.622009 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:54:59.628486 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:54:59.628455 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:01.191590 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:01.191559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:01.192017 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:01.191602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:01.192017 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.191741 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:01.192017 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.191796 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs podName:fa2d1037-187f-4b35-a752-59bfae3a464e nodeName:}" failed. No retries permitted until 2026-06-14 14:55:05.191778298 +0000 UTC m=+9.081003689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs") pod "network-metrics-daemon-9j2l2" (UID: "fa2d1037-187f-4b35-a752-59bfae3a464e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:01.192218 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.192179 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:01.192292 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.192248 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret podName:eb586a37-c589-4617-9967-804838c873b8 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:05.192232444 +0000 UTC m=+9.081457825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret") pod "global-pull-secret-syncer-hrhnq" (UID: "eb586a37-c589-4617-9967-804838c873b8") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:01.292652 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:01.292616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvm5l\" (UniqueName: \"kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l\") pod \"network-check-target-jnqxb\" (UID: \"a866bad3-7c32-4079-aeb6-40b04800c470\") " pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:01.292813 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.292780 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:01.292813 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.292798 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:01.292813 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.292810 2561 projected.go:196] Error preparing data for projected volume kube-api-access-kvm5l for pod openshift-network-diagnostics/network-check-target-jnqxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:01.292977 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.292861 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l podName:a866bad3-7c32-4079-aeb6-40b04800c470 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:05.292845001 +0000 UTC m=+9.182070382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvm5l" (UniqueName: "kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l") pod "network-check-target-jnqxb" (UID: "a866bad3-7c32-4079-aeb6-40b04800c470") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:01.622410 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:01.621535 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:01.622410 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.621659 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:01.622410 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:01.622017 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:01.622410 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.622123 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:01.622410 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:01.622172 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:01.622410 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:01.622285 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:03.621663 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:03.621629 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:03.622112 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:03.621782 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:03.622112 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:03.621802 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:03.622112 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:03.621853 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:03.622112 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:03.621939 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:03.622112 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:03.622035 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:05.225181 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:05.225137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:05.225669 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:05.225211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:05.225669 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.225299 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:05.225669 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.225341 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:05.225669 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.225360 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret podName:eb586a37-c589-4617-9967-804838c873b8 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:13.22534241 +0000 UTC m=+17.114567791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret") pod "global-pull-secret-syncer-hrhnq" (UID: "eb586a37-c589-4617-9967-804838c873b8") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:05.225669 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.225378 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs podName:fa2d1037-187f-4b35-a752-59bfae3a464e nodeName:}" failed. No retries permitted until 2026-06-14 14:55:13.225366375 +0000 UTC m=+17.114591773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs") pod "network-metrics-daemon-9j2l2" (UID: "fa2d1037-187f-4b35-a752-59bfae3a464e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:05.326069 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:05.326037 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvm5l\" (UniqueName: \"kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l\") pod \"network-check-target-jnqxb\" (UID: \"a866bad3-7c32-4079-aeb6-40b04800c470\") " pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:05.326244 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.326161 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:05.326244 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.326179 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:05.326244 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.326208 2561 projected.go:196] Error preparing data for projected volume kube-api-access-kvm5l for pod openshift-network-diagnostics/network-check-target-jnqxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:05.326340 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.326258 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l podName:a866bad3-7c32-4079-aeb6-40b04800c470 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:13.326245948 +0000 UTC m=+17.215471330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvm5l" (UniqueName: "kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l") pod "network-check-target-jnqxb" (UID: "a866bad3-7c32-4079-aeb6-40b04800c470") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:05.621301 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:05.621220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:05.621301 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:05.621269 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:05.621519 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:05.621382 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:05.621519 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.621398 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:05.621519 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.621478 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:05.621648 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:05.621560 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:07.621092 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:07.621059 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:07.621618 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:07.621177 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:07.621618 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:07.621247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:07.621618 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:07.621332 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:07.621618 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:07.621375 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:07.621618 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:07.621441 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:09.621016 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:09.620973 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:09.621447 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:09.620975 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:09.621447 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:09.621083 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:09.621447 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:09.621103 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:09.621447 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:09.621206 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:09.621447 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:09.621280 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:11.621632 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:11.621572 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:11.621632 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:11.621611 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:11.622167 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:11.621611 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:11.622167 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:11.621697 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:11.622167 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:11.622077 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:11.622167 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:11.622159 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:13.282063 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:13.282017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:13.282527 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:13.282073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:13.282527 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.282171 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:13.282527 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.282178 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:13.282527 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.282260 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret podName:eb586a37-c589-4617-9967-804838c873b8 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:29.282245025 +0000 UTC m=+33.171470407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret") pod "global-pull-secret-syncer-hrhnq" (UID: "eb586a37-c589-4617-9967-804838c873b8") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:13.282527 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.282275 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs podName:fa2d1037-187f-4b35-a752-59bfae3a464e nodeName:}" failed. No retries permitted until 2026-06-14 14:55:29.282267814 +0000 UTC m=+33.171493192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs") pod "network-metrics-daemon-9j2l2" (UID: "fa2d1037-187f-4b35-a752-59bfae3a464e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:13.382570 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:13.382527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvm5l\" (UniqueName: \"kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l\") pod \"network-check-target-jnqxb\" (UID: \"a866bad3-7c32-4079-aeb6-40b04800c470\") " pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:13.382761 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.382709 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:13.382761 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.382734 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:13.382761 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.382746 2561 projected.go:196] Error preparing data for projected volume kube-api-access-kvm5l for pod openshift-network-diagnostics/network-check-target-jnqxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:13.382911 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.382814 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l podName:a866bad3-7c32-4079-aeb6-40b04800c470 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:29.382793867 +0000 UTC m=+33.272019248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvm5l" (UniqueName: "kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l") pod "network-check-target-jnqxb" (UID: "a866bad3-7c32-4079-aeb6-40b04800c470") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:13.621280 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:13.621211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:13.621402 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:13.621211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:13.621402 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.621309 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:13.621402 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:13.621211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:13.621505 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.621372 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:13.621505 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:13.621438 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:15.621094 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:15.621051 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:15.621094 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:15.621082 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:15.621586 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:15.621057 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:15.621586 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:15.621178 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:15.621586 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:15.621291 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:15.621586 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:15.621374 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:17.621733 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:17.621693 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:17.622166 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:17.621751 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:17.622166 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:17.621764 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:17.622166 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:17.621866 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:17.622166 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:17.621976 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:17.622166 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:17.622061 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:18.937076 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:18.937042 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g7qbp" event={"ID":"0fcb91a9-1fc2-4ef5-b7ca-1959bdc85234","Type":"ContainerStarted","Data":"6bd0080c6310aa01feef6e9d429f9f686c7ec8c4905511c38e1e6a9fdb735ab8"} Jun 14 14:55:18.938605 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:18.938579 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" event={"ID":"e857945d-1621-4831-a695-4a057e309bbf","Type":"ContainerStarted","Data":"27afd8304fbb8c4588912f47148d41915e26d408a32bbd0bc86671c15d002b18"} Jun 14 14:55:18.940223 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:18.940177 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal" event={"ID":"8ceb315acd6d802f9b9d0b94fadd4ba4","Type":"ContainerStarted","Data":"cbe5f31d16b157fecdfac22d277cffb620d6874bbddf20e605382da0b44fbf7a"} Jun 14 14:55:18.943361 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:18.943340 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" event={"ID":"18d2357f-e492-4696-ac06-bbcd4106f338","Type":"ContainerStarted","Data":"d8e699dc8ec41ac6a7cc2eab21feca446cdb1cf41538a99f8da6436812c50dcf"} Jun 14 14:55:18.954770 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:18.954729 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g7qbp" podStartSLOduration=2.498660714 podStartE2EDuration="22.954717001s" totalImagesPullingTime="20.456056287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:18.954423013 +0000 UTC m=+22.843648412" watchObservedRunningTime="2026-06-14 14:55:18.954717001 +0000 UTC m=+22.843942400" Jun 14 14:55:18.967354 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:18.967317 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-188.ec2.internal" podStartSLOduration=21.967306705 podStartE2EDuration="21.967306705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:18.96694323 +0000 UTC m=+22.856168630" watchObservedRunningTime="2026-06-14 14:55:18.967306705 +0000 UTC m=+22.856532106" Jun 14 14:55:18.983135 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:18.983090 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nhk8c" podStartSLOduration=2.577942578 podStartE2EDuration="22.983079795s" totalImagesPullingTime="20.405137217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:18.982455176 +0000 UTC m=+22.871680602" watchObservedRunningTime="2026-06-14 14:55:18.983079795 +0000 UTC m=+22.872305194" Jun 14 14:55:19.621555 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.621334 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:19.621721 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.621349 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:19.621721 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:19.621600 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:19.621721 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:19.621703 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:19.621826 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.621405 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:19.621826 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:19.621807 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:19.946700 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.946626 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p59wq" event={"ID":"9721353a-571b-44da-86f9-498e489257f1","Type":"ContainerStarted","Data":"0e7dc38e638331cb770c21791a20e8bf6fdd7cda10bad7f820ac62ffbdcd2deb"} Jun 14 14:55:19.948155 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.948130 2561 generic.go:356] "Generic (PLEG): container finished" podID="fcf380b108e952633937340e196633bc" containerID="1b1bc690b8345b0953ad9d0c3f3ab26b9b06aae6e49147a9e56ffb1fcef5f693" exitCode=0 Jun 14 14:55:19.948284 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.948223 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" event={"ID":"fcf380b108e952633937340e196633bc","Type":"ContainerDied","Data":"1b1bc690b8345b0953ad9d0c3f3ab26b9b06aae6e49147a9e56ffb1fcef5f693"} Jun 14 14:55:19.949595 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.949571 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vt5jr" event={"ID":"64c9f8a5-ea6c-4120-b6eb-0f6328d5d127","Type":"ContainerStarted","Data":"41f866fa573539df2f3345a3d6b5c93b2c9d468a774ea36d679ec6574b76e174"} Jun 14 14:55:19.951035 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.951015 2561 generic.go:356] "Generic (PLEG): container finished" podID="20b3c648-3a69-49fe-8902-497a1cd44d97" containerID="5898650b8cd7cd7a2ada84b9320af94e8fb46cb70f78f06e42798e1ebc0bbc62" exitCode=0 Jun 14 14:55:19.951120 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.951075 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccg99" event={"ID":"20b3c648-3a69-49fe-8902-497a1cd44d97","Type":"ContainerDied","Data":"5898650b8cd7cd7a2ada84b9320af94e8fb46cb70f78f06e42798e1ebc0bbc62"} Jun 14 14:55:19.952463 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.952445 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qddgd" event={"ID":"a359273f-3646-4342-8e04-13ca25961257","Type":"ContainerStarted","Data":"e6bdea0fb995ff4c3f190db5b4dd5c0bdfa5e3823d632b2f90deb955182c47d6"} Jun 14 14:55:19.953761 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.953735 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8pvk9" event={"ID":"547b5340-60ab-4196-8d72-bc9e6e3d67ad","Type":"ContainerStarted","Data":"5ffb889263002f18e301122c272e0d49b96ae73a329a06ad4f54bf33bd3dde7e"} Jun 14 14:55:19.956282 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.956262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 14:55:19.956689 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.956672 2561 generic.go:356] "Generic (PLEG): container finished" podID="18d2357f-e492-4696-ac06-bbcd4106f338" containerID="d820af17d5c0159464b95d7bfe2e109a69daf408437ad88a00e0bbcf5ecfbaaf" exitCode=1 Jun 14 14:55:19.956751 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.956736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" event={"ID":"18d2357f-e492-4696-ac06-bbcd4106f338","Type":"ContainerStarted","Data":"1700857d34bbd3a5cb27d0860b1be9788235e5a57a58174d249e95d62312d95a"} Jun 14 14:55:19.956799 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.956784 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" event={"ID":"18d2357f-e492-4696-ac06-bbcd4106f338","Type":"ContainerStarted","Data":"9646359bc8d6cc0260483682f691d88c6099366ea6ffcb000d835662e12640d5"} Jun 14 14:55:19.956849 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.956815 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" event={"ID":"18d2357f-e492-4696-ac06-bbcd4106f338","Type":"ContainerStarted","Data":"d00c7f5e01926666df99396109c804e87a042aad890367b770bac82d0f8a85ee"} Jun 14 14:55:19.956887 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.956851 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" event={"ID":"18d2357f-e492-4696-ac06-bbcd4106f338","Type":"ContainerStarted","Data":"89c3d1cee821de85061d5a737af5ffd6c28eb1cc6fe31bff4465381de572b7dc"} Jun 14 14:55:19.956942 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.956924 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" event={"ID":"18d2357f-e492-4696-ac06-bbcd4106f338","Type":"ContainerDied","Data":"d820af17d5c0159464b95d7bfe2e109a69daf408437ad88a00e0bbcf5ecfbaaf"} Jun 14 14:55:19.958093 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.958068 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" event={"ID":"957dd036-9848-4139-ae9b-00cf5f7f9ae3","Type":"ContainerStarted","Data":"51bd64d8d82396f686f4f13be2ea4386ffde44991b3f4a8e3fc9b54d81ed9171"} Jun 14 14:55:19.960234 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.960177 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p59wq" podStartSLOduration=3.575697398 podStartE2EDuration="23.960162188s" totalImagesPullingTime="20.38446479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:19.960057826 +0000 UTC m=+23.849283232" watchObservedRunningTime="2026-06-14 14:55:19.960162188 +0000 UTC m=+23.849387588" Jun 14 14:55:19.996143 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:19.996105 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qddgd" podStartSLOduration=2.667168528 podStartE2EDuration="22.996089582s" totalImagesPullingTime="20.328921054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:19.973897219 +0000 UTC m=+23.863122621" watchObservedRunningTime="2026-06-14 14:55:19.996089582 +0000 UTC m=+23.885314984" Jun 14 14:55:20.011225 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:20.011166 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vt5jr" podStartSLOduration=8.121697852 podStartE2EDuration="24.011154178s" totalImagesPullingTime="15.889456326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:20.01069876 +0000 UTC m=+23.899924162" watchObservedRunningTime="2026-06-14 14:55:20.011154178 +0000 UTC m=+23.900379602" Jun 14 14:55:20.066620 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:20.066582 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8pvk9" podStartSLOduration=2.7214677800000002 podStartE2EDuration="23.066569372s" totalImagesPullingTime="20.345101592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:20.041606364 +0000 UTC m=+23.930831763" watchObservedRunningTime="2026-06-14 14:55:20.066569372 +0000 UTC m=+23.955794772" Jun 14 14:55:20.963210 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:20.963163 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" event={"ID":"fcf380b108e952633937340e196633bc","Type":"ContainerStarted","Data":"b2e4cd717def85dac7d66b2e78096763bf4834c3a3b741c093052b8e669fe52d"} Jun 14 14:55:20.976837 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:20.976796 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-188.ec2.internal" podStartSLOduration=23.976781349 podStartE2EDuration="23.976781349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:20.976612709 +0000 UTC m=+24.865838109" watchObservedRunningTime="2026-06-14 14:55:20.976781349 +0000 UTC m=+24.866006749" Jun 14 14:55:21.040025 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.040002 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 14:55:21.126998 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.126813 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:55:21.127499 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.127481 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:55:21.621271 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.621241 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:21.621271 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.621272 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:21.621480 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.621244 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:21.621480 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:21.621366 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:21.621480 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:21.621448 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:21.621480 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.621413 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T14:55:21.040019819Z","UUID":"756ad080-f3e7-4bd1-84da-4349b23b54d1","Handler":null,"Name":"","Endpoint":""} Jun 14 14:55:21.621629 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:21.621547 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:21.623204 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.623167 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 14:55:21.623323 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.623232 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 14:55:21.973326 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.973257 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 14:55:21.973828 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.973680 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" event={"ID":"18d2357f-e492-4696-ac06-bbcd4106f338","Type":"ContainerStarted","Data":"9f9fb31e8cc44cba18a912ce4ab16ac769d114e215dde81d311b45ca049fee7e"} Jun 14 14:55:21.975623 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:21.975593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" event={"ID":"957dd036-9848-4139-ae9b-00cf5f7f9ae3","Type":"ContainerStarted","Data":"05bffb64df9ceb202dea66764f561099b253e9d7774641928091297c8fc5014f"} Jun 14 14:55:22.980427 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:22.980361 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 14 14:55:22.980427 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:22.980362 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" event={"ID":"957dd036-9848-4139-ae9b-00cf5f7f9ae3","Type":"ContainerStarted","Data":"dad9d2590564bad9a1228c65a3b98d59bcd2a838cec5857f9f1f54094ffa54fa"} Jun 14 14:55:23.000615 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:23.000565 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bzws6" podStartSLOduration=4.286196058 podStartE2EDuration="27.000548207s" totalImagesPullingTime="22.714352149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:23.000014699 +0000 UTC m=+26.889240127" watchObservedRunningTime="2026-06-14 14:55:23.000548207 +0000 UTC m=+26.889773609" Jun 14 14:55:23.620933 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:23.620897 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:23.621119 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:23.620943 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:23.621119 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:23.621021 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:23.621119 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:23.620901 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:23.621309 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:23.621127 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:23.621309 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:23.621253 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:24.987500 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:24.987337 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 14:55:24.987984 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:24.987848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" event={"ID":"18d2357f-e492-4696-ac06-bbcd4106f338","Type":"ContainerStarted","Data":"4b2089a90efa17957eb8293dd8c2e4b1af1e57278b47f7dda2d7016ffb09dd27"} Jun 14 14:55:24.988128 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:24.988108 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:55:24.988291 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:24.988263 2561 scope.go:117] "RemoveContainer" containerID="d820af17d5c0159464b95d7bfe2e109a69daf408437ad88a00e0bbcf5ecfbaaf" Jun 14 14:55:25.003930 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:25.003863 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:55:25.621085 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:25.621054 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:25.621265 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:25.621054 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:25.621265 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:25.621059 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:25.621335 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:25.621260 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:25.621374 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:25.621335 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:25.621374 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:25.621148 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:25.991902 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:25.991825 2561 generic.go:356] "Generic (PLEG): container finished" podID="20b3c648-3a69-49fe-8902-497a1cd44d97" containerID="c91207ae8bd7b8df540fa77a9e40a26289b293391670af2e47c35f40dc21ff4b" exitCode=0 Jun 14 14:55:25.992495 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:25.991916 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccg99" event={"ID":"20b3c648-3a69-49fe-8902-497a1cd44d97","Type":"ContainerDied","Data":"c91207ae8bd7b8df540fa77a9e40a26289b293391670af2e47c35f40dc21ff4b"} Jun 14 14:55:26.004268 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.004247 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 14:55:26.005206 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.005152 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" event={"ID":"18d2357f-e492-4696-ac06-bbcd4106f338","Type":"ContainerStarted","Data":"91e97494118b0e5bb7dc4018662b2bad21593a4de8c23745f5ea7e5f7b3d10e9"} Jun 14 14:55:26.005483 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.005467 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:55:26.005584 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.005565 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:55:26.023675 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.023633 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:55:26.039593 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.039526 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" podStartSLOduration=9.148035014 podStartE2EDuration="30.039510359s" totalImagesPullingTime="20.891475345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:26.038705483 +0000 UTC m=+29.927930885" watchObservedRunningTime="2026-06-14 14:55:26.039510359 +0000 UTC m=+29.928735758" Jun 14 14:55:26.771665 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.771629 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrhnq"] Jun 14 14:55:26.771840 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.771803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:26.771974 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:26.771942 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:26.774581 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.774553 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9j2l2"] Jun 14 14:55:26.774705 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.774668 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:26.774811 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:26.774788 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:26.775180 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.775155 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jnqxb"] Jun 14 14:55:26.775290 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:26.775271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:26.775378 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:26.775358 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:27.340297 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:27.340222 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:55:27.340675 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:27.340335 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 14 14:55:27.340877 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:27.340857 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8pvk9" Jun 14 14:55:28.010978 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:28.010943 2561 generic.go:356] "Generic (PLEG): container finished" podID="20b3c648-3a69-49fe-8902-497a1cd44d97" containerID="08f27dcf446fe355e42bde5084e2395ce706825d2736f4f8d2ab62fd6d2f5402" exitCode=0 Jun 14 14:55:28.011139 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:28.011035 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccg99" event={"ID":"20b3c648-3a69-49fe-8902-497a1cd44d97","Type":"ContainerDied","Data":"08f27dcf446fe355e42bde5084e2395ce706825d2736f4f8d2ab62fd6d2f5402"} Jun 14 14:55:28.620686 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:28.620655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:28.621230 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:28.620655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:28.621230 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:28.620856 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:28.621230 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:28.620756 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:28.621230 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:28.620890 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:28.621230 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:28.620948 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:29.302529 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:29.302505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:29.302632 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:29.302538 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:29.302673 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:29.302635 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:29.302673 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:29.302642 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:29.302751 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:29.302683 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs podName:fa2d1037-187f-4b35-a752-59bfae3a464e nodeName:}" failed. No retries permitted until 2026-06-14 14:56:01.302667586 +0000 UTC m=+65.191892971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs") pod "network-metrics-daemon-9j2l2" (UID: "fa2d1037-187f-4b35-a752-59bfae3a464e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:29.302751 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:29.302702 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret podName:eb586a37-c589-4617-9967-804838c873b8 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:01.30268986 +0000 UTC m=+65.191915239 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret") pod "global-pull-secret-syncer-hrhnq" (UID: "eb586a37-c589-4617-9967-804838c873b8") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:29.403004 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:29.402975 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvm5l\" (UniqueName: \"kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l\") pod \"network-check-target-jnqxb\" (UID: \"a866bad3-7c32-4079-aeb6-40b04800c470\") " pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:29.403157 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:29.403096 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:29.403157 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:29.403113 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:29.403157 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:29.403122 2561 projected.go:196] Error preparing data for projected volume kube-api-access-kvm5l for pod openshift-network-diagnostics/network-check-target-jnqxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:29.403327 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:29.403172 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l podName:a866bad3-7c32-4079-aeb6-40b04800c470 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:01.403156803 +0000 UTC m=+65.292382186 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvm5l" (UniqueName: "kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l") pod "network-check-target-jnqxb" (UID: "a866bad3-7c32-4079-aeb6-40b04800c470") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:30.020111 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:30.020080 2561 generic.go:356] "Generic (PLEG): container finished" podID="20b3c648-3a69-49fe-8902-497a1cd44d97" containerID="650f839a404da14fd7a05bcaae569507dbc9eacf331a5cb5499c0ad763439497" exitCode=0 Jun 14 14:55:30.020674 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:30.020142 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccg99" event={"ID":"20b3c648-3a69-49fe-8902-497a1cd44d97","Type":"ContainerDied","Data":"650f839a404da14fd7a05bcaae569507dbc9eacf331a5cb5499c0ad763439497"} Jun 14 14:55:30.621141 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:30.621109 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:30.621340 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:30.621148 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:30.621340 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:30.621122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:30.621340 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:30.621233 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhnq" podUID="eb586a37-c589-4617-9967-804838c873b8" Jun 14 14:55:30.621340 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:30.621301 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jnqxb" podUID="a866bad3-7c32-4079-aeb6-40b04800c470" Jun 14 14:55:30.621489 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:30.621378 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:55:31.471483 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.471416 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-188.ec2.internal" event="NodeReady" Jun 14 14:55:31.471955 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.471536 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 14:55:31.503710 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.503680 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn"] Jun 14 14:55:31.507570 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.507534 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t"] Jun 14 14:55:31.507736 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.507684 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" Jun 14 14:55:31.510301 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.510278 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pkpvn\"" Jun 14 14:55:31.510647 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.510524 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 14:55:31.510771 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.510545 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 14:55:31.510840 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.510575 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 14:55:31.510840 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.510734 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 14 14:55:31.512351 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.512332 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h"] Jun 14 14:55:31.512472 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.512456 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.516184 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.516163 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 14 14:55:31.518842 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.518822 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69695b579c-db45k"] Jun 14 14:55:31.518960 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.518886 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.523145 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.522780 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 14 14:55:31.523145 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.522933 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 14 14:55:31.523145 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.522999 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 14 14:55:31.523145 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.523051 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 14 14:55:31.525549 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.525526 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4spxt"] Jun 14 14:55:31.526330 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.526311 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.528774 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.528749 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 14:55:31.528934 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.528914 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rvf4d\"" Jun 14 14:55:31.529050 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.528975 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 14:55:31.529050 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.529023 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 14:55:31.529430 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.529411 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn"] Jun 14 14:55:31.529523 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.529443 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cvld6"] Jun 14 14:55:31.529816 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.529642 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.533060 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.532939 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 14:55:31.533060 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.532959 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4p4qh\"" Jun 14 14:55:31.533060 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.532964 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 14:55:31.533060 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.533023 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t"] Jun 14 14:55:31.533060 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.533052 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h"] Jun 14 14:55:31.533376 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.533077 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69695b579c-db45k"] Jun 14 14:55:31.533376 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.533155 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cvld6" Jun 14 14:55:31.535589 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.534688 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 14:55:31.535780 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.535763 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 14:55:31.536034 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.536018 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8bswm\"" Jun 14 14:55:31.536245 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.536182 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 14:55:31.536323 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.536245 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 14:55:31.539880 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.539796 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cvld6"] Jun 14 14:55:31.540674 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.540658 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4spxt"] Jun 14 14:55:31.619430 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.619555 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-certificates\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.619555 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-installation-pull-secrets\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.619555 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-bound-sa-token\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.619555 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxkcg\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-kube-api-access-sxkcg\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.619764 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhssq\" (UniqueName: \"kubernetes.io/projected/31f5b369-91e9-4390-aa06-da598738aa47-kube-api-access-zhssq\") pod \"ingress-canary-cvld6\" (UID: \"31f5b369-91e9-4390-aa06-da598738aa47\") " pod="openshift-ingress-canary/ingress-canary-cvld6" Jun 14 14:55:31.619764 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619618 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1f23f3-fbe0-4932-925d-f256589ccd55-ca-trust-extracted\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.619764 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1dcbc43a-e548-4d65-85ee-e8f34cf7ff52-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn\" (UID: \"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" Jun 14 14:55:31.619764 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvv72\" (UniqueName: \"kubernetes.io/projected/7ae1ef33-0522-491d-a39f-3028d3aa098c-kube-api-access-kvv72\") pod \"klusterlet-addon-workmgr-d456f4cd9-xgx6t\" (UID: \"7ae1ef33-0522-491d-a39f-3028d3aa098c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.619764 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-ca\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.619764 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619757 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4htq\" (UniqueName: \"kubernetes.io/projected/1dcbc43a-e548-4d65-85ee-e8f34cf7ff52-kube-api-access-c4htq\") pod \"managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn\" (UID: \"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" Jun 14 14:55:31.620025 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-image-registry-private-configuration\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.620025 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619809 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.620025 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq468\" (UniqueName: \"kubernetes.io/projected/42f499f6-f899-4b19-b75a-81851ac7f194-kube-api-access-fq468\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.620025 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.620025 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9f9b652-481b-4434-94b5-da0ff0cfcafc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.620025 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31f5b369-91e9-4390-aa06-da598738aa47-cert\") pod \"ingress-canary-cvld6\" (UID: \"31f5b369-91e9-4390-aa06-da598738aa47\") " pod="openshift-ingress-canary/ingress-canary-cvld6" Jun 14 14:55:31.620025 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.619994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f499f6-f899-4b19-b75a-81851ac7f194-tmp-dir\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.620025 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.620012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42f499f6-f899-4b19-b75a-81851ac7f194-config-volume\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.620379 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.620031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-trusted-ca\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.620379 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.620100 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-hub\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.620379 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.620134 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.620379 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.620158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzprq\" (UniqueName: \"kubernetes.io/projected/d9f9b652-481b-4434-94b5-da0ff0cfcafc-kube-api-access-xzprq\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.620379 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.620207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ae1ef33-0522-491d-a39f-3028d3aa098c-tmp\") pod \"klusterlet-addon-workmgr-d456f4cd9-xgx6t\" (UID: \"7ae1ef33-0522-491d-a39f-3028d3aa098c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.620379 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.620232 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ae1ef33-0522-491d-a39f-3028d3aa098c-klusterlet-config\") pod \"klusterlet-addon-workmgr-d456f4cd9-xgx6t\" (UID: \"7ae1ef33-0522-491d-a39f-3028d3aa098c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.720929 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.720712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxkcg\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-kube-api-access-sxkcg\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.721082 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.720940 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhssq\" (UniqueName: \"kubernetes.io/projected/31f5b369-91e9-4390-aa06-da598738aa47-kube-api-access-zhssq\") pod \"ingress-canary-cvld6\" (UID: \"31f5b369-91e9-4390-aa06-da598738aa47\") " pod="openshift-ingress-canary/ingress-canary-cvld6" Jun 14 14:55:31.721082 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.720974 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1f23f3-fbe0-4932-925d-f256589ccd55-ca-trust-extracted\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.721082 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.720998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1dcbc43a-e548-4d65-85ee-e8f34cf7ff52-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn\" (UID: \"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" Jun 14 14:55:31.721082 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721028 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvv72\" (UniqueName: \"kubernetes.io/projected/7ae1ef33-0522-491d-a39f-3028d3aa098c-kube-api-access-kvv72\") pod \"klusterlet-addon-workmgr-d456f4cd9-xgx6t\" (UID: \"7ae1ef33-0522-491d-a39f-3028d3aa098c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.721082 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-ca\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.721306 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4htq\" (UniqueName: \"kubernetes.io/projected/1dcbc43a-e548-4d65-85ee-e8f34cf7ff52-kube-api-access-c4htq\") pod \"managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn\" (UID: \"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" Jun 14 14:55:31.721306 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721115 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-image-registry-private-configuration\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.721306 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.721306 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721153 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq468\" (UniqueName: \"kubernetes.io/projected/42f499f6-f899-4b19-b75a-81851ac7f194-kube-api-access-fq468\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.721306 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.721306 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721236 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9f9b652-481b-4434-94b5-da0ff0cfcafc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.721306 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31f5b369-91e9-4390-aa06-da598738aa47-cert\") pod \"ingress-canary-cvld6\" (UID: \"31f5b369-91e9-4390-aa06-da598738aa47\") " pod="openshift-ingress-canary/ingress-canary-cvld6" Jun 14 14:55:31.721306 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f499f6-f899-4b19-b75a-81851ac7f194-tmp-dir\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.721306 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721295 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42f499f6-f899-4b19-b75a-81851ac7f194-config-volume\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.721755 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-trusted-ca\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.721755 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-hub\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.721755 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.721755 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzprq\" (UniqueName: \"kubernetes.io/projected/d9f9b652-481b-4434-94b5-da0ff0cfcafc-kube-api-access-xzprq\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.721755 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721420 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ae1ef33-0522-491d-a39f-3028d3aa098c-tmp\") pod \"klusterlet-addon-workmgr-d456f4cd9-xgx6t\" (UID: \"7ae1ef33-0522-491d-a39f-3028d3aa098c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.721755 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ae1ef33-0522-491d-a39f-3028d3aa098c-klusterlet-config\") pod \"klusterlet-addon-workmgr-d456f4cd9-xgx6t\" (UID: \"7ae1ef33-0522-491d-a39f-3028d3aa098c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.721755 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.721755 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721493 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-certificates\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.721755 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721515 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-installation-pull-secrets\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.721755 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.721534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-bound-sa-token\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.722138 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.722108 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1f23f3-fbe0-4932-925d-f256589ccd55-ca-trust-extracted\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.722439 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.722411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42f499f6-f899-4b19-b75a-81851ac7f194-config-volume\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.722542 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:31.722526 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:55:31.722579 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:31.722548 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69695b579c-db45k: secret "image-registry-tls" not found Jun 14 14:55:31.722635 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:31.722612 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls podName:ce1f23f3-fbe0-4932-925d-f256589ccd55 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:32.222593498 +0000 UTC m=+36.111818879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls") pod "image-registry-69695b579c-db45k" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55") : secret "image-registry-tls" not found Jun 14 14:55:31.723179 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.723154 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-trusted-ca\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.723536 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.723391 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ae1ef33-0522-491d-a39f-3028d3aa098c-tmp\") pod \"klusterlet-addon-workmgr-d456f4cd9-xgx6t\" (UID: \"7ae1ef33-0522-491d-a39f-3028d3aa098c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.723536 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.723518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42f499f6-f899-4b19-b75a-81851ac7f194-tmp-dir\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.723690 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.723547 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9f9b652-481b-4434-94b5-da0ff0cfcafc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.724622 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:31.723921 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:31.724622 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:31.723985 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls podName:42f499f6-f899-4b19-b75a-81851ac7f194 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:32.223966566 +0000 UTC m=+36.113191949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls") pod "dns-default-4spxt" (UID: "42f499f6-f899-4b19-b75a-81851ac7f194") : secret "dns-default-metrics-tls" not found Jun 14 14:55:31.724622 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.724581 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-certificates\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.727146 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.727120 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1dcbc43a-e548-4d65-85ee-e8f34cf7ff52-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn\" (UID: \"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" Jun 14 14:55:31.727788 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.727658 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-image-registry-private-configuration\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.727788 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.727774 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ae1ef33-0522-491d-a39f-3028d3aa098c-klusterlet-config\") pod \"klusterlet-addon-workmgr-d456f4cd9-xgx6t\" (UID: \"7ae1ef33-0522-491d-a39f-3028d3aa098c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.728059 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.728033 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31f5b369-91e9-4390-aa06-da598738aa47-cert\") pod \"ingress-canary-cvld6\" (UID: \"31f5b369-91e9-4390-aa06-da598738aa47\") " pod="openshift-ingress-canary/ingress-canary-cvld6" Jun 14 14:55:31.729235 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.728173 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.729235 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.728509 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-ca\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.729235 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.728815 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-installation-pull-secrets\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.729235 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.729079 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-hub\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.729902 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.729810 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9f9b652-481b-4434-94b5-da0ff0cfcafc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.730905 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.730882 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxkcg\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-kube-api-access-sxkcg\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.731007 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.730937 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq468\" (UniqueName: \"kubernetes.io/projected/42f499f6-f899-4b19-b75a-81851ac7f194-kube-api-access-fq468\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:31.731066 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.731034 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhssq\" (UniqueName: \"kubernetes.io/projected/31f5b369-91e9-4390-aa06-da598738aa47-kube-api-access-zhssq\") pod \"ingress-canary-cvld6\" (UID: \"31f5b369-91e9-4390-aa06-da598738aa47\") " pod="openshift-ingress-canary/ingress-canary-cvld6" Jun 14 14:55:31.731725 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.731701 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvv72\" (UniqueName: \"kubernetes.io/projected/7ae1ef33-0522-491d-a39f-3028d3aa098c-kube-api-access-kvv72\") pod \"klusterlet-addon-workmgr-d456f4cd9-xgx6t\" (UID: \"7ae1ef33-0522-491d-a39f-3028d3aa098c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.731875 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.731832 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4htq\" (UniqueName: \"kubernetes.io/projected/1dcbc43a-e548-4d65-85ee-e8f34cf7ff52-kube-api-access-c4htq\") pod \"managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn\" (UID: \"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" Jun 14 14:55:31.732358 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.732328 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-bound-sa-token\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:31.732469 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.732370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzprq\" (UniqueName: \"kubernetes.io/projected/d9f9b652-481b-4434-94b5-da0ff0cfcafc-kube-api-access-xzprq\") pod \"cluster-proxy-proxy-agent-558c89f596-9pf8h\" (UID: \"d9f9b652-481b-4434-94b5-da0ff0cfcafc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.831305 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.831260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" Jun 14 14:55:31.838286 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.838261 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:31.846214 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.846177 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:55:31.877842 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:31.877803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cvld6" Jun 14 14:55:32.024747 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.024708 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn"] Jun 14 14:55:32.031647 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:55:32.031607 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dcbc43a_e548_4d65_85ee_e8f34cf7ff52.slice/crio-297051cf72f35bf3b986b0299bfb90466c55ad60aac116fd8b4e66f985cc79d8 WatchSource:0}: Error finding container 297051cf72f35bf3b986b0299bfb90466c55ad60aac116fd8b4e66f985cc79d8: Status 404 returned error can't find the container with id 297051cf72f35bf3b986b0299bfb90466c55ad60aac116fd8b4e66f985cc79d8 Jun 14 14:55:32.032993 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.032935 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t"] Jun 14 14:55:32.035836 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:55:32.035795 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae1ef33_0522_491d_a39f_3028d3aa098c.slice/crio-30c00f721a7634bf73e306f331f8de6b3fd00706e9c818869e4aacf6ab421905 WatchSource:0}: Error finding container 30c00f721a7634bf73e306f331f8de6b3fd00706e9c818869e4aacf6ab421905: Status 404 returned error can't find the container with id 30c00f721a7634bf73e306f331f8de6b3fd00706e9c818869e4aacf6ab421905 Jun 14 14:55:32.037708 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.037677 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h"] Jun 14 14:55:32.040757 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:55:32.040737 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9f9b652_481b_4434_94b5_da0ff0cfcafc.slice/crio-345c2f317bad20d6facd75719ad3899f65c8b7572c05045e40d0f0289f2afd60 WatchSource:0}: Error finding container 345c2f317bad20d6facd75719ad3899f65c8b7572c05045e40d0f0289f2afd60: Status 404 returned error can't find the container with id 345c2f317bad20d6facd75719ad3899f65c8b7572c05045e40d0f0289f2afd60 Jun 14 14:55:32.055896 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.055873 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cvld6"] Jun 14 14:55:32.059048 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:55:32.059028 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f5b369_91e9_4390_aa06_da598738aa47.slice/crio-5f0bcd874531dc4a3f862e1dd490e1940fea55dda297e23a862f959e9ac4adb4 WatchSource:0}: Error finding container 5f0bcd874531dc4a3f862e1dd490e1940fea55dda297e23a862f959e9ac4adb4: Status 404 returned error can't find the container with id 5f0bcd874531dc4a3f862e1dd490e1940fea55dda297e23a862f959e9ac4adb4 Jun 14 14:55:32.225620 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.225584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:32.225753 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.225630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:32.225753 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:32.225722 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:55:32.225753 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:32.225732 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69695b579c-db45k: secret "image-registry-tls" not found Jun 14 14:55:32.225753 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:32.225729 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:32.225879 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:32.225783 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls podName:ce1f23f3-fbe0-4932-925d-f256589ccd55 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:33.22577 +0000 UTC m=+37.114995382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls") pod "image-registry-69695b579c-db45k" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55") : secret "image-registry-tls" not found Jun 14 14:55:32.225879 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:32.225794 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls podName:42f499f6-f899-4b19-b75a-81851ac7f194 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:33.225789032 +0000 UTC m=+37.115014409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls") pod "dns-default-4spxt" (UID: "42f499f6-f899-4b19-b75a-81851ac7f194") : secret "dns-default-metrics-tls" not found Jun 14 14:55:32.620911 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.620869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:55:32.621445 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.621340 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:55:32.621660 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.621645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:55:32.624859 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.624281 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:55:32.624859 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.624329 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zrcbh\"" Jun 14 14:55:32.624859 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.624286 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:55:32.624859 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.624632 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:55:32.627131 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.625706 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:55:32.627131 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:32.625938 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4zq9\"" Jun 14 14:55:33.036046 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:33.035961 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" event={"ID":"d9f9b652-481b-4434-94b5-da0ff0cfcafc","Type":"ContainerStarted","Data":"345c2f317bad20d6facd75719ad3899f65c8b7572c05045e40d0f0289f2afd60"} Jun 14 14:55:33.037538 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:33.037509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cvld6" event={"ID":"31f5b369-91e9-4390-aa06-da598738aa47","Type":"ContainerStarted","Data":"5f0bcd874531dc4a3f862e1dd490e1940fea55dda297e23a862f959e9ac4adb4"} Jun 14 14:55:33.044868 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:33.044840 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" event={"ID":"7ae1ef33-0522-491d-a39f-3028d3aa098c","Type":"ContainerStarted","Data":"30c00f721a7634bf73e306f331f8de6b3fd00706e9c818869e4aacf6ab421905"} Jun 14 14:55:33.049658 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:33.049634 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" event={"ID":"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52","Type":"ContainerStarted","Data":"297051cf72f35bf3b986b0299bfb90466c55ad60aac116fd8b4e66f985cc79d8"} Jun 14 14:55:33.234212 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:33.233862 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:33.234212 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:33.233991 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:33.234212 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:33.234033 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:55:33.234212 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:33.234055 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69695b579c-db45k: secret "image-registry-tls" not found Jun 14 14:55:33.234212 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:33.234103 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls podName:ce1f23f3-fbe0-4932-925d-f256589ccd55 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:35.234089529 +0000 UTC m=+39.123314908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls") pod "image-registry-69695b579c-db45k" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55") : secret "image-registry-tls" not found Jun 14 14:55:33.234212 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:33.234116 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:33.234212 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:33.234165 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls podName:42f499f6-f899-4b19-b75a-81851ac7f194 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:35.234150269 +0000 UTC m=+39.123375658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls") pod "dns-default-4spxt" (UID: "42f499f6-f899-4b19-b75a-81851ac7f194") : secret "dns-default-metrics-tls" not found Jun 14 14:55:33.578541 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:33.578498 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:33.663102 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:33.663014 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:33.767811 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:33.767769 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:35.252894 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:35.252856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:35.253325 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:35.252927 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:35.253325 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:35.253005 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:35.253325 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:35.253064 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:55:35.253325 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:35.253085 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls podName:42f499f6-f899-4b19-b75a-81851ac7f194 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:39.253049602 +0000 UTC m=+43.142274981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls") pod "dns-default-4spxt" (UID: "42f499f6-f899-4b19-b75a-81851ac7f194") : secret "dns-default-metrics-tls" not found Jun 14 14:55:35.253325 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:35.253084 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69695b579c-db45k: secret "image-registry-tls" not found Jun 14 14:55:35.253325 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:35.253123 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls podName:ce1f23f3-fbe0-4932-925d-f256589ccd55 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:39.253113527 +0000 UTC m=+43.142338906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls") pod "image-registry-69695b579c-db45k" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55") : secret "image-registry-tls" not found Jun 14 14:55:36.126852 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:36.126818 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:39.288780 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:39.288749 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:39.289224 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:39.288793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:39.289224 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:39.288898 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:39.289224 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:39.288901 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:55:39.289224 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:39.288918 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69695b579c-db45k: secret "image-registry-tls" not found Jun 14 14:55:39.289224 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:39.288962 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls podName:ce1f23f3-fbe0-4932-925d-f256589ccd55 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:47.288945667 +0000 UTC m=+51.178171052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls") pod "image-registry-69695b579c-db45k" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55") : secret "image-registry-tls" not found Jun 14 14:55:39.289224 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:39.288978 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls podName:42f499f6-f899-4b19-b75a-81851ac7f194 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:47.288968971 +0000 UTC m=+51.178194349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls") pod "dns-default-4spxt" (UID: "42f499f6-f899-4b19-b75a-81851ac7f194") : secret "dns-default-metrics-tls" not found Jun 14 14:55:41.186977 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:41.186941 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:41.237349 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:41.237314 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:42.249484 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:42.249459 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:42.303529 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:42.303468 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:43.079204 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.079156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cvld6" event={"ID":"31f5b369-91e9-4390-aa06-da598738aa47","Type":"ContainerStarted","Data":"15c54eccd3f0f11c963232a96b4e16fb304813fc6b6ec9be58c7a7acd8680ba3"} Jun 14 14:55:43.080580 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.080554 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" event={"ID":"7ae1ef33-0522-491d-a39f-3028d3aa098c","Type":"ContainerStarted","Data":"8cbbaed73870287a77455525cf6cece4ce661fad0dd0a8d11bae0b28c89157f2"} Jun 14 14:55:43.080727 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.080709 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:43.082414 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.082019 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" event={"ID":"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52","Type":"ContainerStarted","Data":"e438679d81f8275a58089eeee9b3369a51e8f24d787ce49f8da5b6c30eb26173"} Jun 14 14:55:43.082664 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.082645 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:55:43.084797 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.084772 2561 generic.go:356] "Generic (PLEG): container finished" podID="20b3c648-3a69-49fe-8902-497a1cd44d97" containerID="e94a0aaf1b78d8f77eacbe64d60c5268d976398bb97f29e2358256c606f6cb7a" exitCode=0 Jun 14 14:55:43.084864 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.084846 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccg99" event={"ID":"20b3c648-3a69-49fe-8902-497a1cd44d97","Type":"ContainerDied","Data":"e94a0aaf1b78d8f77eacbe64d60c5268d976398bb97f29e2358256c606f6cb7a"} Jun 14 14:55:43.086764 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.086747 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" event={"ID":"d9f9b652-481b-4434-94b5-da0ff0cfcafc","Type":"ContainerStarted","Data":"aa3423a32a68d799c40aa07623957aa10a252ba3848bc7f62d7b79621f2fb7c6"} Jun 14 14:55:43.086840 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.086775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" event={"ID":"d9f9b652-481b-4434-94b5-da0ff0cfcafc","Type":"ContainerStarted","Data":"6acffd4b2c3bd46523fe31bcdd81e638f6d572aa1c2509e0a35a1cd1ef0032dc"} Jun 14 14:55:43.086840 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.086787 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" event={"ID":"d9f9b652-481b-4434-94b5-da0ff0cfcafc","Type":"ContainerStarted","Data":"171331837adc9194db26f971fd8fcaaaf31d7e967c3f65f90fea1ad16a04f752"} Jun 14 14:55:43.095055 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.094996 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cvld6" podStartSLOduration=1.9615747890000002 podStartE2EDuration="12.094977592s" totalImagesPullingTime="10.133402803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:43.09333936 +0000 UTC m=+46.982564762" watchObservedRunningTime="2026-06-14 14:55:43.094977592 +0000 UTC m=+46.984202994" Jun 14 14:55:43.106727 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.106685 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" podStartSLOduration=11.928137631 podStartE2EDuration="22.106668869s" totalImagesPullingTime="10.178531238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:43.10626942 +0000 UTC m=+46.995494821" watchObservedRunningTime="2026-06-14 14:55:43.106668869 +0000 UTC m=+46.995894270" Jun 14 14:55:43.144974 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.144911 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" podStartSLOduration=11.988678947 podStartE2EDuration="22.144893767s" totalImagesPullingTime="10.15621482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:43.124802583 +0000 UTC m=+47.014027984" watchObservedRunningTime="2026-06-14 14:55:43.144893767 +0000 UTC m=+47.034119168" Jun 14 14:55:43.145477 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:43.145439 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" podStartSLOduration=11.958947271 podStartE2EDuration="22.145423914s" totalImagesPullingTime="10.186476643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:43.145142453 +0000 UTC m=+47.034367873" watchObservedRunningTime="2026-06-14 14:55:43.145423914 +0000 UTC m=+47.034649315" Jun 14 14:55:44.095332 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:44.095295 2561 generic.go:356] "Generic (PLEG): container finished" podID="20b3c648-3a69-49fe-8902-497a1cd44d97" containerID="035f1d9a1b0d71cd66fc3aa96d87bccef4f40eb44e1ec05d394054ba60358c7e" exitCode=0 Jun 14 14:55:44.095769 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:44.095371 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccg99" event={"ID":"20b3c648-3a69-49fe-8902-497a1cd44d97","Type":"ContainerDied","Data":"035f1d9a1b0d71cd66fc3aa96d87bccef4f40eb44e1ec05d394054ba60358c7e"} Jun 14 14:55:45.101653 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:45.101617 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccg99" event={"ID":"20b3c648-3a69-49fe-8902-497a1cd44d97","Type":"ContainerStarted","Data":"b6490d57018c9ee4895daba0cb48195efa3d849496c56f73475c4933340b0469"} Jun 14 14:55:45.127993 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:45.127942 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ccg99" podStartSLOduration=8.313517219 podStartE2EDuration="48.127927324s" totalImagesPullingTime="39.814410105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:45.126369239 +0000 UTC m=+49.015594676" watchObservedRunningTime="2026-06-14 14:55:45.127927324 +0000 UTC m=+49.017152725" Jun 14 14:55:45.249367 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:45.249322 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:45.353213 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:45.353115 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:47.354623 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:47.354587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:55:47.355120 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:47.354670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:55:47.355120 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:47.354743 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:55:47.355120 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:47.354768 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69695b579c-db45k: secret "image-registry-tls" not found Jun 14 14:55:47.355120 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:47.354770 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:47.355120 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:47.354835 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls podName:42f499f6-f899-4b19-b75a-81851ac7f194 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:03.354818051 +0000 UTC m=+67.244043443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls") pod "dns-default-4spxt" (UID: "42f499f6-f899-4b19-b75a-81851ac7f194") : secret "dns-default-metrics-tls" not found Jun 14 14:55:47.355120 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:55:47.354850 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls podName:ce1f23f3-fbe0-4932-925d-f256589ccd55 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:03.354844016 +0000 UTC m=+67.244069394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls") pod "image-registry-69695b579c-db45k" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55") : secret "image-registry-tls" not found Jun 14 14:55:50.673616 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:50.673575 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:50.728282 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:50.728254 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:51.648577 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:51.648545 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:51.748265 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:51.748228 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:52.600494 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:52.600456 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:58.032783 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:58.032753 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-msmgc" Jun 14 14:55:58.181602 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:58.181566 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:58.235010 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:55:58.234971 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:01.359130 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.359094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:56:01.359130 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.359128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:56:01.362014 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.361984 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:56:01.362092 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.362003 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:56:01.370144 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:01.370115 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:56:01.370225 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:01.370185 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs podName:fa2d1037-187f-4b35-a752-59bfae3a464e nodeName:}" failed. No retries permitted until 2026-06-14 14:57:05.370169863 +0000 UTC m=+129.259395241 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs") pod "network-metrics-daemon-9j2l2" (UID: "fa2d1037-187f-4b35-a752-59bfae3a464e") : secret "metrics-daemon-secret" not found Jun 14 14:56:01.373575 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.373554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eb586a37-c589-4617-9967-804838c873b8-original-pull-secret\") pod \"global-pull-secret-syncer-hrhnq\" (UID: \"eb586a37-c589-4617-9967-804838c873b8\") " pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:56:01.444975 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.444936 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhnq" Jun 14 14:56:01.460246 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.460218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvm5l\" (UniqueName: \"kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l\") pod \"network-check-target-jnqxb\" (UID: \"a866bad3-7c32-4079-aeb6-40b04800c470\") " pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:56:01.463262 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.463239 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:56:01.473594 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.473565 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:56:01.484958 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.483888 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvm5l\" (UniqueName: \"kubernetes.io/projected/a866bad3-7c32-4079-aeb6-40b04800c470-kube-api-access-kvm5l\") pod \"network-check-target-jnqxb\" (UID: \"a866bad3-7c32-4079-aeb6-40b04800c470\") " pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:56:01.567750 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.567717 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrhnq"] Jun 14 14:56:01.570560 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:56:01.570530 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb586a37_c589_4617_9967_804838c873b8.slice/crio-560a0ef9e2dd52806624c6e8da1f83c9522a2279c9cd08f627f11903e3b4dd4c WatchSource:0}: Error finding container 560a0ef9e2dd52806624c6e8da1f83c9522a2279c9cd08f627f11903e3b4dd4c: Status 404 returned error can't find the container with id 560a0ef9e2dd52806624c6e8da1f83c9522a2279c9cd08f627f11903e3b4dd4c Jun 14 14:56:01.754101 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.754023 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4zq9\"" Jun 14 14:56:01.762019 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.762000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:56:01.883886 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:01.883848 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jnqxb"] Jun 14 14:56:01.887047 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:56:01.887015 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda866bad3_7c32_4079_aeb6_40b04800c470.slice/crio-277532ddb0be06e5151d3ad9623a1d573c640552c572ed60c93de79666f8c23a WatchSource:0}: Error finding container 277532ddb0be06e5151d3ad9623a1d573c640552c572ed60c93de79666f8c23a: Status 404 returned error can't find the container with id 277532ddb0be06e5151d3ad9623a1d573c640552c572ed60c93de79666f8c23a Jun 14 14:56:02.158990 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:02.158955 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jnqxb" event={"ID":"a866bad3-7c32-4079-aeb6-40b04800c470","Type":"ContainerStarted","Data":"277532ddb0be06e5151d3ad9623a1d573c640552c572ed60c93de79666f8c23a"} Jun 14 14:56:02.160024 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:02.160002 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrhnq" event={"ID":"eb586a37-c589-4617-9967-804838c873b8","Type":"ContainerStarted","Data":"560a0ef9e2dd52806624c6e8da1f83c9522a2279c9cd08f627f11903e3b4dd4c"} Jun 14 14:56:03.162427 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:03.162354 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:03.234976 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:03.234940 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:03.374794 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:03.374758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:56:03.374971 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:03.374810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:56:03.374971 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:03.374936 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:03.374971 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:03.374954 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:56:03.374971 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:03.374969 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69695b579c-db45k: secret "image-registry-tls" not found Jun 14 14:56:03.375145 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:03.375014 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls podName:42f499f6-f899-4b19-b75a-81851ac7f194 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:35.374990696 +0000 UTC m=+99.264216086 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls") pod "dns-default-4spxt" (UID: "42f499f6-f899-4b19-b75a-81851ac7f194") : secret "dns-default-metrics-tls" not found Jun 14 14:56:03.375145 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:03.375034 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls podName:ce1f23f3-fbe0-4932-925d-f256589ccd55 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:35.375024568 +0000 UTC m=+99.264249946 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls") pod "image-registry-69695b579c-db45k" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55") : secret "image-registry-tls" not found Jun 14 14:56:05.732071 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:05.732038 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:05.785841 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:05.785794 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:07.177044 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:07.177007 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jnqxb" event={"ID":"a866bad3-7c32-4079-aeb6-40b04800c470","Type":"ContainerStarted","Data":"13a7985a9598db7b2bec3b77b13a2c9ea34d921edee7e784843ef28d7456038f"} Jun 14 14:56:07.177562 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:07.177095 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:56:07.178530 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:07.178499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrhnq" event={"ID":"eb586a37-c589-4617-9967-804838c873b8","Type":"ContainerStarted","Data":"d0d13fc6360e100999688700e2bf467c474ca50b84dd1870055eaf54fe3f3b1a"} Jun 14 14:56:07.192478 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:07.192439 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jnqxb" podStartSLOduration=65.697460662 podStartE2EDuration="1m10.19242654s" totalImagesPullingTime="4.494965878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:56:07.191858145 +0000 UTC m=+71.081083546" watchObservedRunningTime="2026-06-14 14:56:07.19242654 +0000 UTC m=+71.081651934" Jun 14 14:56:07.205489 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:07.205456 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hrhnq" podStartSLOduration=65.389933878 podStartE2EDuration="1m10.205444143s" totalImagesPullingTime="4.815510265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:56:07.205036062 +0000 UTC m=+71.094261462" watchObservedRunningTime="2026-06-14 14:56:07.205444143 +0000 UTC m=+71.094669607" Jun 14 14:56:07.948271 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:07.948233 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:07.998321 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:07.998274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:08.623678 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:08.623644 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:08.724950 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:08.724912 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:28.675685 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:28.675645 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:28.753442 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:28.753401 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:28.818449 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:28.818417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:35.418399 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:35.418363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:56:35.418793 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:35.418407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:56:35.418793 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:35.418512 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:35.418793 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:35.418579 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls podName:42f499f6-f899-4b19-b75a-81851ac7f194 nodeName:}" failed. No retries permitted until 2026-06-14 14:57:39.418565272 +0000 UTC m=+163.307790650 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls") pod "dns-default-4spxt" (UID: "42f499f6-f899-4b19-b75a-81851ac7f194") : secret "dns-default-metrics-tls" not found Jun 14 14:56:35.418793 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:35.418516 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:56:35.418793 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:35.418607 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69695b579c-db45k: secret "image-registry-tls" not found Jun 14 14:56:35.418793 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:56:35.418660 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls podName:ce1f23f3-fbe0-4932-925d-f256589ccd55 nodeName:}" failed. No retries permitted until 2026-06-14 14:57:39.418650061 +0000 UTC m=+163.307875439 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls") pod "image-registry-69695b579c-db45k" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55") : secret "image-registry-tls" not found Jun 14 14:56:38.184277 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:56:38.184251 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jnqxb" Jun 14 14:57:05.430870 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:05.430818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:57:05.431407 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:57:05.430944 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:57:05.431407 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:57:05.430997 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs podName:fa2d1037-187f-4b35-a752-59bfae3a464e nodeName:}" failed. No retries permitted until 2026-06-14 14:59:07.430983198 +0000 UTC m=+251.320208576 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs") pod "network-metrics-daemon-9j2l2" (UID: "fa2d1037-187f-4b35-a752-59bfae3a464e") : secret "metrics-daemon-secret" not found Jun 14 14:57:34.566853 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:57:34.566807 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-69695b579c-db45k" podUID="ce1f23f3-fbe0-4932-925d-f256589ccd55" Jun 14 14:57:34.572929 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:57:34.572905 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4spxt" podUID="42f499f6-f899-4b19-b75a-81851ac7f194" Jun 14 14:57:35.429948 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:35.429916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4spxt" Jun 14 14:57:35.430151 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:35.429916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:57:35.635582 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:57:35.635525 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:57:39.486920 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:39.486884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:57:39.486920 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:39.486934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:57:39.487430 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:57:39.487040 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:57:39.487430 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:57:39.487046 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:57:39.487430 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:57:39.487067 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69695b579c-db45k: secret "image-registry-tls" not found Jun 14 14:57:39.487430 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:57:39.487102 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls podName:42f499f6-f899-4b19-b75a-81851ac7f194 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:41.487086652 +0000 UTC m=+285.376312030 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls") pod "dns-default-4spxt" (UID: "42f499f6-f899-4b19-b75a-81851ac7f194") : secret "dns-default-metrics-tls" not found Jun 14 14:57:39.487430 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:57:39.487129 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls podName:ce1f23f3-fbe0-4932-925d-f256589ccd55 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:41.487114284 +0000 UTC m=+285.376339662 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls") pod "image-registry-69695b579c-db45k" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55") : secret "image-registry-tls" not found Jun 14 14:57:42.451872 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:42.451842 2561 generic.go:356] "Generic (PLEG): container finished" podID="7ae1ef33-0522-491d-a39f-3028d3aa098c" containerID="8cbbaed73870287a77455525cf6cece4ce661fad0dd0a8d11bae0b28c89157f2" exitCode=1 Jun 14 14:57:42.452226 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:42.451884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" event={"ID":"7ae1ef33-0522-491d-a39f-3028d3aa098c","Type":"ContainerDied","Data":"8cbbaed73870287a77455525cf6cece4ce661fad0dd0a8d11bae0b28c89157f2"} Jun 14 14:57:42.452303 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:42.452272 2561 scope.go:117] "RemoveContainer" containerID="8cbbaed73870287a77455525cf6cece4ce661fad0dd0a8d11bae0b28c89157f2" Jun 14 14:57:43.081404 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:43.081374 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:57:43.456205 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:43.456093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" event={"ID":"7ae1ef33-0522-491d-a39f-3028d3aa098c","Type":"ContainerStarted","Data":"7614a625a351af73a6be93da1c1e761707a31a0880dd941de0b1ebf1849480f3"} Jun 14 14:57:43.456655 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:43.456308 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:57:43.456939 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:43.456916 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:57:43.457621 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:43.457602 2561 generic.go:356] "Generic (PLEG): container finished" podID="1dcbc43a-e548-4d65-85ee-e8f34cf7ff52" containerID="e438679d81f8275a58089eeee9b3369a51e8f24d787ce49f8da5b6c30eb26173" exitCode=255 Jun 14 14:57:43.457693 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:43.457645 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" event={"ID":"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52","Type":"ContainerDied","Data":"e438679d81f8275a58089eeee9b3369a51e8f24d787ce49f8da5b6c30eb26173"} Jun 14 14:57:43.457888 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:43.457876 2561 scope.go:117] "RemoveContainer" containerID="e438679d81f8275a58089eeee9b3369a51e8f24d787ce49f8da5b6c30eb26173" Jun 14 14:57:44.462231 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:44.462178 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" event={"ID":"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52","Type":"ContainerStarted","Data":"e9bb5a29616b28bffd57394d3d5081ca7f2c92b09c00a6551382896b3e8bef50"} Jun 14 14:57:47.620807 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:57:47.620776 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:58:03.741931 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:03.741897 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:54.272060 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:54.272015 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:54.324313 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:54.324279 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:56.679157 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:56.679125 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:56.731810 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:56.731780 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:57.092321 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:57.092292 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:57.144604 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:57.144582 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:58.473639 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.473607 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jxjg2"] Jun 14 14:58:58.476647 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.476631 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.482848 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.482828 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 14:58:58.483070 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.483052 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 14:58:58.483340 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.483323 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kkhv5\"" Jun 14 14:58:58.483403 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.483323 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 14:58:58.483403 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.483326 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 14:58:58.493887 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.493858 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jxjg2"] Jun 14 14:58:58.525521 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.525487 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:58.542801 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.542774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.542903 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.542836 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.542903 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.542878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7675443c-f61f-4877-8d63-941dd02951d9-data-volume\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.542991 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.542920 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7675443c-f61f-4877-8d63-941dd02951d9-crio-socket\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.542991 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.542945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m5g9\" (UniqueName: \"kubernetes.io/projected/7675443c-f61f-4877-8d63-941dd02951d9-kube-api-access-4m5g9\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.582332 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.582313 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:58.643949 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.643924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.644071 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.643950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7675443c-f61f-4877-8d63-941dd02951d9-data-volume\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.644071 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.643968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7675443c-f61f-4877-8d63-941dd02951d9-crio-socket\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.644071 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.643986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m5g9\" (UniqueName: \"kubernetes.io/projected/7675443c-f61f-4877-8d63-941dd02951d9-kube-api-access-4m5g9\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.644071 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:58:58.644053 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:58:58.644315 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.644073 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7675443c-f61f-4877-8d63-941dd02951d9-crio-socket\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.644315 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:58:58.644111 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm podName:7675443c-f61f-4877-8d63-941dd02951d9 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:59.144096317 +0000 UTC m=+243.033321715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jxjg2" (UID: "7675443c-f61f-4877-8d63-941dd02951d9") : configmap "kube-rbac-proxy" not found Jun 14 14:58:58.644315 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.644149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.644315 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:58:58.644266 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:58:58.644315 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:58:58.644312 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls podName:7675443c-f61f-4877-8d63-941dd02951d9 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:59.144297003 +0000 UTC m=+243.033522381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxjg2" (UID: "7675443c-f61f-4877-8d63-941dd02951d9") : secret "insights-runtime-extractor-tls" not found Jun 14 14:58:58.644517 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.644375 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7675443c-f61f-4877-8d63-941dd02951d9-data-volume\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:58.654650 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:58.654626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m5g9\" (UniqueName: \"kubernetes.io/projected/7675443c-f61f-4877-8d63-941dd02951d9-kube-api-access-4m5g9\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:59.028452 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:59.028419 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:59.148418 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:59.148385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:59.148589 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:59.148442 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:58:59.148589 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:58:59.148516 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:58:59.148589 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:58:59.148545 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:58:59.148720 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:58:59.148605 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls podName:7675443c-f61f-4877-8d63-941dd02951d9 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:00.148590227 +0000 UTC m=+244.037815608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxjg2" (UID: "7675443c-f61f-4877-8d63-941dd02951d9") : secret "insights-runtime-extractor-tls" not found Jun 14 14:58:59.148720 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:58:59.148619 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm podName:7675443c-f61f-4877-8d63-941dd02951d9 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:00.148612527 +0000 UTC m=+244.037837906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jxjg2" (UID: "7675443c-f61f-4877-8d63-941dd02951d9") : configmap "kube-rbac-proxy" not found Jun 14 14:58:59.459041 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:59.459011 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:59.547704 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:59.547674 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:59.598891 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:59.598866 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:59.653353 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:59.653327 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:59.753924 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:59.753866 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:59.812401 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:58:59.812373 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:00.154346 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:00.154315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:00.154507 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:00.154378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:00.154507 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:00.154428 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:59:00.154507 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:00.154476 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:59:00.154507 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:00.154487 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm podName:7675443c-f61f-4877-8d63-941dd02951d9 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:02.154472745 +0000 UTC m=+246.043698122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jxjg2" (UID: "7675443c-f61f-4877-8d63-941dd02951d9") : configmap "kube-rbac-proxy" not found Jun 14 14:59:00.154641 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:00.154530 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls podName:7675443c-f61f-4877-8d63-941dd02951d9 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:02.154517086 +0000 UTC m=+246.043742468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxjg2" (UID: "7675443c-f61f-4877-8d63-941dd02951d9") : secret "insights-runtime-extractor-tls" not found Jun 14 14:59:00.764593 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:00.764568 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qddgd_a359273f-3646-4342-8e04-13ca25961257/dns-node-resolver/0.log" Jun 14 14:59:01.367312 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:01.367283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:01.621939 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:01.621854 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:01.671553 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:01.671521 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:01.764039 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:01.764011 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vt5jr_64c9f8a5-ea6c-4120-b6eb-0f6328d5d127/node-ca/0.log" Jun 14 14:59:02.167638 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:02.167613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cvld6_31f5b369-91e9-4390-aa06-da598738aa47/serve-healthcheck-canary/0.log" Jun 14 14:59:02.171812 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:02.171794 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:02.171873 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:02.171850 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:02.171916 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:02.171899 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:59:02.171953 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:02.171943 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm podName:7675443c-f61f-4877-8d63-941dd02951d9 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:06.171930496 +0000 UTC m=+250.061155876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jxjg2" (UID: "7675443c-f61f-4877-8d63-941dd02951d9") : configmap "kube-rbac-proxy" not found Jun 14 14:59:02.172001 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:02.171953 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:59:02.172001 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:02.171994 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls podName:7675443c-f61f-4877-8d63-941dd02951d9 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:06.171980447 +0000 UTC m=+250.061205826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxjg2" (UID: "7675443c-f61f-4877-8d63-941dd02951d9") : secret "insights-runtime-extractor-tls" not found Jun 14 14:59:02.338500 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:02.338472 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:03.855645 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:03.855606 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:04.131966 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:04.131881 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:04.226925 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:04.226893 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:04.326739 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:04.326708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:04.427564 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:04.427486 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:04.579989 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:04.579959 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:05.554825 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:05.554796 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:05.757839 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:05.757801 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:06.156094 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:06.156069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:06.205301 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:06.205279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:06.205409 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:06.205332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:06.205409 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:06.205391 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:59:06.205492 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:06.205435 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm podName:7675443c-f61f-4877-8d63-941dd02951d9 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:14.205420901 +0000 UTC m=+258.094646279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jxjg2" (UID: "7675443c-f61f-4877-8d63-941dd02951d9") : configmap "kube-rbac-proxy" not found Jun 14 14:59:06.205547 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:06.205516 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:59:06.205583 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:06.205568 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls podName:7675443c-f61f-4877-8d63-941dd02951d9 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:14.205553 +0000 UTC m=+258.094778379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jxjg2" (UID: "7675443c-f61f-4877-8d63-941dd02951d9") : secret "insights-runtime-extractor-tls" not found Jun 14 14:59:06.358926 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:06.358902 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:06.949338 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:06.949298 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:07.355394 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:07.355368 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:07.515070 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:07.515047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 14:59:07.515207 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:07.515156 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:59:07.515253 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:07.515219 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs podName:fa2d1037-187f-4b35-a752-59bfae3a464e nodeName:}" failed. No retries permitted until 2026-06-14 15:01:09.515205966 +0000 UTC m=+373.404431344 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs") pod "network-metrics-daemon-9j2l2" (UID: "fa2d1037-187f-4b35-a752-59bfae3a464e") : secret "metrics-daemon-secret" not found Jun 14 14:59:07.749814 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:07.749742 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:07.801137 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:07.801110 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:08.088050 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:08.088022 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:08.189044 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:08.189017 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:08.390330 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:08.390242 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:08.753781 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:08.753701 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:09.154815 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:09.154777 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:09.765993 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:09.765959 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:10.156322 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:10.156292 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:11.066806 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:11.066775 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:11.366543 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:11.366510 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:11.634457 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:11.634372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:11.751106 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:11.751083 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:12.160291 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:12.160260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:12.353092 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:12.353060 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:12.755771 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:12.755739 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:13.558312 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:13.558279 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:13.723313 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:13.723241 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:13.779507 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:13.779468 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:14.149730 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:14.149698 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:14.266430 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:14.266395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:14.266560 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:14.266467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:14.267059 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:14.267037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7675443c-f61f-4877-8d63-941dd02951d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:14.268903 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:14.268884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7675443c-f61f-4877-8d63-941dd02951d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jxjg2\" (UID: \"7675443c-f61f-4877-8d63-941dd02951d9\") " pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:14.353406 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:14.353366 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:14.385468 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:14.385443 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jxjg2" Jun 14 14:59:14.507278 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:14.507250 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jxjg2"] Jun 14 14:59:14.510219 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:59:14.510172 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7675443c_f61f_4877_8d63_941dd02951d9.slice/crio-3ce5b7da27c3ed8b1be4dfd3563d3582a19e15a63eb1c56f6a3ed1ffcbe45579 WatchSource:0}: Error finding container 3ce5b7da27c3ed8b1be4dfd3563d3582a19e15a63eb1c56f6a3ed1ffcbe45579: Status 404 returned error can't find the container with id 3ce5b7da27c3ed8b1be4dfd3563d3582a19e15a63eb1c56f6a3ed1ffcbe45579 Jun 14 14:59:14.561138 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:14.561107 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:14.720902 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:14.720815 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jxjg2" event={"ID":"7675443c-f61f-4877-8d63-941dd02951d9","Type":"ContainerStarted","Data":"3ce5b7da27c3ed8b1be4dfd3563d3582a19e15a63eb1c56f6a3ed1ffcbe45579"} Jun 14 14:59:16.603591 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:16.603554 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:16.655042 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:16.655006 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:16.755516 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:16.755481 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:16.897754 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:16.897674 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:17.280408 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:17.280342 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:17.488520 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:17.488482 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:17.589462 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:17.589400 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:17.904586 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:17.904501 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:18.005717 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:18.005693 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:18.285890 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:18.285815 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:18.688121 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:18.688101 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:18.735492 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:18.735468 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jxjg2" event={"ID":"7675443c-f61f-4877-8d63-941dd02951d9","Type":"ContainerStarted","Data":"d9ec6692d18b6d1d10dc72e25e6a53eac40c6006a66b28d68642322d163a3e03"} Jun 14 14:59:18.735578 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:18.735523 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jxjg2" event={"ID":"7675443c-f61f-4877-8d63-941dd02951d9","Type":"ContainerStarted","Data":"87d14f4a1994e22d229e1bc7e435486da3ca9c42a1a7f3decdb305c1e5539f88"} Jun 14 14:59:18.788943 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:18.788911 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:19.536867 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:19.536792 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:20.677297 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:20.677263 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:20.743283 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:20.743249 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jxjg2" event={"ID":"7675443c-f61f-4877-8d63-941dd02951d9","Type":"ContainerStarted","Data":"b8fcfb2ef8e569b7e657cba46ce82393eee23915b70661d4a178b2aca54b4f8b"} Jun 14 14:59:20.762427 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:20.762382 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jxjg2" podStartSLOduration=17.077695687 podStartE2EDuration="22.762367799s" totalImagesPullingTime="5.684672112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:58:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:20.761715927 +0000 UTC m=+264.650941327" watchObservedRunningTime="2026-06-14 14:59:20.762367799 +0000 UTC m=+264.651593199" Jun 14 14:59:20.766546 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:20.766526 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:20.832357 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:20.832339 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:22.746426 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:22.746379 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:22.846721 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:22.846641 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:27.508158 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:27.508125 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:27.561731 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:27.561695 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:28.238996 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:28.238938 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:28.339827 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:28.339799 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:28.442661 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:28.442638 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:28.512352 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:28.512290 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:29.014840 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:29.014805 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:31.335149 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:31.335114 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:31.395237 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:31.395205 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:31.847858 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:31.847817 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" podUID="d9f9b652-481b-4434-94b5-da0ff0cfcafc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 14:59:32.525496 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:32.525462 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:32.589948 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:32.589917 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:32.664077 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:32.664043 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:32.917075 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:32.917042 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:33.016747 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:33.016717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:34.735215 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:34.735155 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:34.785246 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:34.785213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:37.510698 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:37.510664 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:37.560315 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:37.560288 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:38.430692 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:38.430654 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4spxt" podUID="42f499f6-f899-4b19-b75a-81851ac7f194" Jun 14 14:59:38.430692 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:38.430653 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-69695b579c-db45k" podUID="ce1f23f3-fbe0-4932-925d-f256589ccd55" Jun 14 14:59:38.794527 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:38.794447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4spxt" Jun 14 14:59:38.794947 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:38.794447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:59:41.565950 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:41.565913 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:59:41.566323 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:41.565968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:59:41.568441 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:41.568414 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42f499f6-f899-4b19-b75a-81851ac7f194-metrics-tls\") pod \"dns-default-4spxt\" (UID: \"42f499f6-f899-4b19-b75a-81851ac7f194\") " pod="openshift-dns/dns-default-4spxt" Jun 14 14:59:41.568559 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:41.568515 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"image-registry-69695b579c-db45k\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:59:41.798227 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:41.798183 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4p4qh\"" Jun 14 14:59:41.798227 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:41.798183 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rvf4d\"" Jun 14 14:59:41.805834 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:41.805809 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4spxt" Jun 14 14:59:41.805939 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:41.805891 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:59:41.847106 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:41.847081 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" podUID="d9f9b652-481b-4434-94b5-da0ff0cfcafc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 14:59:41.932363 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:41.932335 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:42.133031 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.132983 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69695b579c-db45k"] Jun 14 14:59:42.135613 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:59:42.135586 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1f23f3_fbe0_4932_925d_f256589ccd55.slice/crio-0b1d7122f8e6435249fbc20a1b3aca3ea0bff09ddee2614b587d005099ec09ab WatchSource:0}: Error finding container 0b1d7122f8e6435249fbc20a1b3aca3ea0bff09ddee2614b587d005099ec09ab: Status 404 returned error can't find the container with id 0b1d7122f8e6435249fbc20a1b3aca3ea0bff09ddee2614b587d005099ec09ab Jun 14 14:59:42.148596 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.148574 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4spxt"] Jun 14 14:59:42.151256 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:59:42.151230 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f499f6_f899_4b19_b75a_81851ac7f194.slice/crio-f61471bcba5fe40835b35f9b408ef850f48d4c9f4b7de386d2bef670ff14afe9 WatchSource:0}: Error finding container f61471bcba5fe40835b35f9b408ef850f48d4c9f4b7de386d2bef670ff14afe9: Status 404 returned error can't find the container with id f61471bcba5fe40835b35f9b408ef850f48d4c9f4b7de386d2bef670ff14afe9 Jun 14 14:59:42.291370 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.291333 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:42.356350 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.356276 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:42.808210 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.808098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69695b579c-db45k" event={"ID":"ce1f23f3-fbe0-4932-925d-f256589ccd55","Type":"ContainerStarted","Data":"bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a"} Jun 14 14:59:42.808607 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.808238 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 14:59:42.808607 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.808283 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69695b579c-db45k" event={"ID":"ce1f23f3-fbe0-4932-925d-f256589ccd55","Type":"ContainerStarted","Data":"0b1d7122f8e6435249fbc20a1b3aca3ea0bff09ddee2614b587d005099ec09ab"} Jun 14 14:59:42.809769 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.809747 2561 generic.go:356] "Generic (PLEG): container finished" podID="7ae1ef33-0522-491d-a39f-3028d3aa098c" containerID="7614a625a351af73a6be93da1c1e761707a31a0880dd941de0b1ebf1849480f3" exitCode=1 Jun 14 14:59:42.809890 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.809822 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" event={"ID":"7ae1ef33-0522-491d-a39f-3028d3aa098c","Type":"ContainerDied","Data":"7614a625a351af73a6be93da1c1e761707a31a0880dd941de0b1ebf1849480f3"} Jun 14 14:59:42.809958 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.809878 2561 scope.go:117] "RemoveContainer" containerID="8cbbaed73870287a77455525cf6cece4ce661fad0dd0a8d11bae0b28c89157f2" Jun 14 14:59:42.810269 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.810178 2561 scope.go:117] "RemoveContainer" containerID="7614a625a351af73a6be93da1c1e761707a31a0880dd941de0b1ebf1849480f3" Jun 14 14:59:42.810405 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:42.810379 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-d456f4cd9-xgx6t_open-cluster-management-agent-addon(7ae1ef33-0522-491d-a39f-3028d3aa098c)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" podUID="7ae1ef33-0522-491d-a39f-3028d3aa098c" Jun 14 14:59:42.810969 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.810937 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4spxt" event={"ID":"42f499f6-f899-4b19-b75a-81851ac7f194","Type":"ContainerStarted","Data":"f61471bcba5fe40835b35f9b408ef850f48d4c9f4b7de386d2bef670ff14afe9"} Jun 14 14:59:42.846229 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:42.846161 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69695b579c-db45k" podStartSLOduration=286.846144025 podStartE2EDuration="4m46.846144025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:54:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:42.827550689 +0000 UTC m=+286.716776089" watchObservedRunningTime="2026-06-14 14:59:42.846144025 +0000 UTC m=+286.735369426" Jun 14 14:59:43.457179 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:43.457138 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:59:43.817098 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:43.817013 2561 scope.go:117] "RemoveContainer" containerID="7614a625a351af73a6be93da1c1e761707a31a0880dd941de0b1ebf1849480f3" Jun 14 14:59:43.817588 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:43.817261 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-d456f4cd9-xgx6t_open-cluster-management-agent-addon(7ae1ef33-0522-491d-a39f-3028d3aa098c)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" podUID="7ae1ef33-0522-491d-a39f-3028d3aa098c" Jun 14 14:59:43.818816 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:43.818792 2561 generic.go:356] "Generic (PLEG): container finished" podID="1dcbc43a-e548-4d65-85ee-e8f34cf7ff52" containerID="e9bb5a29616b28bffd57394d3d5081ca7f2c92b09c00a6551382896b3e8bef50" exitCode=255 Jun 14 14:59:43.818931 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:43.818882 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" event={"ID":"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52","Type":"ContainerDied","Data":"e9bb5a29616b28bffd57394d3d5081ca7f2c92b09c00a6551382896b3e8bef50"} Jun 14 14:59:43.818931 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:43.818922 2561 scope.go:117] "RemoveContainer" containerID="e438679d81f8275a58089eeee9b3369a51e8f24d787ce49f8da5b6c30eb26173" Jun 14 14:59:43.819290 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:43.819272 2561 scope.go:117] "RemoveContainer" containerID="e9bb5a29616b28bffd57394d3d5081ca7f2c92b09c00a6551382896b3e8bef50" Jun 14 14:59:43.819453 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:43.819431 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn_open-cluster-management-agent-addon(1dcbc43a-e548-4d65-85ee-e8f34cf7ff52)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" podUID="1dcbc43a-e548-4d65-85ee-e8f34cf7ff52" Jun 14 14:59:44.660048 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.660015 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:44.824475 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.824445 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4spxt" event={"ID":"42f499f6-f899-4b19-b75a-81851ac7f194","Type":"ContainerStarted","Data":"0b8416a78427edc3d42b3f6522026ac5ec7411fbbfa0b06851fe09a8acf6ac02"} Jun 14 14:59:44.824846 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.824499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4spxt" event={"ID":"42f499f6-f899-4b19-b75a-81851ac7f194","Type":"ContainerStarted","Data":"c84d6c7482a3c47ae2134d6f305b3359786c0e91b81b9a7b4ae68e89291b15ef"} Jun 14 14:59:44.824846 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.824529 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4spxt" Jun 14 14:59:44.845464 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.845413 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4spxt" podStartSLOduration=251.901968736 podStartE2EDuration="4m13.845399185s" totalImagesPullingTime="1.943430449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:44.844923082 +0000 UTC m=+288.734148482" watchObservedRunningTime="2026-06-14 14:59:44.845399185 +0000 UTC m=+288.734624585" Jun 14 14:59:44.884816 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.884755 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:44.935746 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.935681 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-55fjf"] Jun 14 14:59:44.938856 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.938842 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:44.940956 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.940921 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 14:59:44.941208 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.941167 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m7rxh\"" Jun 14 14:59:44.941482 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.941462 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 14:59:44.941583 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.941490 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 14:59:44.941583 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.941496 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 14:59:44.941583 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.941509 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 14:59:44.941583 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.941529 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 14:59:44.975027 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.975007 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:44.991924 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.991904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84577\" (UniqueName: \"kubernetes.io/projected/dde431ed-57d6-452d-8e8c-e16edddd02e5-kube-api-access-84577\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:44.992017 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.991947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-wtmp\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:44.992017 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.991973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde431ed-57d6-452d-8e8c-e16edddd02e5-sys\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:44.992017 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.991993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde431ed-57d6-452d-8e8c-e16edddd02e5-metrics-client-ca\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:44.992164 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.992080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-textfile\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:44.992164 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.992122 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-tls\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:44.992266 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.992161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde431ed-57d6-452d-8e8c-e16edddd02e5-root\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:44.992266 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.992207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:44.992266 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:44.992241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.055875 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.055846 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:45.093107 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde431ed-57d6-452d-8e8c-e16edddd02e5-root\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093204 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093204 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093328 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093185 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84577\" (UniqueName: \"kubernetes.io/projected/dde431ed-57d6-452d-8e8c-e16edddd02e5-kube-api-access-84577\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093328 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093212 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde431ed-57d6-452d-8e8c-e16edddd02e5-root\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093328 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093274 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-wtmp\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093328 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093300 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde431ed-57d6-452d-8e8c-e16edddd02e5-sys\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093512 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093329 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde431ed-57d6-452d-8e8c-e16edddd02e5-metrics-client-ca\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093512 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093378 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde431ed-57d6-452d-8e8c-e16edddd02e5-sys\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093512 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-textfile\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093512 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093462 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-wtmp\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093512 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093475 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-tls\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093718 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093699 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-textfile\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093786 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093764 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.093832 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.093805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde431ed-57d6-452d-8e8c-e16edddd02e5-metrics-client-ca\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.095712 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.095687 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.095804 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.095759 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde431ed-57d6-452d-8e8c-e16edddd02e5-node-exporter-tls\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.103698 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.103680 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84577\" (UniqueName: \"kubernetes.io/projected/dde431ed-57d6-452d-8e8c-e16edddd02e5-kube-api-access-84577\") pod \"node-exporter-55fjf\" (UID: \"dde431ed-57d6-452d-8e8c-e16edddd02e5\") " pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.155603 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.155569 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:45.247880 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.247814 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-55fjf" Jun 14 14:59:45.255275 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.255253 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:45.258971 ip-10-0-134-188 kubenswrapper[2561]: W0614 14:59:45.258950 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde431ed_57d6_452d_8e8c_e16edddd02e5.slice/crio-8734f3aed6c2b5463cadac29db9b54b7b7ebe524d1a75b41dcb6f34a2d79de9c WatchSource:0}: Error finding container 8734f3aed6c2b5463cadac29db9b54b7b7ebe524d1a75b41dcb6f34a2d79de9c: Status 404 returned error can't find the container with id 8734f3aed6c2b5463cadac29db9b54b7b7ebe524d1a75b41dcb6f34a2d79de9c Jun 14 14:59:45.356117 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.356084 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:45.504580 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.504508 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:45.605257 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.605227 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:45.831248 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.831215 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-55fjf" event={"ID":"dde431ed-57d6-452d-8e8c-e16edddd02e5","Type":"ContainerStarted","Data":"8734f3aed6c2b5463cadac29db9b54b7b7ebe524d1a75b41dcb6f34a2d79de9c"} Jun 14 14:59:45.919520 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:45.919478 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:46.001357 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:46.001321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:46.257667 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:46.257639 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:46.835953 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:46.835919 2561 generic.go:356] "Generic (PLEG): container finished" podID="dde431ed-57d6-452d-8e8c-e16edddd02e5" containerID="60bac3eafb3d829c5536e346866f0f848127ce4f6298349daf7c7e59226e0934" exitCode=0 Jun 14 14:59:46.836335 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:46.836011 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-55fjf" event={"ID":"dde431ed-57d6-452d-8e8c-e16edddd02e5","Type":"ContainerDied","Data":"60bac3eafb3d829c5536e346866f0f848127ce4f6298349daf7c7e59226e0934"} Jun 14 14:59:47.809227 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:47.809180 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:47.840812 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:47.840781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-55fjf" event={"ID":"dde431ed-57d6-452d-8e8c-e16edddd02e5","Type":"ContainerStarted","Data":"1c3d82992c3304a7504ea0823bdbcd9f81079aeec793f55346e64014180b431d"} Jun 14 14:59:47.841133 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:47.840855 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-55fjf" event={"ID":"dde431ed-57d6-452d-8e8c-e16edddd02e5","Type":"ContainerStarted","Data":"0471ef88af7be3e8fafcf692896593d7b6906c6ab4266b318be01d59d9fa4bb8"} Jun 14 14:59:47.860297 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:47.860255 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-55fjf" podStartSLOduration=2.821927491 podStartE2EDuration="3.860243173s" totalImagesPullingTime="968.263764ms" totalInitContainerRuntime="70.051918ms" isStatefulPod=true podCreationTimestamp="2026-06-14 14:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:47.859127036 +0000 UTC m=+291.748352436" watchObservedRunningTime="2026-06-14 14:59:47.860243173 +0000 UTC m=+291.749468552" Jun 14 14:59:47.875569 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:47.875544 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:47.973572 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:47.973542 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:48.284536 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:48.284505 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:49.712542 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:49.712509 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:49.786943 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:49.786890 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:49.890644 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:49.890616 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:50.621968 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:50.621930 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9j2l2" podUID="fa2d1037-187f-4b35-a752-59bfae3a464e" Jun 14 14:59:51.076849 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.076817 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:51.662390 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.662362 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:51.740706 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.740675 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:51.831862 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.831827 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" Jun 14 14:59:51.832124 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.832112 2561 scope.go:117] "RemoveContainer" containerID="e9bb5a29616b28bffd57394d3d5081ca7f2c92b09c00a6551382896b3e8bef50" Jun 14 14:59:51.832294 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:51.832277 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn_open-cluster-management-agent-addon(1dcbc43a-e548-4d65-85ee-e8f34cf7ff52)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" podUID="1dcbc43a-e548-4d65-85ee-e8f34cf7ff52" Jun 14 14:59:51.838486 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.838472 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 14:59:51.838750 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.838738 2561 scope.go:117] "RemoveContainer" containerID="7614a625a351af73a6be93da1c1e761707a31a0880dd941de0b1ebf1849480f3" Jun 14 14:59:51.838871 ip-10-0-134-188 kubenswrapper[2561]: E0614 14:59:51.838854 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-d456f4cd9-xgx6t_open-cluster-management-agent-addon(7ae1ef33-0522-491d-a39f-3028d3aa098c)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" podUID="7ae1ef33-0522-491d-a39f-3028d3aa098c" Jun 14 14:59:51.847608 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.847583 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" podUID="d9f9b652-481b-4434-94b5-da0ff0cfcafc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 14 14:59:51.847689 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.847631 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" Jun 14 14:59:51.848089 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.848061 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"aa3423a32a68d799c40aa07623957aa10a252ba3848bc7f62d7b79621f2fb7c6"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 14 14:59:51.848126 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:51.848110 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" podUID="d9f9b652-481b-4434-94b5-da0ff0cfcafc" containerName="service-proxy" containerID="cri-o://aa3423a32a68d799c40aa07623957aa10a252ba3848bc7f62d7b79621f2fb7c6" gracePeriod=30 Jun 14 14:59:52.858203 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:52.858154 2561 generic.go:356] "Generic (PLEG): container finished" podID="d9f9b652-481b-4434-94b5-da0ff0cfcafc" containerID="aa3423a32a68d799c40aa07623957aa10a252ba3848bc7f62d7b79621f2fb7c6" exitCode=2 Jun 14 14:59:52.858563 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:52.858224 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" event={"ID":"d9f9b652-481b-4434-94b5-da0ff0cfcafc","Type":"ContainerDied","Data":"aa3423a32a68d799c40aa07623957aa10a252ba3848bc7f62d7b79621f2fb7c6"} Jun 14 14:59:52.858563 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:52.858268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558c89f596-9pf8h" event={"ID":"d9f9b652-481b-4434-94b5-da0ff0cfcafc","Type":"ContainerStarted","Data":"6f173fd9b50e2ee3c42b0e8cecbb7a7e65002ff9db18886869ca643e55e59769"} Jun 14 14:59:54.833145 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:54.833117 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4spxt" Jun 14 14:59:55.777061 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:55.776995 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:55.876961 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:55.876927 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:55.977440 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:55.977411 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:56.562933 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:56.562910 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 14:59:56.565160 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:56.565137 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 14:59:56.567763 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:56.567737 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 14:59:56.888717 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:56.888689 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:56.989520 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:56.989491 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:57.118019 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:57.117990 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:57.219156 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:57.219085 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:57.487264 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:57.487164 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:57.539048 ip-10-0-134-188 kubenswrapper[2561]: I0614 14:59:57.539023 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:00.436874 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:00.436841 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:00.485965 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:00.485930 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:01.295998 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:01.295965 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:01.394088 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:01.394060 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:01.809950 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:01.809917 2561 patch_prober.go:28] interesting pod/image-registry-69695b579c-db45k container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 15:00:01.810354 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:01.809969 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-69695b579c-db45k" podUID="ce1f23f3-fbe0-4932-925d-f256589ccd55" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 15:00:03.825666 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:03.825638 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 15:00:03.942616 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:03.942586 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:03.993357 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:03.993332 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:04.078428 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:04.078347 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:04.179112 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:04.179083 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:04.621154 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:04.621124 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 15:00:04.621446 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:04.621426 2561 scope.go:117] "RemoveContainer" containerID="e9bb5a29616b28bffd57394d3d5081ca7f2c92b09c00a6551382896b3e8bef50" Jun 14 15:00:04.900346 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:04.900270 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d76fb4c4-4b7fn" event={"ID":"1dcbc43a-e548-4d65-85ee-e8f34cf7ff52","Type":"ContainerStarted","Data":"4eea490feb5a38fdea7b7c93642cefb6b014ea29c8fb076eda5ad2db996906ca"} Jun 14 15:00:05.621201 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:05.621167 2561 scope.go:117] "RemoveContainer" containerID="7614a625a351af73a6be93da1c1e761707a31a0880dd941de0b1ebf1849480f3" Jun 14 15:00:05.906106 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:05.906025 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" event={"ID":"7ae1ef33-0522-491d-a39f-3028d3aa098c","Type":"ContainerStarted","Data":"d580c1350ffc5d862ac758524aceb8a5b1dcb3666a62e8ecea81c72fa1b77850"} Jun 14 15:00:05.906463 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:05.906398 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 15:00:05.907629 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:05.907607 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d456f4cd9-xgx6t" Jun 14 15:00:07.980537 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:07.980506 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:08.036342 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:08.036311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:11.053967 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:11.053935 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69695b579c-db45k"] Jun 14 15:00:11.122007 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:11.121974 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:11.224280 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:11.224246 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:11.323360 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:11.323271 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:12.953837 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:12.953801 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:13.003826 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:13.003802 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:15.231952 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:15.231917 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:15.283397 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:15.283369 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:18.562751 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:18.562717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:18.660087 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:18.660057 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:24.337539 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:24.337496 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:24.395887 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:24.395860 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:26.709030 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:26.709002 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:26.768967 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:26.768938 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:27.417667 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:27.417634 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:29.099355 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:29.099324 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69695b579c-db45k_ce1f23f3-fbe0-4932-925d-f256589ccd55/registry/0.log" Jun 14 15:00:29.130690 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:29.130665 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vt5jr_64c9f8a5-ea6c-4120-b6eb-0f6328d5d127/node-ca/0.log" Jun 14 15:00:33.553679 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:33.553648 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:33.620504 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:33.620479 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:35.515253 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:35.515220 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:35.616157 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:35.616132 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:36.073366 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:36.073328 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69695b579c-db45k" podUID="ce1f23f3-fbe0-4932-925d-f256589ccd55" containerName="registry" containerID="cri-o://bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a" gracePeriod=30 Jun 14 15:00:37.319309 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.319286 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 15:00:37.472825 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.472743 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-bound-sa-token\") pod \"ce1f23f3-fbe0-4932-925d-f256589ccd55\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " Jun 14 15:00:37.472825 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.472781 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-trusted-ca\") pod \"ce1f23f3-fbe0-4932-925d-f256589ccd55\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " Jun 14 15:00:37.472825 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.472805 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1f23f3-fbe0-4932-925d-f256589ccd55-ca-trust-extracted\") pod \"ce1f23f3-fbe0-4932-925d-f256589ccd55\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " Jun 14 15:00:37.473065 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.472830 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-image-registry-private-configuration\") pod \"ce1f23f3-fbe0-4932-925d-f256589ccd55\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " Jun 14 15:00:37.473065 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.472858 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") pod \"ce1f23f3-fbe0-4932-925d-f256589ccd55\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " Jun 14 15:00:37.473065 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.472895 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-installation-pull-secrets\") pod \"ce1f23f3-fbe0-4932-925d-f256589ccd55\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " Jun 14 15:00:37.473065 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.472918 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxkcg\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-kube-api-access-sxkcg\") pod \"ce1f23f3-fbe0-4932-925d-f256589ccd55\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " Jun 14 15:00:37.473065 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.472957 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-certificates\") pod \"ce1f23f3-fbe0-4932-925d-f256589ccd55\" (UID: \"ce1f23f3-fbe0-4932-925d-f256589ccd55\") " Jun 14 15:00:37.473349 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.473243 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ce1f23f3-fbe0-4932-925d-f256589ccd55" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:37.473717 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.473583 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ce1f23f3-fbe0-4932-925d-f256589ccd55" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:37.475365 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.475332 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ce1f23f3-fbe0-4932-925d-f256589ccd55" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:00:37.475569 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.475524 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ce1f23f3-fbe0-4932-925d-f256589ccd55" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:00:37.475656 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.475595 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ce1f23f3-fbe0-4932-925d-f256589ccd55" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:00:37.475873 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.475854 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-kube-api-access-sxkcg" (OuterVolumeSpecName: "kube-api-access-sxkcg") pod "ce1f23f3-fbe0-4932-925d-f256589ccd55" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55"). InnerVolumeSpecName "kube-api-access-sxkcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:00:37.475934 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.475868 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ce1f23f3-fbe0-4932-925d-f256589ccd55" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:00:37.481615 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.481589 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1f23f3-fbe0-4932-925d-f256589ccd55-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ce1f23f3-fbe0-4932-925d-f256589ccd55" (UID: "ce1f23f3-fbe0-4932-925d-f256589ccd55"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:00:37.574368 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.574348 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-certificates\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:00:37.574368 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.574368 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-bound-sa-token\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:00:37.574484 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.574378 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1f23f3-fbe0-4932-925d-f256589ccd55-trusted-ca\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:00:37.574484 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.574386 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce1f23f3-fbe0-4932-925d-f256589ccd55-ca-trust-extracted\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:00:37.574484 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.574395 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-image-registry-private-configuration\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:00:37.574484 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.574404 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-registry-tls\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:00:37.574484 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.574412 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce1f23f3-fbe0-4932-925d-f256589ccd55-installation-pull-secrets\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:00:37.574484 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:37.574420 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxkcg\" (UniqueName: \"kubernetes.io/projected/ce1f23f3-fbe0-4932-925d-f256589ccd55-kube-api-access-sxkcg\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:00:38.011829 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:38.011795 2561 generic.go:356] "Generic (PLEG): container finished" podID="ce1f23f3-fbe0-4932-925d-f256589ccd55" containerID="bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a" exitCode=0 Jun 14 15:00:38.012023 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:38.011845 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69695b579c-db45k" Jun 14 15:00:38.012023 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:38.011879 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69695b579c-db45k" event={"ID":"ce1f23f3-fbe0-4932-925d-f256589ccd55","Type":"ContainerDied","Data":"bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a"} Jun 14 15:00:38.012023 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:38.011929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69695b579c-db45k" event={"ID":"ce1f23f3-fbe0-4932-925d-f256589ccd55","Type":"ContainerDied","Data":"0b1d7122f8e6435249fbc20a1b3aca3ea0bff09ddee2614b587d005099ec09ab"} Jun 14 15:00:38.012023 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:38.011950 2561 scope.go:117] "RemoveContainer" containerID="bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a" Jun 14 15:00:38.019962 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:38.019947 2561 scope.go:117] "RemoveContainer" containerID="bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a" Jun 14 15:00:38.020241 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:00:38.020215 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a\": container with ID starting with bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a not found: ID does not exist" containerID="bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a" Jun 14 15:00:38.020292 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:38.020250 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a"} err="failed to get container status \"bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a\": rpc error: code = NotFound desc = could not find container \"bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a\": container with ID starting with bf290027f9ad4de452f345e201fa33b90bb296287f86d59e601a83bd5a76de6a not found: ID does not exist" Jun 14 15:00:38.031684 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:38.031659 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69695b579c-db45k"] Jun 14 15:00:38.034826 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:38.034807 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69695b579c-db45k"] Jun 14 15:00:38.625545 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:38.625511 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce1f23f3-fbe0-4932-925d-f256589ccd55" path="/var/lib/kubelet/pods/ce1f23f3-fbe0-4932-925d-f256589ccd55/volumes" Jun 14 15:00:47.714563 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:47.714488 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:47.814785 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:00:47.814754 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:00.950442 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:00.950403 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:01.051026 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:01.050992 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:03.555029 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:03.554976 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:03.608736 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:03.608683 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:03.674260 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:03.674230 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:09.605372 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:09.605338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 15:01:09.607678 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:09.607659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2d1037-187f-4b35-a752-59bfae3a464e-metrics-certs\") pod \"network-metrics-daemon-9j2l2\" (UID: \"fa2d1037-187f-4b35-a752-59bfae3a464e\") " pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 15:01:09.724183 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:09.724155 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zrcbh\"" Jun 14 15:01:09.732054 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:09.732037 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9j2l2" Jun 14 15:01:09.858436 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:09.858364 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9j2l2"] Jun 14 15:01:09.861904 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:01:09.861870 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2d1037_187f_4b35_a752_59bfae3a464e.slice/crio-f78fe7c780a5f253e2cffa3088e6dc8e2cc1aa5a0364cc8259d81e167036a056 WatchSource:0}: Error finding container f78fe7c780a5f253e2cffa3088e6dc8e2cc1aa5a0364cc8259d81e167036a056: Status 404 returned error can't find the container with id f78fe7c780a5f253e2cffa3088e6dc8e2cc1aa5a0364cc8259d81e167036a056 Jun 14 15:01:09.863950 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:09.863935 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:01:10.112603 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:10.112522 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9j2l2" event={"ID":"fa2d1037-187f-4b35-a752-59bfae3a464e","Type":"ContainerStarted","Data":"f78fe7c780a5f253e2cffa3088e6dc8e2cc1aa5a0364cc8259d81e167036a056"} Jun 14 15:01:11.117118 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:11.117032 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9j2l2" event={"ID":"fa2d1037-187f-4b35-a752-59bfae3a464e","Type":"ContainerStarted","Data":"3939d8363327c21f27a0fe45d9169e2f0245974030381abbacdc62f8e1053eef"} Jun 14 15:01:11.117118 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:11.117081 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9j2l2" event={"ID":"fa2d1037-187f-4b35-a752-59bfae3a464e","Type":"ContainerStarted","Data":"7ab1d1ea8f57e115ace107ab25bc366481c352389180d11f58d10dbc75056c08"} Jun 14 15:01:11.134412 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:11.134372 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9j2l2" podStartSLOduration=374.165298013 podStartE2EDuration="6m15.134357965s" totalImagesPullingTime="969.059952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:01:11.133561893 +0000 UTC m=+375.022787315" watchObservedRunningTime="2026-06-14 15:01:11.134357965 +0000 UTC m=+375.023583365" Jun 14 15:01:11.231096 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:11.231018 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:11.300361 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:11.300320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:16.874147 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:16.874108 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:17.011074 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:17.011039 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:17.069897 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:17.069873 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:17.506999 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:17.506963 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:17.607956 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:17.607931 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:17.659750 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:17.659720 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:18.552837 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:18.552803 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:18.602987 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:18.602959 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:27.324450 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:27.324421 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:27.425335 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:27.425295 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:27.488659 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:27.488630 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:33.567394 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:33.567361 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:33.667676 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:33.667650 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:59.219516 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:59.219473 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:59.267087 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:01:59.267054 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:20.758441 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:20.758363 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:20.856777 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:20.856743 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:34.984430 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:34.984393 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:39.948759 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:39.948722 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:47.243950 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:47.243921 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:48.054341 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:48.054306 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:50.876781 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:50.876742 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:50.965208 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:50.965165 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:51.884589 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:51.884555 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:51.992682 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:51.992628 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:52.094291 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:52.094250 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:55.346217 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:55.346171 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:55.743281 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:55.743207 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:57.446020 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:57.445986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:57.547283 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:57.547252 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:59.917223 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:59.917172 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dprmr"] Jun 14 15:02:59.917664 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:59.917497 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1f23f3-fbe0-4932-925d-f256589ccd55" containerName="registry" Jun 14 15:02:59.917664 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:59.917514 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1f23f3-fbe0-4932-925d-f256589ccd55" containerName="registry" Jun 14 15:02:59.917664 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:59.917582 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1f23f3-fbe0-4932-925d-f256589ccd55" containerName="registry" Jun 14 15:02:59.920367 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:59.920349 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" Jun 14 15:02:59.922644 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:59.922622 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 15:02:59.923600 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:59.923580 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-l52bw\"" Jun 14 15:02:59.923690 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:59.923615 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 15:02:59.927865 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:02:59.927847 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dprmr"] Jun 14 15:03:00.026671 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:00.026630 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xv5n\" (UniqueName: \"kubernetes.io/projected/5ab6feb0-1f41-4a87-ac1d-98479d186376-kube-api-access-9xv5n\") pod \"cert-manager-cainjector-5d99449ffd-dprmr\" (UID: \"5ab6feb0-1f41-4a87-ac1d-98479d186376\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" Jun 14 15:03:00.026814 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:00.026730 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ab6feb0-1f41-4a87-ac1d-98479d186376-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dprmr\" (UID: \"5ab6feb0-1f41-4a87-ac1d-98479d186376\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" Jun 14 15:03:00.127592 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:00.127563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xv5n\" (UniqueName: \"kubernetes.io/projected/5ab6feb0-1f41-4a87-ac1d-98479d186376-kube-api-access-9xv5n\") pod \"cert-manager-cainjector-5d99449ffd-dprmr\" (UID: \"5ab6feb0-1f41-4a87-ac1d-98479d186376\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" Jun 14 15:03:00.127685 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:00.127603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ab6feb0-1f41-4a87-ac1d-98479d186376-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dprmr\" (UID: \"5ab6feb0-1f41-4a87-ac1d-98479d186376\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" Jun 14 15:03:00.136385 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:00.136355 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ab6feb0-1f41-4a87-ac1d-98479d186376-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-dprmr\" (UID: \"5ab6feb0-1f41-4a87-ac1d-98479d186376\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" Jun 14 15:03:00.136523 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:00.136501 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xv5n\" (UniqueName: \"kubernetes.io/projected/5ab6feb0-1f41-4a87-ac1d-98479d186376-kube-api-access-9xv5n\") pod \"cert-manager-cainjector-5d99449ffd-dprmr\" (UID: \"5ab6feb0-1f41-4a87-ac1d-98479d186376\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" Jun 14 15:03:00.229579 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:00.229492 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" Jun 14 15:03:00.348020 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:00.347988 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-dprmr"] Jun 14 15:03:00.350988 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:03:00.350961 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ab6feb0_1f41_4a87_ac1d_98479d186376.slice/crio-dbd3b0e1a101c2d12540fa8bd3e4db07966ba04852d5592c4823b64d23a3fe79 WatchSource:0}: Error finding container dbd3b0e1a101c2d12540fa8bd3e4db07966ba04852d5592c4823b64d23a3fe79: Status 404 returned error can't find the container with id dbd3b0e1a101c2d12540fa8bd3e4db07966ba04852d5592c4823b64d23a3fe79 Jun 14 15:03:00.459385 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:00.459354 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" event={"ID":"5ab6feb0-1f41-4a87-ac1d-98479d186376","Type":"ContainerStarted","Data":"dbd3b0e1a101c2d12540fa8bd3e4db07966ba04852d5592c4823b64d23a3fe79"} Jun 14 15:03:02.937904 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:02.937864 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:03.471018 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:03.470984 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" event={"ID":"5ab6feb0-1f41-4a87-ac1d-98479d186376","Type":"ContainerStarted","Data":"eb297c6c6391df0243a7efe312176ac6aff66272c1ce0e881bcd3ae4e119a2c5"} Jun 14 15:03:03.488311 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:03.488263 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-dprmr" podStartSLOduration=1.444960684 podStartE2EDuration="4.48824852s" totalImagesPullingTime="3.043287836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:03:03.487000104 +0000 UTC m=+487.376225505" watchObservedRunningTime="2026-06-14 15:03:03.48824852 +0000 UTC m=+487.377473919" Jun 14 15:03:04.072280 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:04.072246 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:04.172344 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:04.172315 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:04.722655 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:04.722617 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:04.790286 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:04.790257 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:10.411351 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:10.411321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:10.511799 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:10.511767 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:12.511644 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:12.511615 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:27.899788 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:27.899752 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:27.989928 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:27.989897 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:28.529304 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.529267 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:28.750318 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.750287 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:28.851917 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.851893 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:28.878564 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.878525 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl"] Jun 14 15:03:28.881552 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.881538 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:28.883964 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.883937 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 15:03:28.884074 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.883990 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 15:03:28.884074 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.884056 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-msgfl\"" Jun 14 15:03:28.884494 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.884473 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 15:03:28.884606 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.884508 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 15:03:28.901082 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.901059 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl"] Jun 14 15:03:28.904275 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.904251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f53f866-be92-4d9c-888e-d425cf4ac0a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:28.904362 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.904296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f53f866-be92-4d9c-888e-d425cf4ac0a5-tmp\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:28.904411 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.904355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f53f866-be92-4d9c-888e-d425cf4ac0a5-manifests\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:28.904411 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.904402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqwsc\" (UniqueName: \"kubernetes.io/projected/0f53f866-be92-4d9c-888e-d425cf4ac0a5-kube-api-access-vqwsc\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:28.904492 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:28.904430 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f53f866-be92-4d9c-888e-d425cf4ac0a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.005073 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.005039 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f53f866-be92-4d9c-888e-d425cf4ac0a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.005269 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.005084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f53f866-be92-4d9c-888e-d425cf4ac0a5-tmp\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.005352 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.005328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f53f866-be92-4d9c-888e-d425cf4ac0a5-manifests\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.005418 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.005370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqwsc\" (UniqueName: \"kubernetes.io/projected/0f53f866-be92-4d9c-888e-d425cf4ac0a5-kube-api-access-vqwsc\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.005418 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.005397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f53f866-be92-4d9c-888e-d425cf4ac0a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.005742 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.005718 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f53f866-be92-4d9c-888e-d425cf4ac0a5-manifests\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.007497 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.007479 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f53f866-be92-4d9c-888e-d425cf4ac0a5-tmp\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.007631 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.007613 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f53f866-be92-4d9c-888e-d425cf4ac0a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.007708 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.007690 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f53f866-be92-4d9c-888e-d425cf4ac0a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.012851 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.012823 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:29.015709 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.015687 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqwsc\" (UniqueName: \"kubernetes.io/projected/0f53f866-be92-4d9c-888e-d425cf4ac0a5-kube-api-access-vqwsc\") pod \"opendatahub-operator-controller-manager-8b6c5698-mqxfl\" (UID: \"0f53f866-be92-4d9c-888e-d425cf4ac0a5\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.135567 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.135497 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:29.191549 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.191529 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:29.219103 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.219077 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:29.320249 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.320214 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl"] Jun 14 15:03:29.323019 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:03:29.322994 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f53f866_be92_4d9c_888e_d425cf4ac0a5.slice/crio-e26cdc711b1a9f34cbf9ae579e664098968163ec0da8cf9fef1a47621674fe9e WatchSource:0}: Error finding container e26cdc711b1a9f34cbf9ae579e664098968163ec0da8cf9fef1a47621674fe9e: Status 404 returned error can't find the container with id e26cdc711b1a9f34cbf9ae579e664098968163ec0da8cf9fef1a47621674fe9e Jun 14 15:03:29.323592 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.323558 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:29.419899 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.419809 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:29.564553 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:29.564513 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" event={"ID":"0f53f866-be92-4d9c-888e-d425cf4ac0a5","Type":"ContainerStarted","Data":"e26cdc711b1a9f34cbf9ae579e664098968163ec0da8cf9fef1a47621674fe9e"} Jun 14 15:03:32.576021 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:32.575986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" event={"ID":"0f53f866-be92-4d9c-888e-d425cf4ac0a5","Type":"ContainerStarted","Data":"036026a2ed636218c9980843baf112a4ea30f6c79d99a89e9191a8e6da4697b1"} Jun 14 15:03:33.581143 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:33.581113 2561 generic.go:356] "Generic (PLEG): container finished" podID="0f53f866-be92-4d9c-888e-d425cf4ac0a5" containerID="036026a2ed636218c9980843baf112a4ea30f6c79d99a89e9191a8e6da4697b1" exitCode=0 Jun 14 15:03:33.581516 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:33.581181 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" event={"ID":"0f53f866-be92-4d9c-888e-d425cf4ac0a5","Type":"ContainerDied","Data":"036026a2ed636218c9980843baf112a4ea30f6c79d99a89e9191a8e6da4697b1"} Jun 14 15:03:34.587720 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:34.587679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" event={"ID":"0f53f866-be92-4d9c-888e-d425cf4ac0a5","Type":"ContainerStarted","Data":"b3d8bb8f0cfafcdf1a2ec1dfa2b417627671a41417e35524b5e5933a350bf9fa"} Jun 14 15:03:34.588126 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:34.587790 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:34.608768 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:34.608716 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" podStartSLOduration=2.481588384 podStartE2EDuration="6.608696248s" totalImagesPullingTime="3.143508098s" totalInitContainerRuntime="983.599766ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:03:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:03:34.606621857 +0000 UTC m=+518.495847268" watchObservedRunningTime="2026-06-14 15:03:34.608696248 +0000 UTC m=+518.497921654" Jun 14 15:03:41.017487 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:41.017452 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:41.115112 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:41.115076 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:45.594124 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:45.594049 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-mqxfl" Jun 14 15:03:56.693410 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:56.693372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:57.548045 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.548003 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g"] Jun 14 15:03:57.552578 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.552558 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.554954 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.554928 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 15:03:57.554954 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.554946 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 15:03:57.555112 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.554952 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 15:03:57.555976 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.555955 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 15:03:57.556035 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.556000 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:03:57.556035 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.556014 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fs7lb\"" Jun 14 15:03:57.561281 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.561260 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g"] Jun 14 15:03:57.585893 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.585861 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba2a705a-e545-477f-ba60-9c38fc124be6-metrics-cert\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.586015 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.585913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba2a705a-e545-477f-ba60-9c38fc124be6-cert\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.586015 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.585941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsv9k\" (UniqueName: \"kubernetes.io/projected/ba2a705a-e545-477f-ba60-9c38fc124be6-kube-api-access-zsv9k\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.586015 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.585964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ba2a705a-e545-477f-ba60-9c38fc124be6-manager-config\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.686501 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.686458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsv9k\" (UniqueName: \"kubernetes.io/projected/ba2a705a-e545-477f-ba60-9c38fc124be6-kube-api-access-zsv9k\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.686501 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.686504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ba2a705a-e545-477f-ba60-9c38fc124be6-manager-config\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.686708 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.686545 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba2a705a-e545-477f-ba60-9c38fc124be6-metrics-cert\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.686708 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.686577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba2a705a-e545-477f-ba60-9c38fc124be6-cert\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.687325 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.687264 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ba2a705a-e545-477f-ba60-9c38fc124be6-manager-config\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.689223 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.689204 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba2a705a-e545-477f-ba60-9c38fc124be6-cert\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.689312 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.689291 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba2a705a-e545-477f-ba60-9c38fc124be6-metrics-cert\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.694861 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.694838 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsv9k\" (UniqueName: \"kubernetes.io/projected/ba2a705a-e545-477f-ba60-9c38fc124be6-kube-api-access-zsv9k\") pod \"lws-controller-manager-7d55879689-hhw4g\" (UID: \"ba2a705a-e545-477f-ba60-9c38fc124be6\") " pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.862308 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.862278 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:03:57.989078 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:57.989049 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g"] Jun 14 15:03:57.991447 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:03:57.991419 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba2a705a_e545_477f_ba60_9c38fc124be6.slice/crio-5805b4f2164cf086086234889f134aad50736c04836d1b7647788803851e774d WatchSource:0}: Error finding container 5805b4f2164cf086086234889f134aad50736c04836d1b7647788803851e774d: Status 404 returned error can't find the container with id 5805b4f2164cf086086234889f134aad50736c04836d1b7647788803851e774d Jun 14 15:03:58.670894 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:03:58.670851 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" event={"ID":"ba2a705a-e545-477f-ba60-9c38fc124be6","Type":"ContainerStarted","Data":"5805b4f2164cf086086234889f134aad50736c04836d1b7647788803851e774d"} Jun 14 15:04:00.680073 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:00.680031 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" event={"ID":"ba2a705a-e545-477f-ba60-9c38fc124be6","Type":"ContainerStarted","Data":"c37dc12aa5bb3a23a145327a6dc2bcc5c21401b2a0cd84782321ee8020b57e41"} Jun 14 15:04:00.680476 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:00.680210 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:04:03.637181 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:03.637150 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:11.687229 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:11.687182 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" Jun 14 15:04:11.707370 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:11.707324 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d55879689-hhw4g" podStartSLOduration=12.422500866 podStartE2EDuration="14.707308205s" totalImagesPullingTime="2.284807339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:00.714550458 +0000 UTC m=+544.603775857" watchObservedRunningTime="2026-06-14 15:04:11.707308205 +0000 UTC m=+555.596533606" Jun 14 15:04:33.558613 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:33.558579 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:34.693730 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:34.693695 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:34.812225 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:34.812152 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:34.913311 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:34.913276 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:35.013564 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:35.013462 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:35.253063 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:35.253031 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:35.613469 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:35.613414 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:35.714060 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:35.714029 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:43.330722 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:43.330690 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:43.441645 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:43.441597 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:43.909714 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:43.909678 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:44.032729 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:44.032679 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:44.252008 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:44.251896 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:44.621029 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:44.620971 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:45.250356 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:45.250322 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:45.347100 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:45.347072 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:48.545535 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:48.545467 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:48.658973 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:48.658933 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:49.951762 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:49.951727 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:50.064153 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.064116 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:50.396770 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.396735 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:50.596207 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.596167 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-f68ccfc94-qd72q"] Jun 14 15:04:50.599293 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.599267 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" Jun 14 15:04:50.607666 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.607646 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vgt2v\"" Jun 14 15:04:50.625533 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.625498 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 15:04:50.628064 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.628041 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f68ccfc94-qd72q"] Jun 14 15:04:50.651043 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.650965 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:50.682117 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.682077 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c7587307-f933-423a-8b56-6e54a4cd7063-redirect-config\") pod \"dashboard-redirect-f68ccfc94-qd72q\" (UID: \"c7587307-f933-423a-8b56-6e54a4cd7063\") " pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" Jun 14 15:04:50.682117 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.682118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptlkw\" (UniqueName: \"kubernetes.io/projected/c7587307-f933-423a-8b56-6e54a4cd7063-kube-api-access-ptlkw\") pod \"dashboard-redirect-f68ccfc94-qd72q\" (UID: \"c7587307-f933-423a-8b56-6e54a4cd7063\") " pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" Jun 14 15:04:50.776944 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.776907 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:50.783640 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.783615 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c7587307-f933-423a-8b56-6e54a4cd7063-redirect-config\") pod \"dashboard-redirect-f68ccfc94-qd72q\" (UID: \"c7587307-f933-423a-8b56-6e54a4cd7063\") " pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" Jun 14 15:04:50.783761 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.783656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptlkw\" (UniqueName: \"kubernetes.io/projected/c7587307-f933-423a-8b56-6e54a4cd7063-kube-api-access-ptlkw\") pod \"dashboard-redirect-f68ccfc94-qd72q\" (UID: \"c7587307-f933-423a-8b56-6e54a4cd7063\") " pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" Jun 14 15:04:50.784488 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.784461 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c7587307-f933-423a-8b56-6e54a4cd7063-redirect-config\") pod \"dashboard-redirect-f68ccfc94-qd72q\" (UID: \"c7587307-f933-423a-8b56-6e54a4cd7063\") " pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" Jun 14 15:04:50.793045 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.793022 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptlkw\" (UniqueName: \"kubernetes.io/projected/c7587307-f933-423a-8b56-6e54a4cd7063-kube-api-access-ptlkw\") pod \"dashboard-redirect-f68ccfc94-qd72q\" (UID: \"c7587307-f933-423a-8b56-6e54a4cd7063\") " pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" Jun 14 15:04:50.909703 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.909623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" Jun 14 15:04:50.964716 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:50.964690 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:51.060856 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:51.060831 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f68ccfc94-qd72q"] Jun 14 15:04:51.062666 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:04:51.062634 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7587307_f933_423a_8b56_6e54a4cd7063.slice/crio-c2175a31590282555033b8148ef48ecf13e2bd8615e5f187461093be3fedadf3 WatchSource:0}: Error finding container c2175a31590282555033b8148ef48ecf13e2bd8615e5f187461093be3fedadf3: Status 404 returned error can't find the container with id c2175a31590282555033b8148ef48ecf13e2bd8615e5f187461093be3fedadf3 Jun 14 15:04:51.855677 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:51.855635 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" event={"ID":"c7587307-f933-423a-8b56-6e54a4cd7063","Type":"ContainerStarted","Data":"c2175a31590282555033b8148ef48ecf13e2bd8615e5f187461093be3fedadf3"} Jun 14 15:04:53.863045 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:53.863005 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" event={"ID":"c7587307-f933-423a-8b56-6e54a4cd7063","Type":"ContainerStarted","Data":"daad713dff6ebe50210651ac67ab72342f9c26a3b6058b476833262961f9c9d6"} Jun 14 15:04:53.882586 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:53.882542 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-f68ccfc94-qd72q" podStartSLOduration=2.037480455 podStartE2EDuration="3.882528212s" totalImagesPullingTime="1.845047757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:53.880616594 +0000 UTC m=+597.769842008" watchObservedRunningTime="2026-06-14 15:04:53.882528212 +0000 UTC m=+597.771753612" Jun 14 15:04:56.587596 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:56.587567 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:04:56.589613 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:56.589587 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:04:57.474733 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:57.474696 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:04:57.543603 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:04:57.543569 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:01.184935 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:01.184893 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:01.285913 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:01.285879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:08.685256 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:08.685223 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:08.785364 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:08.785325 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:11.229357 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:11.229323 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:11.328605 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:11.328563 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:11.760459 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:11.760424 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:16.401392 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.401311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:16.501108 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.501076 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:16.661978 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.661898 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb"] Jun 14 15:05:16.665237 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.665213 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.667816 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.667797 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-brcfd\"" Jun 14 15:05:16.668093 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.668073 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 15:05:16.668093 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.668081 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 15:05:16.668228 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.668211 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 15:05:16.674563 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.674540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8rmd\" (UniqueName: \"kubernetes.io/projected/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-kube-api-access-f8rmd\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.674663 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.674577 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.674663 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.674602 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.674663 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.674626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.674810 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.674679 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.674810 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.674710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.674810 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.674737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.674810 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.674792 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.674950 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.674832 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.681007 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.680985 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb"] Jun 14 15:05:16.715729 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.715706 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:16.775408 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.775378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.775408 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.775411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.775590 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.775431 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.775590 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.775466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.775590 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.775499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.775590 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.775539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8rmd\" (UniqueName: \"kubernetes.io/projected/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-kube-api-access-f8rmd\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.775590 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.775567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.775841 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.775652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.775841 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.775696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.776097 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.776060 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.776231 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.776086 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.776231 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.776182 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.776354 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.776273 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.776527 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.776507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.777844 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.777821 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.778049 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.778033 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.793589 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.793570 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.796737 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.796717 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8rmd\" (UniqueName: \"kubernetes.io/projected/0af4f781-f4c1-452c-8ce6-3e828c8b6b6c-kube-api-access-f8rmd\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w54kb\" (UID: \"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:16.814985 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.814963 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:16.948071 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.947994 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:16.974902 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:16.974871 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:17.117855 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:17.117833 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb"] Jun 14 15:05:17.120547 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:05:17.120521 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af4f781_f4c1_452c_8ce6_3e828c8b6b6c.slice/crio-f3e902f8a7722b0f08de5af3b78aceaa526a4c284e6dbcfc7b19d0a455930245 WatchSource:0}: Error finding container f3e902f8a7722b0f08de5af3b78aceaa526a4c284e6dbcfc7b19d0a455930245: Status 404 returned error can't find the container with id f3e902f8a7722b0f08de5af3b78aceaa526a4c284e6dbcfc7b19d0a455930245 Jun 14 15:05:17.558082 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:17.558049 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:17.950552 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:17.950517 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" event={"ID":"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c","Type":"ContainerStarted","Data":"f3e902f8a7722b0f08de5af3b78aceaa526a4c284e6dbcfc7b19d0a455930245"} Jun 14 15:05:20.224050 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:20.224010 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:05:20.224359 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:20.224106 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:05:20.224359 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:20.224135 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:05:20.964845 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:20.964801 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" event={"ID":"0af4f781-f4c1-452c-8ce6-3e828c8b6b6c","Type":"ContainerStarted","Data":"845e8bfce092d9c217f9d34730734095eb566a10a77972a9142c1d0a12a8cb77"} Jun 14 15:05:20.975524 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:20.975501 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:20.989033 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:20.988990 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" podStartSLOduration=1.887615966 podStartE2EDuration="4.988977312s" totalImagesPullingTime="3.101361346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:05:20.986795241 +0000 UTC m=+624.876020640" watchObservedRunningTime="2026-06-14 15:05:20.988977312 +0000 UTC m=+624.878202712" Jun 14 15:05:21.980100 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:21.980071 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:22.976756 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:22.974971 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:22.977615 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:22.977588 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w54kb" Jun 14 15:05:36.084688 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.084653 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:36.173600 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.173572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:36.188289 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.188264 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r2t5z"] Jun 14 15:05:36.200715 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.200631 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" Jun 14 15:05:36.201415 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.201383 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r2t5z"] Jun 14 15:05:36.203265 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.203139 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 15:05:36.203484 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.203462 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6tkxp\"" Jun 14 15:05:36.204292 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.204271 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 15:05:36.258978 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.258948 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:36.323229 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.323175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx59r\" (UniqueName: \"kubernetes.io/projected/bacee16a-8fe3-4169-892a-94a64bd552f0-kube-api-access-mx59r\") pod \"kuadrant-operator-catalog-r2t5z\" (UID: \"bacee16a-8fe3-4169-892a-94a64bd552f0\") " pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" Jun 14 15:05:36.424461 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.424425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx59r\" (UniqueName: \"kubernetes.io/projected/bacee16a-8fe3-4169-892a-94a64bd552f0-kube-api-access-mx59r\") pod \"kuadrant-operator-catalog-r2t5z\" (UID: \"bacee16a-8fe3-4169-892a-94a64bd552f0\") " pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" Jun 14 15:05:36.432819 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.432795 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx59r\" (UniqueName: \"kubernetes.io/projected/bacee16a-8fe3-4169-892a-94a64bd552f0-kube-api-access-mx59r\") pod \"kuadrant-operator-catalog-r2t5z\" (UID: \"bacee16a-8fe3-4169-892a-94a64bd552f0\") " pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" Jun 14 15:05:36.511318 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.511284 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" Jun 14 15:05:36.563313 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.563281 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r2t5z"] Jun 14 15:05:36.640039 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.639963 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r2t5z"] Jun 14 15:05:36.642649 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:05:36.642625 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbacee16a_8fe3_4169_892a_94a64bd552f0.slice/crio-2f70388b79fb3c40e3ec53ff71a460a4e2ff6af930c22197d8a0739b4a64882a WatchSource:0}: Error finding container 2f70388b79fb3c40e3ec53ff71a460a4e2ff6af930c22197d8a0739b4a64882a: Status 404 returned error can't find the container with id 2f70388b79fb3c40e3ec53ff71a460a4e2ff6af930c22197d8a0739b4a64882a Jun 14 15:05:36.769439 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.769403 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-spgxc"] Jun 14 15:05:36.774003 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.773983 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-spgxc" Jun 14 15:05:36.781292 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.781257 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-spgxc"] Jun 14 15:05:36.827330 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.827307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8mnj\" (UniqueName: \"kubernetes.io/projected/52607ae4-b0ba-43a4-932c-357bf2879aaf-kube-api-access-j8mnj\") pod \"kuadrant-operator-catalog-spgxc\" (UID: \"52607ae4-b0ba-43a4-932c-357bf2879aaf\") " pod="kuadrant-system/kuadrant-operator-catalog-spgxc" Jun 14 15:05:36.927686 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.927600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8mnj\" (UniqueName: \"kubernetes.io/projected/52607ae4-b0ba-43a4-932c-357bf2879aaf-kube-api-access-j8mnj\") pod \"kuadrant-operator-catalog-spgxc\" (UID: \"52607ae4-b0ba-43a4-932c-357bf2879aaf\") " pod="kuadrant-system/kuadrant-operator-catalog-spgxc" Jun 14 15:05:36.938153 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.938134 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8mnj\" (UniqueName: \"kubernetes.io/projected/52607ae4-b0ba-43a4-932c-357bf2879aaf-kube-api-access-j8mnj\") pod \"kuadrant-operator-catalog-spgxc\" (UID: \"52607ae4-b0ba-43a4-932c-357bf2879aaf\") " pod="kuadrant-system/kuadrant-operator-catalog-spgxc" Jun 14 15:05:36.988126 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:36.988097 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:37.023889 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:37.023857 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" event={"ID":"bacee16a-8fe3-4169-892a-94a64bd552f0","Type":"ContainerStarted","Data":"2f70388b79fb3c40e3ec53ff71a460a4e2ff6af930c22197d8a0739b4a64882a"} Jun 14 15:05:37.084306 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:37.084277 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-spgxc" Jun 14 15:05:37.201752 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:37.201681 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:05:37.225842 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:37.225814 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-spgxc"] Jun 14 15:05:37.228967 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:05:37.228940 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52607ae4_b0ba_43a4_932c_357bf2879aaf.slice/crio-03d6b9978c02f9d3c417761261bc3748c258c6c8ea64801b6b98fa9d4b41d522 WatchSource:0}: Error finding container 03d6b9978c02f9d3c417761261bc3748c258c6c8ea64801b6b98fa9d4b41d522: Status 404 returned error can't find the container with id 03d6b9978c02f9d3c417761261bc3748c258c6c8ea64801b6b98fa9d4b41d522 Jun 14 15:05:38.030259 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:38.030218 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-spgxc" event={"ID":"52607ae4-b0ba-43a4-932c-357bf2879aaf","Type":"ContainerStarted","Data":"03d6b9978c02f9d3c417761261bc3748c258c6c8ea64801b6b98fa9d4b41d522"} Jun 14 15:05:39.035543 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:39.035448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" event={"ID":"bacee16a-8fe3-4169-892a-94a64bd552f0","Type":"ContainerStarted","Data":"8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515"} Jun 14 15:05:39.035543 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:39.035539 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" podUID="bacee16a-8fe3-4169-892a-94a64bd552f0" containerName="registry-server" containerID="cri-o://8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515" gracePeriod=2 Jun 14 15:05:39.036997 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:39.036971 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-spgxc" event={"ID":"52607ae4-b0ba-43a4-932c-357bf2879aaf","Type":"ContainerStarted","Data":"553843baa32cf8a1832743e33ae32c2ba610386a653679aae83bb56874478c0c"} Jun 14 15:05:39.053828 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:39.053785 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" podStartSLOduration=0.942730264 podStartE2EDuration="3.053772194s" totalImagesPullingTime="2.11104193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:05:39.052896737 +0000 UTC m=+642.942122179" watchObservedRunningTime="2026-06-14 15:05:39.053772194 +0000 UTC m=+642.942997594" Jun 14 15:05:39.069440 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:39.069399 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-spgxc" podStartSLOduration=1.541567455 podStartE2EDuration="3.069383578s" totalImagesPullingTime="1.527816123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:05:39.068471271 +0000 UTC m=+642.957696671" watchObservedRunningTime="2026-06-14 15:05:39.069383578 +0000 UTC m=+642.958608978" Jun 14 15:05:39.271603 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:39.271580 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" Jun 14 15:05:39.350063 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:39.350038 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx59r\" (UniqueName: \"kubernetes.io/projected/bacee16a-8fe3-4169-892a-94a64bd552f0-kube-api-access-mx59r\") pod \"bacee16a-8fe3-4169-892a-94a64bd552f0\" (UID: \"bacee16a-8fe3-4169-892a-94a64bd552f0\") " Jun 14 15:05:39.352289 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:39.352268 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bacee16a-8fe3-4169-892a-94a64bd552f0-kube-api-access-mx59r" (OuterVolumeSpecName: "kube-api-access-mx59r") pod "bacee16a-8fe3-4169-892a-94a64bd552f0" (UID: "bacee16a-8fe3-4169-892a-94a64bd552f0"). InnerVolumeSpecName "kube-api-access-mx59r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:05:39.450775 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:39.450729 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx59r\" (UniqueName: \"kubernetes.io/projected/bacee16a-8fe3-4169-892a-94a64bd552f0-kube-api-access-mx59r\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:05:40.046597 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:40.046510 2561 generic.go:356] "Generic (PLEG): container finished" podID="bacee16a-8fe3-4169-892a-94a64bd552f0" containerID="8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515" exitCode=0 Jun 14 15:05:40.046597 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:40.046562 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" Jun 14 15:05:40.047094 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:40.046599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" event={"ID":"bacee16a-8fe3-4169-892a-94a64bd552f0","Type":"ContainerDied","Data":"8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515"} Jun 14 15:05:40.047094 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:40.046682 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r2t5z" event={"ID":"bacee16a-8fe3-4169-892a-94a64bd552f0","Type":"ContainerDied","Data":"2f70388b79fb3c40e3ec53ff71a460a4e2ff6af930c22197d8a0739b4a64882a"} Jun 14 15:05:40.047094 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:40.046712 2561 scope.go:117] "RemoveContainer" containerID="8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515" Jun 14 15:05:40.054850 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:40.054834 2561 scope.go:117] "RemoveContainer" containerID="8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515" Jun 14 15:05:40.055089 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:05:40.055072 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515\": container with ID starting with 8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515 not found: ID does not exist" containerID="8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515" Jun 14 15:05:40.055127 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:40.055098 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515"} err="failed to get container status \"8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515\": rpc error: code = NotFound desc = could not find container \"8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515\": container with ID starting with 8c96fec34ef910066ffcea3d01a4d5fa7d14fa15154278b407110d3fe0682515 not found: ID does not exist" Jun 14 15:05:40.066265 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:40.066241 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r2t5z"] Jun 14 15:05:40.069612 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:40.069591 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r2t5z"] Jun 14 15:05:40.625701 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:40.625668 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bacee16a-8fe3-4169-892a-94a64bd552f0" path="/var/lib/kubelet/pods/bacee16a-8fe3-4169-892a-94a64bd552f0/volumes" Jun 14 15:05:47.084718 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:47.084684 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-spgxc" Jun 14 15:05:47.085245 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:47.084740 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-spgxc" Jun 14 15:05:47.106391 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:47.106368 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-spgxc" Jun 14 15:05:48.095663 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:05:48.095635 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-spgxc" Jun 14 15:06:04.551975 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:04.551938 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:05.153152 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:05.153089 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:06.229044 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:06.229011 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:06.379792 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:06.379760 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:08.668483 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.668445 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4"] Jun 14 15:06:08.668944 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.668852 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bacee16a-8fe3-4169-892a-94a64bd552f0" containerName="registry-server" Jun 14 15:06:08.668944 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.668871 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bacee16a-8fe3-4169-892a-94a64bd552f0" containerName="registry-server" Jun 14 15:06:08.668944 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.668931 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bacee16a-8fe3-4169-892a-94a64bd552f0" containerName="registry-server" Jun 14 15:06:08.676847 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.676820 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4" Jun 14 15:06:08.679966 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.679951 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vhz8h\"" Jun 14 15:06:08.686068 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.686043 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4"] Jun 14 15:06:08.868846 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.868814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xslx\" (UniqueName: \"kubernetes.io/projected/32ff0340-fe81-45b2-8097-fdf0e4049b43-kube-api-access-8xslx\") pod \"authorino-operator-75cc8d5cb7-g6zd4\" (UID: \"32ff0340-fe81-45b2-8097-fdf0e4049b43\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4" Jun 14 15:06:08.969429 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.969333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xslx\" (UniqueName: \"kubernetes.io/projected/32ff0340-fe81-45b2-8097-fdf0e4049b43-kube-api-access-8xslx\") pod \"authorino-operator-75cc8d5cb7-g6zd4\" (UID: \"32ff0340-fe81-45b2-8097-fdf0e4049b43\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4" Jun 14 15:06:08.983295 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.983272 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xslx\" (UniqueName: \"kubernetes.io/projected/32ff0340-fe81-45b2-8097-fdf0e4049b43-kube-api-access-8xslx\") pod \"authorino-operator-75cc8d5cb7-g6zd4\" (UID: \"32ff0340-fe81-45b2-8097-fdf0e4049b43\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4" Jun 14 15:06:08.987201 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:08.987172 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4" Jun 14 15:06:09.122484 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:09.122298 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4"] Jun 14 15:06:09.125075 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:06:09.125048 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ff0340_fe81_45b2_8097_fdf0e4049b43.slice/crio-c38ede4a0ac69e986b97f6ef9a472a43d760ac325db54e6d4390acd41cd5cacf WatchSource:0}: Error finding container c38ede4a0ac69e986b97f6ef9a472a43d760ac325db54e6d4390acd41cd5cacf: Status 404 returned error can't find the container with id c38ede4a0ac69e986b97f6ef9a472a43d760ac325db54e6d4390acd41cd5cacf Jun 14 15:06:09.150444 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:09.150411 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4" event={"ID":"32ff0340-fe81-45b2-8097-fdf0e4049b43","Type":"ContainerStarted","Data":"c38ede4a0ac69e986b97f6ef9a472a43d760ac325db54e6d4390acd41cd5cacf"} Jun 14 15:06:09.791337 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:09.791307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:11.958795 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:11.958759 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:12.165328 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:12.165289 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4" event={"ID":"32ff0340-fe81-45b2-8097-fdf0e4049b43","Type":"ContainerStarted","Data":"206a0847eb1f246a79c0610d02d409ad0b0d649853b888ecc52c81bc4c78fab5"} Jun 14 15:06:12.165533 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:12.165514 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4" Jun 14 15:06:12.224669 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:12.224571 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4" podStartSLOduration=2.00425476 podStartE2EDuration="4.224556408s" totalImagesPullingTime="2.220301648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:06:12.222522922 +0000 UTC m=+676.111748322" watchObservedRunningTime="2026-06-14 15:06:12.224556408 +0000 UTC m=+676.113781868" Jun 14 15:06:12.279778 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:12.279747 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:13.271178 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:13.271151 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:15.953646 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:15.953609 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:17.009263 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:17.009232 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:17.567848 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:17.567814 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9"] Jun 14 15:06:17.570791 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:17.570775 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:17.573388 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:17.573368 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cfsqd\"" Jun 14 15:06:17.582753 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:17.582732 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9"] Jun 14 15:06:17.631712 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:17.631680 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2896\" (UniqueName: \"kubernetes.io/projected/552b2129-475e-4b83-9a95-5794acf7e1f2-kube-api-access-z2896\") pod \"limitador-operator-controller-manager-859d7b78bd-w4sz9\" (UID: \"552b2129-475e-4b83-9a95-5794acf7e1f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:17.732254 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:17.732217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2896\" (UniqueName: \"kubernetes.io/projected/552b2129-475e-4b83-9a95-5794acf7e1f2-kube-api-access-z2896\") pod \"limitador-operator-controller-manager-859d7b78bd-w4sz9\" (UID: \"552b2129-475e-4b83-9a95-5794acf7e1f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:17.742267 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:17.742232 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2896\" (UniqueName: \"kubernetes.io/projected/552b2129-475e-4b83-9a95-5794acf7e1f2-kube-api-access-z2896\") pod \"limitador-operator-controller-manager-859d7b78bd-w4sz9\" (UID: \"552b2129-475e-4b83-9a95-5794acf7e1f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:17.880553 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:17.880526 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:18.013436 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:18.013411 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9"] Jun 14 15:06:18.016169 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:06:18.016140 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552b2129_475e_4b83_9a95_5794acf7e1f2.slice/crio-871b58357f2adc5d7d02829fb3875d46a4ef4eecf2638f77b1fdc831633ffb13 WatchSource:0}: Error finding container 871b58357f2adc5d7d02829fb3875d46a4ef4eecf2638f77b1fdc831633ffb13: Status 404 returned error can't find the container with id 871b58357f2adc5d7d02829fb3875d46a4ef4eecf2638f77b1fdc831633ffb13 Jun 14 15:06:18.018241 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:18.018221 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:06:18.188909 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:18.188821 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" event={"ID":"552b2129-475e-4b83-9a95-5794acf7e1f2","Type":"ContainerStarted","Data":"871b58357f2adc5d7d02829fb3875d46a4ef4eecf2638f77b1fdc831633ffb13"} Jun 14 15:06:18.962402 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:18.962363 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:19.063211 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:19.063162 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:19.365710 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:19.365680 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:19.432100 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:19.432069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:20.198385 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:20.198344 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" event={"ID":"552b2129-475e-4b83-9a95-5794acf7e1f2","Type":"ContainerStarted","Data":"330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489"} Jun 14 15:06:20.198832 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:20.198476 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:20.216117 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:20.216072 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" podStartSLOduration=1.509508609 podStartE2EDuration="3.216059997s" totalImagesPullingTime="1.706551388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:06:20.215037088 +0000 UTC m=+684.104262506" watchObservedRunningTime="2026-06-14 15:06:20.216059997 +0000 UTC m=+684.105285397" Jun 14 15:06:23.172159 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:23.172131 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g6zd4" Jun 14 15:06:23.186039 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:23.186013 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:23.298454 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:23.298413 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:27.390796 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:27.390760 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:27.634239 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:27.634208 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:28.555898 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:28.555860 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:28.620483 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:28.620454 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:31.204846 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:31.204816 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:34.772048 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:34.772013 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:34.871887 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:34.871855 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:37.713412 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.713375 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9"] Jun 14 15:06:37.713791 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.713565 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" podUID="552b2129-475e-4b83-9a95-5794acf7e1f2" containerName="manager" containerID="cri-o://330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489" gracePeriod=2 Jun 14 15:06:37.728873 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.728848 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9"] Jun 14 15:06:37.784441 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.784411 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7"] Jun 14 15:06:37.784744 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.784728 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552b2129-475e-4b83-9a95-5794acf7e1f2" containerName="manager" Jun 14 15:06:37.784823 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.784747 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="552b2129-475e-4b83-9a95-5794acf7e1f2" containerName="manager" Jun 14 15:06:37.784873 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.784843 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="552b2129-475e-4b83-9a95-5794acf7e1f2" containerName="manager" Jun 14 15:06:37.787600 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.787580 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7" Jun 14 15:06:37.806601 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.804614 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7"] Jun 14 15:06:37.834402 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:06:37.834372 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w4sz9\" is forbidden: User \"system:node:ip-10-0-134-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-188.ec2.internal' and this object" podUID="552b2129-475e-4b83-9a95-5794acf7e1f2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:37.883380 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.883338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsrmt\" (UniqueName: \"kubernetes.io/projected/a55a82f6-5973-45bc-ae0f-f49f5f875924-kube-api-access-rsrmt\") pod \"limitador-operator-controller-manager-859d7b78bd-swxg7\" (UID: \"a55a82f6-5973-45bc-ae0f-f49f5f875924\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7" Jun 14 15:06:37.947969 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.947944 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:37.950944 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:06:37.950917 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w4sz9\" is forbidden: User \"system:node:ip-10-0-134-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-188.ec2.internal' and this object" podUID="552b2129-475e-4b83-9a95-5794acf7e1f2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:37.984103 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.984049 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2896\" (UniqueName: \"kubernetes.io/projected/552b2129-475e-4b83-9a95-5794acf7e1f2-kube-api-access-z2896\") pod \"552b2129-475e-4b83-9a95-5794acf7e1f2\" (UID: \"552b2129-475e-4b83-9a95-5794acf7e1f2\") " Jun 14 15:06:37.984233 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.984216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsrmt\" (UniqueName: \"kubernetes.io/projected/a55a82f6-5973-45bc-ae0f-f49f5f875924-kube-api-access-rsrmt\") pod \"limitador-operator-controller-manager-859d7b78bd-swxg7\" (UID: \"a55a82f6-5973-45bc-ae0f-f49f5f875924\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7" Jun 14 15:06:37.986103 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:37.986077 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552b2129-475e-4b83-9a95-5794acf7e1f2-kube-api-access-z2896" (OuterVolumeSpecName: "kube-api-access-z2896") pod "552b2129-475e-4b83-9a95-5794acf7e1f2" (UID: "552b2129-475e-4b83-9a95-5794acf7e1f2"). InnerVolumeSpecName "kube-api-access-z2896". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:06:38.005419 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.005394 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsrmt\" (UniqueName: \"kubernetes.io/projected/a55a82f6-5973-45bc-ae0f-f49f5f875924-kube-api-access-rsrmt\") pod \"limitador-operator-controller-manager-859d7b78bd-swxg7\" (UID: \"a55a82f6-5973-45bc-ae0f-f49f5f875924\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7" Jun 14 15:06:38.085513 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.085491 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2896\" (UniqueName: \"kubernetes.io/projected/552b2129-475e-4b83-9a95-5794acf7e1f2-kube-api-access-z2896\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:06:38.097424 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.097404 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7" Jun 14 15:06:38.255111 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.255018 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7"] Jun 14 15:06:38.258012 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:06:38.257987 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55a82f6_5973_45bc_ae0f_f49f5f875924.slice/crio-f0b8c5db7695ee8e14b3f532a82890e8d496f3490a45c6d813a430a92c6c186e WatchSource:0}: Error finding container f0b8c5db7695ee8e14b3f532a82890e8d496f3490a45c6d813a430a92c6c186e: Status 404 returned error can't find the container with id f0b8c5db7695ee8e14b3f532a82890e8d496f3490a45c6d813a430a92c6c186e Jun 14 15:06:38.270359 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.270327 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7" event={"ID":"a55a82f6-5973-45bc-ae0f-f49f5f875924","Type":"ContainerStarted","Data":"f0b8c5db7695ee8e14b3f532a82890e8d496f3490a45c6d813a430a92c6c186e"} Jun 14 15:06:38.271586 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.271564 2561 generic.go:356] "Generic (PLEG): container finished" podID="552b2129-475e-4b83-9a95-5794acf7e1f2" containerID="330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489" exitCode=0 Jun 14 15:06:38.271656 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.271607 2561 scope.go:117] "RemoveContainer" containerID="330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489" Jun 14 15:06:38.271656 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.271623 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:38.274234 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:06:38.274206 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w4sz9\" is forbidden: User \"system:node:ip-10-0-134-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-188.ec2.internal' and this object" podUID="552b2129-475e-4b83-9a95-5794acf7e1f2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:38.282485 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.282460 2561 scope.go:117] "RemoveContainer" containerID="330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489" Jun 14 15:06:38.282970 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:06:38.282951 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489\": container with ID starting with 330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489 not found: ID does not exist" containerID="330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489" Jun 14 15:06:38.283020 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.282978 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489"} err="failed to get container status \"330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489\": rpc error: code = NotFound desc = could not find container \"330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489\": container with ID starting with 330c65e4c960b9d0d3b5669295190dd6b8e5c05b9c82bf6ced22560e04485489 not found: ID does not exist" Jun 14 15:06:38.295335 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:06:38.295306 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w4sz9\" is forbidden: User \"system:node:ip-10-0-134-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-188.ec2.internal' and this object" podUID="552b2129-475e-4b83-9a95-5794acf7e1f2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w4sz9" Jun 14 15:06:38.626422 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.626388 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="552b2129-475e-4b83-9a95-5794acf7e1f2" path="/var/lib/kubelet/pods/552b2129-475e-4b83-9a95-5794acf7e1f2/volumes" Jun 14 15:06:38.895878 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:38.895791 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:39.047554 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:39.047513 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:39.277359 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:39.277268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7" event={"ID":"a55a82f6-5973-45bc-ae0f-f49f5f875924","Type":"ContainerStarted","Data":"9f493d0a3220bd47308d090989419beb8fbeb5f5cce485e55d2ce9ab0c5d4fac"} Jun 14 15:06:39.277501 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:39.277408 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7" Jun 14 15:06:39.300227 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:39.300167 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7" podStartSLOduration=2.300150828 podStartE2EDuration="2.300150828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:06:39.298884685 +0000 UTC m=+703.188110085" watchObservedRunningTime="2026-06-14 15:06:39.300150828 +0000 UTC m=+703.189376228" Jun 14 15:06:39.447405 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:39.447371 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:39.545102 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:39.545021 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:41.635798 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:41.635770 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:41.756436 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:41.756408 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:42.128766 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:42.128738 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:42.250521 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:42.250491 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:46.794892 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:46.794801 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:46.894990 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:46.894956 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:50.283426 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:50.283392 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-swxg7" Jun 14 15:06:53.796662 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:53.796631 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:06:54.019582 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:06:54.019546 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:06.751944 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.751917 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv"] Jun 14 15:07:06.758200 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.758161 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:06.764775 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.764611 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nwr22\"" Jun 14 15:07:06.776811 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.776781 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv"] Jun 14 15:07:06.835489 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.835456 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:06.902155 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.902122 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:06.902155 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.902159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7mqw\" (UniqueName: \"kubernetes.io/projected/1948e1fc-950a-4341-b695-1151e6d5baf7-kube-api-access-w7mqw\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:06.902365 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.902182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1948e1fc-950a-4341-b695-1151e6d5baf7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:06.902365 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.902236 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:06.902365 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.902298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:06.902365 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.902328 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:06.902365 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.902354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:06.902516 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.902373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:06.902516 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:06.902392 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.002813 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.002715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.002813 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.002776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.002813 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.002803 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7mqw\" (UniqueName: \"kubernetes.io/projected/1948e1fc-950a-4341-b695-1151e6d5baf7-kube-api-access-w7mqw\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003092 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.002830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1948e1fc-950a-4341-b695-1151e6d5baf7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003092 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.002857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003092 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.002897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003092 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.002987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003092 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.003030 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003092 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.003061 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003433 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.003171 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003719 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.003512 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003719 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.003662 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1948e1fc-950a-4341-b695-1151e6d5baf7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003942 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.003923 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.003942 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.003931 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.005518 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.005494 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.005622 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.005516 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.022099 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.022075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1948e1fc-950a-4341-b695-1151e6d5baf7-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.024995 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.024973 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7mqw\" (UniqueName: \"kubernetes.io/projected/1948e1fc-950a-4341-b695-1151e6d5baf7-kube-api-access-w7mqw\") pod \"maas-default-gateway-openshift-default-687ff6996-j9hmv\" (UID: \"1948e1fc-950a-4341-b695-1151e6d5baf7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.068737 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.068704 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:07.196269 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.196232 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:07.217523 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.217475 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv"] Jun 14 15:07:07.221937 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:07:07.221911 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1948e1fc_950a_4341_b695_1151e6d5baf7.slice/crio-f668e4d7fa8526d1d122e727a179125fb96ddef6a41eec10caf2fddf67d27c83 WatchSource:0}: Error finding container f668e4d7fa8526d1d122e727a179125fb96ddef6a41eec10caf2fddf67d27c83: Status 404 returned error can't find the container with id f668e4d7fa8526d1d122e727a179125fb96ddef6a41eec10caf2fddf67d27c83 Jun 14 15:07:07.224019 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.223986 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:07:07.224074 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.224063 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:07:07.224111 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.224098 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:07:07.388780 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.388745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" event={"ID":"1948e1fc-950a-4341-b695-1151e6d5baf7","Type":"ContainerStarted","Data":"06bf3b65b6eff53c6483310874a6572d8bd12a324f155ffe80c626b3014e4711"} Jun 14 15:07:07.388967 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:07.388805 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" event={"ID":"1948e1fc-950a-4341-b695-1151e6d5baf7","Type":"ContainerStarted","Data":"f668e4d7fa8526d1d122e727a179125fb96ddef6a41eec10caf2fddf67d27c83"} Jun 14 15:07:08.069372 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:08.069342 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:08.073650 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:08.073628 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:08.105763 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:08.105714 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" podStartSLOduration=2.10569905 podStartE2EDuration="2.10569905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:07:07.428474324 +0000 UTC m=+731.317699723" watchObservedRunningTime="2026-06-14 15:07:08.10569905 +0000 UTC m=+731.994924516" Jun 14 15:07:08.392582 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:08.392547 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:08.393653 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:08.393633 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:07:08.682179 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:08.682065 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:08.904276 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:08.904246 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:09.721318 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:09.721279 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lhbr4"] Jun 14 15:07:09.724934 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:09.724916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lhbr4" Jun 14 15:07:09.728108 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:09.728082 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wkrcn\"" Jun 14 15:07:09.737121 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:09.737099 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lhbr4"] Jun 14 15:07:09.776289 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:09.776260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:09.826662 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:09.826632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps9px\" (UniqueName: \"kubernetes.io/projected/842754fa-5493-43c3-8ee0-98dda342b100-kube-api-access-ps9px\") pod \"authorino-58cd955675-lhbr4\" (UID: \"842754fa-5493-43c3-8ee0-98dda342b100\") " pod="kuadrant-system/authorino-58cd955675-lhbr4" Jun 14 15:07:09.883342 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:09.883298 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:09.927140 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:09.927107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps9px\" (UniqueName: \"kubernetes.io/projected/842754fa-5493-43c3-8ee0-98dda342b100-kube-api-access-ps9px\") pod \"authorino-58cd955675-lhbr4\" (UID: \"842754fa-5493-43c3-8ee0-98dda342b100\") " pod="kuadrant-system/authorino-58cd955675-lhbr4" Jun 14 15:07:09.940032 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:09.940004 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps9px\" (UniqueName: \"kubernetes.io/projected/842754fa-5493-43c3-8ee0-98dda342b100-kube-api-access-ps9px\") pod \"authorino-58cd955675-lhbr4\" (UID: \"842754fa-5493-43c3-8ee0-98dda342b100\") " pod="kuadrant-system/authorino-58cd955675-lhbr4" Jun 14 15:07:10.034794 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:10.034707 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lhbr4" Jun 14 15:07:10.177593 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:10.177558 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lhbr4"] Jun 14 15:07:10.181404 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:07:10.181381 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod842754fa_5493_43c3_8ee0_98dda342b100.slice/crio-000be007dd556022ebfc1880b3aef78b04c9a3d08854428096c06f9f61c191cf WatchSource:0}: Error finding container 000be007dd556022ebfc1880b3aef78b04c9a3d08854428096c06f9f61c191cf: Status 404 returned error can't find the container with id 000be007dd556022ebfc1880b3aef78b04c9a3d08854428096c06f9f61c191cf Jun 14 15:07:10.401568 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:10.401534 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lhbr4" event={"ID":"842754fa-5493-43c3-8ee0-98dda342b100","Type":"ContainerStarted","Data":"000be007dd556022ebfc1880b3aef78b04c9a3d08854428096c06f9f61c191cf"} Jun 14 15:07:14.312776 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:14.312737 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lhbr4"] Jun 14 15:07:14.421888 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:14.421852 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lhbr4" event={"ID":"842754fa-5493-43c3-8ee0-98dda342b100","Type":"ContainerStarted","Data":"7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e"} Jun 14 15:07:14.443769 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:14.443724 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lhbr4" podStartSLOduration=1.93743476 podStartE2EDuration="5.443707421s" totalImagesPullingTime="3.506272661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:07:14.443293919 +0000 UTC m=+738.332519320" watchObservedRunningTime="2026-06-14 15:07:14.443707421 +0000 UTC m=+738.332932822" Jun 14 15:07:15.426356 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:15.426306 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lhbr4" podUID="842754fa-5493-43c3-8ee0-98dda342b100" containerName="authorino" containerID="cri-o://7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e" gracePeriod=30 Jun 14 15:07:15.665921 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:15.665896 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lhbr4" Jun 14 15:07:15.779712 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:15.779642 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps9px\" (UniqueName: \"kubernetes.io/projected/842754fa-5493-43c3-8ee0-98dda342b100-kube-api-access-ps9px\") pod \"842754fa-5493-43c3-8ee0-98dda342b100\" (UID: \"842754fa-5493-43c3-8ee0-98dda342b100\") " Jun 14 15:07:15.781752 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:15.781731 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/842754fa-5493-43c3-8ee0-98dda342b100-kube-api-access-ps9px" (OuterVolumeSpecName: "kube-api-access-ps9px") pod "842754fa-5493-43c3-8ee0-98dda342b100" (UID: "842754fa-5493-43c3-8ee0-98dda342b100"). InnerVolumeSpecName "kube-api-access-ps9px". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:07:15.880464 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:15.880434 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps9px\" (UniqueName: \"kubernetes.io/projected/842754fa-5493-43c3-8ee0-98dda342b100-kube-api-access-ps9px\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:07:16.432055 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.432022 2561 generic.go:356] "Generic (PLEG): container finished" podID="842754fa-5493-43c3-8ee0-98dda342b100" containerID="7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e" exitCode=0 Jun 14 15:07:16.432523 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.432061 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lhbr4" Jun 14 15:07:16.432523 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.432071 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lhbr4" event={"ID":"842754fa-5493-43c3-8ee0-98dda342b100","Type":"ContainerDied","Data":"7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e"} Jun 14 15:07:16.432523 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.432102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lhbr4" event={"ID":"842754fa-5493-43c3-8ee0-98dda342b100","Type":"ContainerDied","Data":"000be007dd556022ebfc1880b3aef78b04c9a3d08854428096c06f9f61c191cf"} Jun 14 15:07:16.432523 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.432118 2561 scope.go:117] "RemoveContainer" containerID="7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e" Jun 14 15:07:16.440483 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.440466 2561 scope.go:117] "RemoveContainer" containerID="7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e" Jun 14 15:07:16.440726 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:07:16.440707 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e\": container with ID starting with 7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e not found: ID does not exist" containerID="7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e" Jun 14 15:07:16.440775 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.440734 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e"} err="failed to get container status \"7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e\": rpc error: code = NotFound desc = could not find container \"7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e\": container with ID starting with 7d8317bafc306df8516cde48d01bbe5050863d02a114c649d9c1e258faa90a6e not found: ID does not exist" Jun 14 15:07:16.469755 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.469732 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lhbr4"] Jun 14 15:07:16.477694 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.477674 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lhbr4"] Jun 14 15:07:16.626689 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.626660 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="842754fa-5493-43c3-8ee0-98dda342b100" path="/var/lib/kubelet/pods/842754fa-5493-43c3-8ee0-98dda342b100/volumes" Jun 14 15:07:16.768667 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.768584 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:16.927667 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:16.927629 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:24.878211 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:24.878153 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:29.832170 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:29.832127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:39.927316 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:39.927280 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:40.098723 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:40.098685 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:07:40.446003 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:07:40.445974 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:09.705741 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:09.705708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:09.810866 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:09.810829 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:10.201750 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.201719 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 15:08:10.202035 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.202020 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842754fa-5493-43c3-8ee0-98dda342b100" containerName="authorino" Jun 14 15:08:10.202091 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.202037 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="842754fa-5493-43c3-8ee0-98dda342b100" containerName="authorino" Jun 14 15:08:10.202091 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.202089 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="842754fa-5493-43c3-8ee0-98dda342b100" containerName="authorino" Jun 14 15:08:10.205907 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.205892 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 15:08:10.210143 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.210120 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 15:08:10.210609 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.210594 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8r47w\"" Jun 14 15:08:10.212058 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.212020 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 15:08:10.215266 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.215250 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 14 15:08:10.266774 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.266747 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 15:08:10.313080 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.313057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmqg8\" (UniqueName: \"kubernetes.io/projected/8e60d201-56c7-4157-b395-f340b826b97e-kube-api-access-wmqg8\") pod \"maas-keycloak-0\" (UID: \"8e60d201-56c7-4157-b395-f340b826b97e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 15:08:10.414015 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.413981 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmqg8\" (UniqueName: \"kubernetes.io/projected/8e60d201-56c7-4157-b395-f340b826b97e-kube-api-access-wmqg8\") pod \"maas-keycloak-0\" (UID: \"8e60d201-56c7-4157-b395-f340b826b97e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 15:08:10.448923 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.448892 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmqg8\" (UniqueName: \"kubernetes.io/projected/8e60d201-56c7-4157-b395-f340b826b97e-kube-api-access-wmqg8\") pod \"maas-keycloak-0\" (UID: \"8e60d201-56c7-4157-b395-f340b826b97e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 15:08:10.514687 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.514620 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 15:08:10.658966 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:10.658945 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 15:08:10.660603 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:08:10.660575 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e60d201_56c7_4157_b395_f340b826b97e.slice/crio-56631c7f8f439305a2046ef7aae06e3cbeb3cc5b2ddc87b49f063ad26b2b28a5 WatchSource:0}: Error finding container 56631c7f8f439305a2046ef7aae06e3cbeb3cc5b2ddc87b49f063ad26b2b28a5: Status 404 returned error can't find the container with id 56631c7f8f439305a2046ef7aae06e3cbeb3cc5b2ddc87b49f063ad26b2b28a5 Jun 14 15:08:11.655735 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:11.655703 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8e60d201-56c7-4157-b395-f340b826b97e","Type":"ContainerStarted","Data":"56631c7f8f439305a2046ef7aae06e3cbeb3cc5b2ddc87b49f063ad26b2b28a5"} Jun 14 15:08:16.680800 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:16.680757 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8e60d201-56c7-4157-b395-f340b826b97e","Type":"ContainerStarted","Data":"83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5"} Jun 14 15:08:16.709062 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:16.708924 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.927122724 podStartE2EDuration="6.708887446s" totalImagesPullingTime="5.781764722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:08:16.705654005 +0000 UTC m=+800.594879428" watchObservedRunningTime="2026-06-14 15:08:16.708887446 +0000 UTC m=+800.598112848" Jun 14 15:08:17.514958 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:17.514915 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 14 15:08:17.516559 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:17.516514 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:18.515719 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:18.515672 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:19.515452 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:19.515399 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:20.514786 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:20.514734 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 14 15:08:20.516038 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:20.515998 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:21.515258 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:21.515181 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:22.515268 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:22.515219 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:23.516091 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:23.516036 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:24.515302 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:24.515261 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:25.516043 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:25.516000 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:26.515461 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:26.515420 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:27.515010 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:27.514968 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:28.515391 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:28.515342 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.25:9000/health/started\": dial tcp 10.132.0.25:9000: connect: connection refused" Jun 14 15:08:29.640008 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:29.639972 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 14 15:08:29.656575 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:29.656536 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 15:08:39.647444 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:39.647409 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 14 15:08:40.354484 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:40.354449 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:40.719864 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:40.719785 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:40.867023 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:40.866992 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f7fcf6d94-8p9wq"] Jun 14 15:08:40.876640 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:40.876609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f7fcf6d94-8p9wq" Jun 14 15:08:40.878786 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:40.878762 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f7fcf6d94-8p9wq"] Jun 14 15:08:40.879688 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:40.879672 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wkrcn\"" Jun 14 15:08:40.941462 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:40.941430 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f7fcf6d94-8p9wq"] Jun 14 15:08:40.941699 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:08:40.941677 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-r678m], unattached volumes=[], failed to process volumes=[kube-api-access-r678m]: context canceled" pod="kuadrant-system/authorino-f7fcf6d94-8p9wq" podUID="070b67d8-4dda-4b97-adfb-089387ced3b2" Jun 14 15:08:40.995656 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:40.995572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r678m\" (UniqueName: \"kubernetes.io/projected/070b67d8-4dda-4b97-adfb-089387ced3b2-kube-api-access-r678m\") pod \"authorino-f7fcf6d94-8p9wq\" (UID: \"070b67d8-4dda-4b97-adfb-089387ced3b2\") " pod="kuadrant-system/authorino-f7fcf6d94-8p9wq" Jun 14 15:08:41.096058 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:41.096019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r678m\" (UniqueName: \"kubernetes.io/projected/070b67d8-4dda-4b97-adfb-089387ced3b2-kube-api-access-r678m\") pod \"authorino-f7fcf6d94-8p9wq\" (UID: \"070b67d8-4dda-4b97-adfb-089387ced3b2\") " pod="kuadrant-system/authorino-f7fcf6d94-8p9wq" Jun 14 15:08:41.104635 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:41.104612 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r678m\" (UniqueName: \"kubernetes.io/projected/070b67d8-4dda-4b97-adfb-089387ced3b2-kube-api-access-r678m\") pod \"authorino-f7fcf6d94-8p9wq\" (UID: \"070b67d8-4dda-4b97-adfb-089387ced3b2\") " pod="kuadrant-system/authorino-f7fcf6d94-8p9wq" Jun 14 15:08:41.810151 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:41.810122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f7fcf6d94-8p9wq" Jun 14 15:08:41.817051 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:41.817028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f7fcf6d94-8p9wq" Jun 14 15:08:41.903439 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:41.903409 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r678m\" (UniqueName: \"kubernetes.io/projected/070b67d8-4dda-4b97-adfb-089387ced3b2-kube-api-access-r678m\") pod \"070b67d8-4dda-4b97-adfb-089387ced3b2\" (UID: \"070b67d8-4dda-4b97-adfb-089387ced3b2\") " Jun 14 15:08:41.905665 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:41.905643 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/070b67d8-4dda-4b97-adfb-089387ced3b2-kube-api-access-r678m" (OuterVolumeSpecName: "kube-api-access-r678m") pod "070b67d8-4dda-4b97-adfb-089387ced3b2" (UID: "070b67d8-4dda-4b97-adfb-089387ced3b2"). InnerVolumeSpecName "kube-api-access-r678m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:08:42.004048 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:42.004013 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r678m\" (UniqueName: \"kubernetes.io/projected/070b67d8-4dda-4b97-adfb-089387ced3b2-kube-api-access-r678m\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:08:42.731747 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:42.731713 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:42.806373 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:42.806337 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:42.814460 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:42.814436 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f7fcf6d94-8p9wq" Jun 14 15:08:42.845498 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:42.845464 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f7fcf6d94-8p9wq"] Jun 14 15:08:42.848560 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:42.848535 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f7fcf6d94-8p9wq"] Jun 14 15:08:44.626245 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:44.626213 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="070b67d8-4dda-4b97-adfb-089387ced3b2" path="/var/lib/kubelet/pods/070b67d8-4dda-4b97-adfb-089387ced3b2/volumes" Jun 14 15:08:46.528465 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.528428 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:46.564914 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.564875 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5899b7bb77-fdqg5"] Jun 14 15:08:46.568107 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.568089 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:08:46.571937 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.571911 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 15:08:46.572051 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.571939 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hlgkn\"" Jun 14 15:08:46.572051 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.571951 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 15:08:46.587739 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.587716 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5899b7bb77-fdqg5"] Jun 14 15:08:46.623471 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.623442 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:46.639977 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.639946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b124a15d-fafd-416c-812f-41cdc62ef3f4-webhook-cert\") pod \"maas-controller-5899b7bb77-fdqg5\" (UID: \"b124a15d-fafd-416c-812f-41cdc62ef3f4\") " pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:08:46.640135 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.639983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp26r\" (UniqueName: \"kubernetes.io/projected/b124a15d-fafd-416c-812f-41cdc62ef3f4-kube-api-access-kp26r\") pod \"maas-controller-5899b7bb77-fdqg5\" (UID: \"b124a15d-fafd-416c-812f-41cdc62ef3f4\") " pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:08:46.723948 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.723918 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:46.740798 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.740773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b124a15d-fafd-416c-812f-41cdc62ef3f4-webhook-cert\") pod \"maas-controller-5899b7bb77-fdqg5\" (UID: \"b124a15d-fafd-416c-812f-41cdc62ef3f4\") " pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:08:46.740882 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.740806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp26r\" (UniqueName: \"kubernetes.io/projected/b124a15d-fafd-416c-812f-41cdc62ef3f4-kube-api-access-kp26r\") pod \"maas-controller-5899b7bb77-fdqg5\" (UID: \"b124a15d-fafd-416c-812f-41cdc62ef3f4\") " pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:08:46.743365 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.743332 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b124a15d-fafd-416c-812f-41cdc62ef3f4-webhook-cert\") pod \"maas-controller-5899b7bb77-fdqg5\" (UID: \"b124a15d-fafd-416c-812f-41cdc62ef3f4\") " pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:08:46.754066 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.754040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp26r\" (UniqueName: \"kubernetes.io/projected/b124a15d-fafd-416c-812f-41cdc62ef3f4-kube-api-access-kp26r\") pod \"maas-controller-5899b7bb77-fdqg5\" (UID: \"b124a15d-fafd-416c-812f-41cdc62ef3f4\") " pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:08:46.786059 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.785980 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dc85674c-2lvwl"] Jun 14 15:08:46.789165 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.789149 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:08:46.798363 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.798335 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dc85674c-2lvwl"] Jun 14 15:08:46.841760 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.841725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2knlf\" (UniqueName: \"kubernetes.io/projected/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-kube-api-access-2knlf\") pod \"maas-controller-6dc85674c-2lvwl\" (UID: \"826f1d32-615c-4b0d-b0f8-3bd1b26bd726\") " pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:08:46.841932 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.841782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-webhook-cert\") pod \"maas-controller-6dc85674c-2lvwl\" (UID: \"826f1d32-615c-4b0d-b0f8-3bd1b26bd726\") " pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:08:46.877723 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.877690 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:08:46.942398 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.942316 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-webhook-cert\") pod \"maas-controller-6dc85674c-2lvwl\" (UID: \"826f1d32-615c-4b0d-b0f8-3bd1b26bd726\") " pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:08:46.942550 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.942415 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2knlf\" (UniqueName: \"kubernetes.io/projected/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-kube-api-access-2knlf\") pod \"maas-controller-6dc85674c-2lvwl\" (UID: \"826f1d32-615c-4b0d-b0f8-3bd1b26bd726\") " pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:08:46.945595 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.945564 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-webhook-cert\") pod \"maas-controller-6dc85674c-2lvwl\" (UID: \"826f1d32-615c-4b0d-b0f8-3bd1b26bd726\") " pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:08:46.951409 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:46.951388 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2knlf\" (UniqueName: \"kubernetes.io/projected/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-kube-api-access-2knlf\") pod \"maas-controller-6dc85674c-2lvwl\" (UID: \"826f1d32-615c-4b0d-b0f8-3bd1b26bd726\") " pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:08:47.009461 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:47.009417 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5899b7bb77-fdqg5"] Jun 14 15:08:47.012389 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:08:47.012363 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb124a15d_fafd_416c_812f_41cdc62ef3f4.slice/crio-6de8d6e565987bff8decc730383b7b2b96870003948da5f75e7cac55eeb98433 WatchSource:0}: Error finding container 6de8d6e565987bff8decc730383b7b2b96870003948da5f75e7cac55eeb98433: Status 404 returned error can't find the container with id 6de8d6e565987bff8decc730383b7b2b96870003948da5f75e7cac55eeb98433 Jun 14 15:08:47.100349 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:47.100319 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:08:47.233017 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:47.232987 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dc85674c-2lvwl"] Jun 14 15:08:47.235402 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:08:47.235377 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826f1d32_615c_4b0d_b0f8_3bd1b26bd726.slice/crio-2a56f6538eea5a079862fdc0a82a49360cd79f86c306bcb28bc90702b13fbd74 WatchSource:0}: Error finding container 2a56f6538eea5a079862fdc0a82a49360cd79f86c306bcb28bc90702b13fbd74: Status 404 returned error can't find the container with id 2a56f6538eea5a079862fdc0a82a49360cd79f86c306bcb28bc90702b13fbd74 Jun 14 15:08:47.838665 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:47.838622 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc85674c-2lvwl" event={"ID":"826f1d32-615c-4b0d-b0f8-3bd1b26bd726","Type":"ContainerStarted","Data":"2a56f6538eea5a079862fdc0a82a49360cd79f86c306bcb28bc90702b13fbd74"} Jun 14 15:08:47.839946 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:47.839887 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" event={"ID":"b124a15d-fafd-416c-812f-41cdc62ef3f4","Type":"ContainerStarted","Data":"6de8d6e565987bff8decc730383b7b2b96870003948da5f75e7cac55eeb98433"} Jun 14 15:08:49.050860 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:49.050769 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:49.178967 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:49.178938 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:49.849781 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:49.849738 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc85674c-2lvwl" event={"ID":"826f1d32-615c-4b0d-b0f8-3bd1b26bd726","Type":"ContainerStarted","Data":"e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd"} Jun 14 15:08:49.849967 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:49.849806 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:08:49.851244 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:49.851217 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" event={"ID":"b124a15d-fafd-416c-812f-41cdc62ef3f4","Type":"ContainerStarted","Data":"a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198"} Jun 14 15:08:49.851359 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:49.851341 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:08:49.873066 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:49.873024 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dc85674c-2lvwl" podStartSLOduration=2.310925746 podStartE2EDuration="3.873010626s" totalImagesPullingTime="1.56208488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:08:49.870693356 +0000 UTC m=+833.759918755" watchObservedRunningTime="2026-06-14 15:08:49.873010626 +0000 UTC m=+833.762236042" Jun 14 15:08:49.900219 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:08:49.896219 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" podStartSLOduration=2.114424923 podStartE2EDuration="3.896182683s" totalImagesPullingTime="1.78175776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:08:49.893699204 +0000 UTC m=+833.782924627" watchObservedRunningTime="2026-06-14 15:08:49.896182683 +0000 UTC m=+833.785408083" Jun 14 15:09:00.860452 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:00.860417 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:09:00.860956 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:00.860748 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:09:00.920175 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:00.920136 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5899b7bb77-fdqg5"] Jun 14 15:09:00.920393 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:00.920352 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" podUID="b124a15d-fafd-416c-812f-41cdc62ef3f4" containerName="manager" containerID="cri-o://a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198" gracePeriod=30 Jun 14 15:09:01.165216 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.165173 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:09:01.255998 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.255968 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp26r\" (UniqueName: \"kubernetes.io/projected/b124a15d-fafd-416c-812f-41cdc62ef3f4-kube-api-access-kp26r\") pod \"b124a15d-fafd-416c-812f-41cdc62ef3f4\" (UID: \"b124a15d-fafd-416c-812f-41cdc62ef3f4\") " Jun 14 15:09:01.256155 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.256048 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b124a15d-fafd-416c-812f-41cdc62ef3f4-webhook-cert\") pod \"b124a15d-fafd-416c-812f-41cdc62ef3f4\" (UID: \"b124a15d-fafd-416c-812f-41cdc62ef3f4\") " Jun 14 15:09:01.258397 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.258371 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b124a15d-fafd-416c-812f-41cdc62ef3f4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b124a15d-fafd-416c-812f-41cdc62ef3f4" (UID: "b124a15d-fafd-416c-812f-41cdc62ef3f4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:09:01.258480 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.258411 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b124a15d-fafd-416c-812f-41cdc62ef3f4-kube-api-access-kp26r" (OuterVolumeSpecName: "kube-api-access-kp26r") pod "b124a15d-fafd-416c-812f-41cdc62ef3f4" (UID: "b124a15d-fafd-416c-812f-41cdc62ef3f4"). InnerVolumeSpecName "kube-api-access-kp26r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:09:01.356562 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.356521 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b124a15d-fafd-416c-812f-41cdc62ef3f4-webhook-cert\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:09:01.356562 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.356554 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp26r\" (UniqueName: \"kubernetes.io/projected/b124a15d-fafd-416c-812f-41cdc62ef3f4-kube-api-access-kp26r\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:09:01.900682 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.900639 2561 generic.go:356] "Generic (PLEG): container finished" podID="b124a15d-fafd-416c-812f-41cdc62ef3f4" containerID="a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198" exitCode=0 Jun 14 15:09:01.900682 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.900679 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" Jun 14 15:09:01.901232 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.900695 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" event={"ID":"b124a15d-fafd-416c-812f-41cdc62ef3f4","Type":"ContainerDied","Data":"a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198"} Jun 14 15:09:01.901232 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.900745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5899b7bb77-fdqg5" event={"ID":"b124a15d-fafd-416c-812f-41cdc62ef3f4","Type":"ContainerDied","Data":"6de8d6e565987bff8decc730383b7b2b96870003948da5f75e7cac55eeb98433"} Jun 14 15:09:01.901232 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.900767 2561 scope.go:117] "RemoveContainer" containerID="a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198" Jun 14 15:09:01.912401 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.912380 2561 scope.go:117] "RemoveContainer" containerID="a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198" Jun 14 15:09:01.912690 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:09:01.912673 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198\": container with ID starting with a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198 not found: ID does not exist" containerID="a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198" Jun 14 15:09:01.912757 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.912700 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198"} err="failed to get container status \"a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198\": rpc error: code = NotFound desc = could not find container \"a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198\": container with ID starting with a28e49c82860994b09ff296c98faadb27e324103b514785d60b04e29f277c198 not found: ID does not exist" Jun 14 15:09:01.926719 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.926695 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5899b7bb77-fdqg5"] Jun 14 15:09:01.931467 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:01.931446 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5899b7bb77-fdqg5"] Jun 14 15:09:02.626100 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:02.626069 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b124a15d-fafd-416c-812f-41cdc62ef3f4" path="/var/lib/kubelet/pods/b124a15d-fafd-416c-812f-41cdc62ef3f4/volumes" Jun 14 15:09:09.663662 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:09.663627 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:09:09.764052 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:09.764009 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:09:20.154374 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.154335 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:09:20.224013 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.223980 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5dd58bcd4c-4v4s2"] Jun 14 15:09:20.224361 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.224342 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b124a15d-fafd-416c-812f-41cdc62ef3f4" containerName="manager" Jun 14 15:09:20.224457 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.224364 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b124a15d-fafd-416c-812f-41cdc62ef3f4" containerName="manager" Jun 14 15:09:20.224457 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.224438 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b124a15d-fafd-416c-812f-41cdc62ef3f4" containerName="manager" Jun 14 15:09:20.228384 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.228363 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:20.232966 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.232698 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 15:09:20.232966 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.232843 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8jw98\"" Jun 14 15:09:20.243441 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.243411 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5dd58bcd4c-4v4s2"] Jun 14 15:09:20.310419 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.310386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prvcz\" (UniqueName: \"kubernetes.io/projected/d5d37154-9551-4a4d-9608-c43ba1ff2081-kube-api-access-prvcz\") pod \"maas-api-5dd58bcd4c-4v4s2\" (UID: \"d5d37154-9551-4a4d-9608-c43ba1ff2081\") " pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:20.310561 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.310457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d37154-9551-4a4d-9608-c43ba1ff2081-openshift-service-ca\") pod \"maas-api-5dd58bcd4c-4v4s2\" (UID: \"d5d37154-9551-4a4d-9608-c43ba1ff2081\") " pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:20.310561 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.310489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5d37154-9551-4a4d-9608-c43ba1ff2081-maas-api-tls\") pod \"maas-api-5dd58bcd4c-4v4s2\" (UID: \"d5d37154-9551-4a4d-9608-c43ba1ff2081\") " pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:20.411460 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.411362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvcz\" (UniqueName: \"kubernetes.io/projected/d5d37154-9551-4a4d-9608-c43ba1ff2081-kube-api-access-prvcz\") pod \"maas-api-5dd58bcd4c-4v4s2\" (UID: \"d5d37154-9551-4a4d-9608-c43ba1ff2081\") " pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:20.411460 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.411428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d37154-9551-4a4d-9608-c43ba1ff2081-openshift-service-ca\") pod \"maas-api-5dd58bcd4c-4v4s2\" (UID: \"d5d37154-9551-4a4d-9608-c43ba1ff2081\") " pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:20.411460 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.411457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5d37154-9551-4a4d-9608-c43ba1ff2081-maas-api-tls\") pod \"maas-api-5dd58bcd4c-4v4s2\" (UID: \"d5d37154-9551-4a4d-9608-c43ba1ff2081\") " pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:20.411732 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:09:20.411540 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 14 15:09:20.411732 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:09:20.411593 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5d37154-9551-4a4d-9608-c43ba1ff2081-maas-api-tls podName:d5d37154-9551-4a4d-9608-c43ba1ff2081 nodeName:}" failed. No retries permitted until 2026-06-14 15:09:20.911576472 +0000 UTC m=+864.800801850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d5d37154-9551-4a4d-9608-c43ba1ff2081-maas-api-tls") pod "maas-api-5dd58bcd4c-4v4s2" (UID: "d5d37154-9551-4a4d-9608-c43ba1ff2081") : secret "maas-api-serving-cert" not found Jun 14 15:09:20.412084 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.412062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d37154-9551-4a4d-9608-c43ba1ff2081-openshift-service-ca\") pod \"maas-api-5dd58bcd4c-4v4s2\" (UID: \"d5d37154-9551-4a4d-9608-c43ba1ff2081\") " pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:20.427735 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.427700 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvcz\" (UniqueName: \"kubernetes.io/projected/d5d37154-9551-4a4d-9608-c43ba1ff2081-kube-api-access-prvcz\") pod \"maas-api-5dd58bcd4c-4v4s2\" (UID: \"d5d37154-9551-4a4d-9608-c43ba1ff2081\") " pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:20.543618 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.543585 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:09:20.645048 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.645018 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:09:20.734211 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.734110 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:09:20.915008 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.914977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5d37154-9551-4a4d-9608-c43ba1ff2081-maas-api-tls\") pod \"maas-api-5dd58bcd4c-4v4s2\" (UID: \"d5d37154-9551-4a4d-9608-c43ba1ff2081\") " pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:20.917790 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:20.917756 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5d37154-9551-4a4d-9608-c43ba1ff2081-maas-api-tls\") pod \"maas-api-5dd58bcd4c-4v4s2\" (UID: \"d5d37154-9551-4a4d-9608-c43ba1ff2081\") " pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:21.144916 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:21.144878 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:21.276156 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:21.276127 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5dd58bcd4c-4v4s2"] Jun 14 15:09:21.279458 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:09:21.279415 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d37154_9551_4a4d_9608_c43ba1ff2081.slice/crio-441fd17c17db5e6806ef95b36f628fec176032c8c6c3189d4dce274150682f0e WatchSource:0}: Error finding container 441fd17c17db5e6806ef95b36f628fec176032c8c6c3189d4dce274150682f0e: Status 404 returned error can't find the container with id 441fd17c17db5e6806ef95b36f628fec176032c8c6c3189d4dce274150682f0e Jun 14 15:09:21.988567 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:21.988526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" event={"ID":"d5d37154-9551-4a4d-9608-c43ba1ff2081","Type":"ContainerStarted","Data":"441fd17c17db5e6806ef95b36f628fec176032c8c6c3189d4dce274150682f0e"} Jun 14 15:09:23.998899 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:23.998859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" event={"ID":"d5d37154-9551-4a4d-9608-c43ba1ff2081","Type":"ContainerStarted","Data":"46f1ac2bae8a8739e9f43a0562cacf80c7de70d09c832a690f1cfbedd01dd7dd"} Jun 14 15:09:23.999389 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:23.998989 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:24.015279 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:24.015228 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" podStartSLOduration=2.022983457 podStartE2EDuration="4.015211535s" totalImagesPullingTime="1.992228078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:09:24.015137129 +0000 UTC m=+867.904362531" watchObservedRunningTime="2026-06-14 15:09:24.015211535 +0000 UTC m=+867.904436928" Jun 14 15:09:29.022990 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:29.022958 2561 generic.go:356] "Generic (PLEG): container finished" podID="1948e1fc-950a-4341-b695-1151e6d5baf7" containerID="06bf3b65b6eff53c6483310874a6572d8bd12a324f155ffe80c626b3014e4711" exitCode=0 Jun 14 15:09:29.023426 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:29.023023 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" event={"ID":"1948e1fc-950a-4341-b695-1151e6d5baf7","Type":"ContainerDied","Data":"06bf3b65b6eff53c6483310874a6572d8bd12a324f155ffe80c626b3014e4711"} Jun 14 15:09:29.023426 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:29.023404 2561 scope.go:117] "RemoveContainer" containerID="06bf3b65b6eff53c6483310874a6572d8bd12a324f155ffe80c626b3014e4711" Jun 14 15:09:29.024431 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:29.024400 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:09:29.024498 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:29.024470 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:09:29.024548 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:29.024501 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:09:30.009492 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:30.009462 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5dd58bcd4c-4v4s2" Jun 14 15:09:30.029537 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:30.029506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" event={"ID":"1948e1fc-950a-4341-b695-1151e6d5baf7","Type":"ContainerStarted","Data":"403c51a05668c6a567bf926bb4fd81a53f86bd3ea1ff17feeef8aa810ca45612"} Jun 14 15:09:30.069406 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:30.069373 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:09:30.069752 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:30.069704 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j9hmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body= Jun 14 15:09:30.069849 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:30.069781 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" podUID="1948e1fc-950a-4341-b695-1151e6d5baf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" Jun 14 15:09:31.069917 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:31.069870 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j9hmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body= Jun 14 15:09:31.070364 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:31.069934 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" podUID="1948e1fc-950a-4341-b695-1151e6d5baf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" Jun 14 15:09:32.069319 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:32.069273 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j9hmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body= Jun 14 15:09:32.069571 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:32.069341 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" podUID="1948e1fc-950a-4341-b695-1151e6d5baf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" Jun 14 15:09:33.069677 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:33.069630 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-j9hmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body= Jun 14 15:09:33.070179 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:33.069700 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" podUID="1948e1fc-950a-4341-b695-1151e6d5baf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" Jun 14 15:09:34.072779 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:34.072744 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:09:34.073176 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:34.072996 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:09:34.073716 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:34.073701 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-j9hmv" Jun 14 15:09:52.040219 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:52.040111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:09:56.614586 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:56.614558 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:09:56.615004 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:09:56.614780 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:10:31.798879 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:10:31.798842 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:11:08.128241 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:08.128206 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:11:08.197546 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:08.197511 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:11:34.263143 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:34.263103 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 15:11:34.263577 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:34.263302 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" containerID="cri-o://83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5" gracePeriod=30 Jun 14 15:11:36.304750 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.304725 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:36.408337 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.408301 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmqg8\" (UniqueName: \"kubernetes.io/projected/8e60d201-56c7-4157-b395-f340b826b97e-kube-api-access-wmqg8\") pod \"8e60d201-56c7-4157-b395-f340b826b97e\" (UID: \"8e60d201-56c7-4157-b395-f340b826b97e\") " Jun 14 15:11:36.410510 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.410479 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e60d201-56c7-4157-b395-f340b826b97e-kube-api-access-wmqg8" (OuterVolumeSpecName: "kube-api-access-wmqg8") pod "8e60d201-56c7-4157-b395-f340b826b97e" (UID: "8e60d201-56c7-4157-b395-f340b826b97e"). InnerVolumeSpecName "kube-api-access-wmqg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:11:36.509120 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.509040 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmqg8\" (UniqueName: \"kubernetes.io/projected/8e60d201-56c7-4157-b395-f340b826b97e-kube-api-access-wmqg8\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:11:36.555656 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.555624 2561 generic.go:356] "Generic (PLEG): container finished" podID="8e60d201-56c7-4157-b395-f340b826b97e" containerID="83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5" exitCode=143 Jun 14 15:11:36.555821 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.555674 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:36.555821 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.555681 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8e60d201-56c7-4157-b395-f340b826b97e","Type":"ContainerDied","Data":"83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5"} Jun 14 15:11:36.555821 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.555778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8e60d201-56c7-4157-b395-f340b826b97e","Type":"ContainerDied","Data":"56631c7f8f439305a2046ef7aae06e3cbeb3cc5b2ddc87b49f063ad26b2b28a5"} Jun 14 15:11:36.555821 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.555798 2561 scope.go:117] "RemoveContainer" containerID="83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5" Jun 14 15:11:36.565720 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.565699 2561 scope.go:117] "RemoveContainer" containerID="83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5" Jun 14 15:11:36.565969 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:11:36.565951 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5\": container with ID starting with 83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5 not found: ID does not exist" containerID="83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5" Jun 14 15:11:36.566023 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.565977 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5"} err="failed to get container status \"83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5\": rpc error: code = NotFound desc = could not find container \"83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5\": container with ID starting with 83998761e6ccb3aa4493a6a84e3734f099cb4f632b8383453d195577ffec03b5 not found: ID does not exist" Jun 14 15:11:36.584985 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.584956 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 15:11:36.586666 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.586645 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 15:11:36.626174 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.626153 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e60d201-56c7-4157-b395-f340b826b97e" path="/var/lib/kubelet/pods/8e60d201-56c7-4157-b395-f340b826b97e/volumes" Jun 14 15:11:36.631235 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.631216 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 15:11:36.631485 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.631474 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" Jun 14 15:11:36.631529 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.631487 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" Jun 14 15:11:36.631564 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.631541 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e60d201-56c7-4157-b395-f340b826b97e" containerName="keycloak" Jun 14 15:11:36.635592 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.635577 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:36.638626 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.638600 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 14 15:11:36.638737 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.638715 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 14 15:11:36.638866 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.638840 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 15:11:36.638988 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.638972 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 15:11:36.639124 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.639110 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8r47w\"" Jun 14 15:11:36.645325 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.645304 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 15:11:36.711519 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.711490 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1e27061e-e563-403a-b50e-8f88693624b1-test-realms\") pod \"maas-keycloak-0\" (UID: \"1e27061e-e563-403a-b50e-8f88693624b1\") " pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:36.711681 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.711525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4ds\" (UniqueName: \"kubernetes.io/projected/1e27061e-e563-403a-b50e-8f88693624b1-kube-api-access-px4ds\") pod \"maas-keycloak-0\" (UID: \"1e27061e-e563-403a-b50e-8f88693624b1\") " pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:36.812222 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.812115 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1e27061e-e563-403a-b50e-8f88693624b1-test-realms\") pod \"maas-keycloak-0\" (UID: \"1e27061e-e563-403a-b50e-8f88693624b1\") " pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:36.812222 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.812152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4ds\" (UniqueName: \"kubernetes.io/projected/1e27061e-e563-403a-b50e-8f88693624b1-kube-api-access-px4ds\") pod \"maas-keycloak-0\" (UID: \"1e27061e-e563-403a-b50e-8f88693624b1\") " pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:36.812957 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.812930 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1e27061e-e563-403a-b50e-8f88693624b1-test-realms\") pod \"maas-keycloak-0\" (UID: \"1e27061e-e563-403a-b50e-8f88693624b1\") " pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:36.821358 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.821333 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4ds\" (UniqueName: \"kubernetes.io/projected/1e27061e-e563-403a-b50e-8f88693624b1-kube-api-access-px4ds\") pod \"maas-keycloak-0\" (UID: \"1e27061e-e563-403a-b50e-8f88693624b1\") " pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:36.945152 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:36.945123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:37.078764 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:37.078731 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 15:11:37.081582 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:11:37.081557 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e27061e_e563_403a_b50e_8f88693624b1.slice/crio-07ab81839e526da2ab85f670960656c6394d980c2ea3bfb67d209739644faeca WatchSource:0}: Error finding container 07ab81839e526da2ab85f670960656c6394d980c2ea3bfb67d209739644faeca: Status 404 returned error can't find the container with id 07ab81839e526da2ab85f670960656c6394d980c2ea3bfb67d209739644faeca Jun 14 15:11:37.083049 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:37.083025 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:11:37.562209 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:37.562154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1e27061e-e563-403a-b50e-8f88693624b1","Type":"ContainerStarted","Data":"22988b35e2329b8b876657002a7667d68905dfabc5305efcb67c5d84c25423c1"} Jun 14 15:11:37.562668 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:37.562235 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1e27061e-e563-403a-b50e-8f88693624b1","Type":"ContainerStarted","Data":"07ab81839e526da2ab85f670960656c6394d980c2ea3bfb67d209739644faeca"} Jun 14 15:11:37.582514 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:37.582468 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.263069553 podStartE2EDuration="1.58245201s" totalImagesPullingTime="319.382457ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:11:37.580648746 +0000 UTC m=+1001.469874182" watchObservedRunningTime="2026-06-14 15:11:37.58245201 +0000 UTC m=+1001.471677410" Jun 14 15:11:37.946239 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:37.946176 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:37.947921 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:37.947875 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:38.946172 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:38.946131 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:39.945905 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:39.945850 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:40.946549 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:40.946496 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:41.946057 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:41.945999 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:42.945791 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:42.945741 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:43.946561 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:43.946511 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:44.946667 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:44.946612 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:45.946218 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:45.946136 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:46.238282 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:46.238182 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:11:46.945766 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:46.945723 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:46.946006 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:46.945976 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:47.945816 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:47.945769 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:48.946611 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:48.946555 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:49.946532 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:49.946479 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 14 15:11:51.067554 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:51.067511 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 14 15:11:51.087668 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:11:51.087618 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1e27061e-e563-403a-b50e-8f88693624b1" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 15:12:01.074823 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:01.074791 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 14 15:12:14.339255 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:14.339212 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:12:14.433930 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:14.433901 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:12:28.018665 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:28.018635 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:12:41.180472 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.180437 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv"] Jun 14 15:12:41.184109 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.184091 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.186649 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.186625 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 15:12:41.186756 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.186690 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 15:12:41.187819 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.187805 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 14 15:12:41.187871 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.187840 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lxjd7\"" Jun 14 15:12:41.208592 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.208562 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv"] Jun 14 15:12:41.234359 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.234330 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:12:41.254546 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.254518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1c11a46-ff3d-4972-9b79-36419b1560a9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.254646 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.254553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.254646 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.254574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.254717 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.254667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9878\" (UniqueName: \"kubernetes.io/projected/d1c11a46-ff3d-4972-9b79-36419b1560a9-kube-api-access-b9878\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.254752 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.254728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.254788 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.254763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.355829 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.355791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.355829 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.355834 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.356038 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.355855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1c11a46-ff3d-4972-9b79-36419b1560a9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.356038 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.355959 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.356038 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.355999 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.356304 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.356061 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9878\" (UniqueName: \"kubernetes.io/projected/d1c11a46-ff3d-4972-9b79-36419b1560a9-kube-api-access-b9878\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.356304 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.356266 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.356422 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.356272 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.356422 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.356382 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.358432 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.358406 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1c11a46-ff3d-4972-9b79-36419b1560a9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.358536 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.358520 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1c11a46-ff3d-4972-9b79-36419b1560a9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.365243 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.365218 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9878\" (UniqueName: \"kubernetes.io/projected/d1c11a46-ff3d-4972-9b79-36419b1560a9-kube-api-access-b9878\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zxpjv\" (UID: \"d1c11a46-ff3d-4972-9b79-36419b1560a9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.495111 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.495045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:41.626789 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.626761 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv"] Jun 14 15:12:41.629146 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:12:41.629120 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c11a46_ff3d_4972_9b79_36419b1560a9.slice/crio-eaef087872772c979bcf262fa55c37530d268b781409638df5859e463bd91c4a WatchSource:0}: Error finding container eaef087872772c979bcf262fa55c37530d268b781409638df5859e463bd91c4a: Status 404 returned error can't find the container with id eaef087872772c979bcf262fa55c37530d268b781409638df5859e463bd91c4a Jun 14 15:12:41.879078 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:41.879040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" event={"ID":"d1c11a46-ff3d-4972-9b79-36419b1560a9","Type":"ContainerStarted","Data":"eaef087872772c979bcf262fa55c37530d268b781409638df5859e463bd91c4a"} Jun 14 15:12:45.898734 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:45.898699 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" event={"ID":"d1c11a46-ff3d-4972-9b79-36419b1560a9","Type":"ContainerStarted","Data":"a9ae445ad0faecd96ece0559b11f8f5e6acce38e5186885735ed423c7e33f0f8"} Jun 14 15:12:46.903965 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:46.903928 2561 generic.go:356] "Generic (PLEG): container finished" podID="d1c11a46-ff3d-4972-9b79-36419b1560a9" containerID="a9ae445ad0faecd96ece0559b11f8f5e6acce38e5186885735ed423c7e33f0f8" exitCode=0 Jun 14 15:12:46.904358 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:46.903984 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" event={"ID":"d1c11a46-ff3d-4972-9b79-36419b1560a9","Type":"ContainerDied","Data":"a9ae445ad0faecd96ece0559b11f8f5e6acce38e5186885735ed423c7e33f0f8"} Jun 14 15:12:48.916608 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:48.916574 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" event={"ID":"d1c11a46-ff3d-4972-9b79-36419b1560a9","Type":"ContainerStarted","Data":"996e0a3b19b84fb296c4ef20cee2bb4cb31152e636176e1b9ad30bdb09063493"} Jun 14 15:12:48.936378 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:48.936334 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" podStartSLOduration=2.099252603 podStartE2EDuration="7.936321161s" totalImagesPullingTime="4.462876324s" totalInitContainerRuntime="1.374192234s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:12:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:12:48.935509329 +0000 UTC m=+1072.824734733" watchObservedRunningTime="2026-06-14 15:12:48.936321161 +0000 UTC m=+1072.825546561" Jun 14 15:12:51.496267 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:51.496231 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:51.496741 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:51.496297 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:51.508995 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:51.508975 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:51.939935 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:51.939905 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zxpjv" Jun 14 15:12:54.255820 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:54.255779 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:12:57.575887 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:12:57.575849 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:13:12.849474 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.849438 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr"] Jun 14 15:13:12.869125 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.869091 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr"] Jun 14 15:13:12.869417 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.869249 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:12.871755 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.871731 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 14 15:13:12.881347 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.881321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:13:12.923358 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.923317 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/039af0d1-1a43-4551-bc52-38a619709d93-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:12.923533 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.923389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:12.923533 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.923480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5lgf\" (UniqueName: \"kubernetes.io/projected/039af0d1-1a43-4551-bc52-38a619709d93-kube-api-access-p5lgf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:12.923533 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.923514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:12.923672 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.923536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:12.923672 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:12.923582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.024981 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.024944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5lgf\" (UniqueName: \"kubernetes.io/projected/039af0d1-1a43-4551-bc52-38a619709d93-kube-api-access-p5lgf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.025219 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.025000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.025219 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.025024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.025373 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.025237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.025373 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.025322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/039af0d1-1a43-4551-bc52-38a619709d93-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.025714 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.025686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.026172 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.026143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.026305 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.026004 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.026305 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.025753 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.028047 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.028026 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/039af0d1-1a43-4551-bc52-38a619709d93-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.028201 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.028154 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/039af0d1-1a43-4551-bc52-38a619709d93-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.033820 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.033789 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5lgf\" (UniqueName: \"kubernetes.io/projected/039af0d1-1a43-4551-bc52-38a619709d93-kube-api-access-p5lgf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-q75wr\" (UID: \"039af0d1-1a43-4551-bc52-38a619709d93\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.179607 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.179536 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:13.309410 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:13.309280 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr"] Jun 14 15:13:13.311644 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:13:13.311618 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039af0d1_1a43_4551_bc52_38a619709d93.slice/crio-f1d011d73bdcfafc39b90bf4e0cc448ecdbdaf51e749906432f451f9b77a5482 WatchSource:0}: Error finding container f1d011d73bdcfafc39b90bf4e0cc448ecdbdaf51e749906432f451f9b77a5482: Status 404 returned error can't find the container with id f1d011d73bdcfafc39b90bf4e0cc448ecdbdaf51e749906432f451f9b77a5482 Jun 14 15:13:14.023716 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:14.023675 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" event={"ID":"039af0d1-1a43-4551-bc52-38a619709d93","Type":"ContainerStarted","Data":"3ec886961203839522c11eda20160c6909bc855043b3c969d9b0440110ae9bfa"} Jun 14 15:13:14.024077 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:14.023727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" event={"ID":"039af0d1-1a43-4551-bc52-38a619709d93","Type":"ContainerStarted","Data":"f1d011d73bdcfafc39b90bf4e0cc448ecdbdaf51e749906432f451f9b77a5482"} Jun 14 15:13:15.029075 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:15.028989 2561 generic.go:356] "Generic (PLEG): container finished" podID="039af0d1-1a43-4551-bc52-38a619709d93" containerID="3ec886961203839522c11eda20160c6909bc855043b3c969d9b0440110ae9bfa" exitCode=0 Jun 14 15:13:15.029075 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:15.029018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" event={"ID":"039af0d1-1a43-4551-bc52-38a619709d93","Type":"ContainerDied","Data":"3ec886961203839522c11eda20160c6909bc855043b3c969d9b0440110ae9bfa"} Jun 14 15:13:16.034860 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:16.034828 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" event={"ID":"039af0d1-1a43-4551-bc52-38a619709d93","Type":"ContainerStarted","Data":"78b668bc300ea6edd18b0d0840f712c45a07f7d47ee5edcc9e8ae92620438574"} Jun 14 15:13:16.065623 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:16.065580 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" podStartSLOduration=2.50647242 podStartE2EDuration="4.065564151s" totalImagesPullingTime="189.414242ms" totalInitContainerRuntime="1.369677489s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:13:16.064141654 +0000 UTC m=+1099.953367048" watchObservedRunningTime="2026-06-14 15:13:16.065564151 +0000 UTC m=+1099.954789551" Jun 14 15:13:17.649625 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.649592 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw"] Jun 14 15:13:17.653264 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.653241 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.655857 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.655834 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 14 15:13:17.664218 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.664180 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw"] Jun 14 15:13:17.673687 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.673660 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:13:17.763985 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.763953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.764149 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.764007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.764149 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.764059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.764149 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.764085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.764149 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.764113 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aec24a88-c1e8-41d5-9b7f-dd39e1418244-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.764149 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.764135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcpmg\" (UniqueName: \"kubernetes.io/projected/aec24a88-c1e8-41d5-9b7f-dd39e1418244-kube-api-access-kcpmg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.864893 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.864848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.865070 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.864901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.865070 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.864931 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aec24a88-c1e8-41d5-9b7f-dd39e1418244-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.865070 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.864966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcpmg\" (UniqueName: \"kubernetes.io/projected/aec24a88-c1e8-41d5-9b7f-dd39e1418244-kube-api-access-kcpmg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.865070 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.865000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.865070 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.865060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.865371 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.865302 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.865503 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.865482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.865570 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.865518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.867303 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.867286 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aec24a88-c1e8-41d5-9b7f-dd39e1418244-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.867558 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.867541 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aec24a88-c1e8-41d5-9b7f-dd39e1418244-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.873255 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.873229 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcpmg\" (UniqueName: \"kubernetes.io/projected/aec24a88-c1e8-41d5-9b7f-dd39e1418244-kube-api-access-kcpmg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zbzmw\" (UID: \"aec24a88-c1e8-41d5-9b7f-dd39e1418244\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:17.962433 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:17.962364 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:13:18.102872 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:18.102817 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw"] Jun 14 15:13:18.104918 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:13:18.104888 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec24a88_c1e8_41d5_9b7f_dd39e1418244.slice/crio-7267f0339084e697b6d24f3ea81f42f3c55b904319609310582e2e80f2775861 WatchSource:0}: Error finding container 7267f0339084e697b6d24f3ea81f42f3c55b904319609310582e2e80f2775861: Status 404 returned error can't find the container with id 7267f0339084e697b6d24f3ea81f42f3c55b904319609310582e2e80f2775861 Jun 14 15:13:19.049580 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:19.049528 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" event={"ID":"aec24a88-c1e8-41d5-9b7f-dd39e1418244","Type":"ContainerStarted","Data":"d4f15bd937aec207b6f0d0295d289ef206aab1d9d163374a36859d76f6c518f8"} Jun 14 15:13:19.049580 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:19.049579 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" event={"ID":"aec24a88-c1e8-41d5-9b7f-dd39e1418244","Type":"ContainerStarted","Data":"7267f0339084e697b6d24f3ea81f42f3c55b904319609310582e2e80f2775861"} Jun 14 15:13:23.180677 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:23.180630 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:23.181103 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:23.180700 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:23.192964 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:23.192941 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:24.082573 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:24.082545 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-q75wr" Jun 14 15:13:55.932103 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:13:55.932070 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:14:56.640816 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:14:56.640786 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:14:56.642006 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:14:56.641983 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:15:52.724278 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:15:52.724242 2561 generic.go:356] "Generic (PLEG): container finished" podID="aec24a88-c1e8-41d5-9b7f-dd39e1418244" containerID="d4f15bd937aec207b6f0d0295d289ef206aab1d9d163374a36859d76f6c518f8" exitCode=0 Jun 14 15:15:52.724705 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:15:52.724317 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" event={"ID":"aec24a88-c1e8-41d5-9b7f-dd39e1418244","Type":"ContainerDied","Data":"d4f15bd937aec207b6f0d0295d289ef206aab1d9d163374a36859d76f6c518f8"} Jun 14 15:15:53.736952 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:15:53.736914 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" event={"ID":"aec24a88-c1e8-41d5-9b7f-dd39e1418244","Type":"ContainerStarted","Data":"b0eb44cc1d3ad2f779af3285d4da38983ef83a9a7a54ef91572760150660f0c4"} Jun 14 15:15:53.756961 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:15:53.756918 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" podStartSLOduration=2.119733457 podStartE2EDuration="2m36.756904235s" totalImagesPullingTime="215.383747ms" totalInitContainerRuntime="2m34.421787031s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:13:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:15:53.755721474 +0000 UTC m=+1257.644946875" watchObservedRunningTime="2026-06-14 15:15:53.756904235 +0000 UTC m=+1257.646129635" Jun 14 15:15:57.962894 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:15:57.962849 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:15:57.963374 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:15:57.962913 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:15:57.975576 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:15:57.975549 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:15:58.769508 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:15:58.769482 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zbzmw" Jun 14 15:16:02.495923 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:16:02.495882 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:16:03.666643 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:16:03.666600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:50.204964 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:50.204923 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:50.260690 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:50.260654 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dc85674c-2lvwl"] Jun 14 15:17:50.260896 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:50.260857 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6dc85674c-2lvwl" podUID="826f1d32-615c-4b0d-b0f8-3bd1b26bd726" containerName="manager" containerID="cri-o://e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd" gracePeriod=30 Jun 14 15:17:50.511579 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:50.511549 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:17:50.598848 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:50.598817 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-webhook-cert\") pod \"826f1d32-615c-4b0d-b0f8-3bd1b26bd726\" (UID: \"826f1d32-615c-4b0d-b0f8-3bd1b26bd726\") " Jun 14 15:17:50.599028 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:50.598931 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2knlf\" (UniqueName: \"kubernetes.io/projected/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-kube-api-access-2knlf\") pod \"826f1d32-615c-4b0d-b0f8-3bd1b26bd726\" (UID: \"826f1d32-615c-4b0d-b0f8-3bd1b26bd726\") " Jun 14 15:17:50.601011 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:50.600985 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "826f1d32-615c-4b0d-b0f8-3bd1b26bd726" (UID: "826f1d32-615c-4b0d-b0f8-3bd1b26bd726"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:17:50.601101 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:50.601026 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-kube-api-access-2knlf" (OuterVolumeSpecName: "kube-api-access-2knlf") pod "826f1d32-615c-4b0d-b0f8-3bd1b26bd726" (UID: "826f1d32-615c-4b0d-b0f8-3bd1b26bd726"). InnerVolumeSpecName "kube-api-access-2knlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:17:50.700034 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:50.699996 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2knlf\" (UniqueName: \"kubernetes.io/projected/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-kube-api-access-2knlf\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:17:50.700034 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:50.700030 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/826f1d32-615c-4b0d-b0f8-3bd1b26bd726-webhook-cert\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:17:51.252684 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:51.252647 2561 generic.go:356] "Generic (PLEG): container finished" podID="826f1d32-615c-4b0d-b0f8-3bd1b26bd726" containerID="e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd" exitCode=0 Jun 14 15:17:51.253114 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:51.252693 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dc85674c-2lvwl" Jun 14 15:17:51.253114 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:51.252735 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc85674c-2lvwl" event={"ID":"826f1d32-615c-4b0d-b0f8-3bd1b26bd726","Type":"ContainerDied","Data":"e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd"} Jun 14 15:17:51.253114 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:51.252792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc85674c-2lvwl" event={"ID":"826f1d32-615c-4b0d-b0f8-3bd1b26bd726","Type":"ContainerDied","Data":"2a56f6538eea5a079862fdc0a82a49360cd79f86c306bcb28bc90702b13fbd74"} Jun 14 15:17:51.253114 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:51.252821 2561 scope.go:117] "RemoveContainer" containerID="e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd" Jun 14 15:17:51.261668 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:51.261505 2561 scope.go:117] "RemoveContainer" containerID="e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd" Jun 14 15:17:51.261754 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:17:51.261737 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd\": container with ID starting with e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd not found: ID does not exist" containerID="e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd" Jun 14 15:17:51.261795 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:51.261762 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd"} err="failed to get container status \"e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd\": rpc error: code = NotFound desc = could not find container \"e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd\": container with ID starting with e6a5196b1c1f1a9bb769e89697262f380d25fc362e211810beaae52b6b46dcfd not found: ID does not exist" Jun 14 15:17:51.268239 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:51.268216 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dc85674c-2lvwl"] Jun 14 15:17:51.272317 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:51.272295 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6dc85674c-2lvwl"] Jun 14 15:17:51.915898 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:51.915848 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:52.023771 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.023731 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dc85674c-qhlbr"] Jun 14 15:17:52.024132 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.024114 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="826f1d32-615c-4b0d-b0f8-3bd1b26bd726" containerName="manager" Jun 14 15:17:52.024254 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.024134 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="826f1d32-615c-4b0d-b0f8-3bd1b26bd726" containerName="manager" Jun 14 15:17:52.024254 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.024247 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="826f1d32-615c-4b0d-b0f8-3bd1b26bd726" containerName="manager" Jun 14 15:17:52.028383 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.028363 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dc85674c-qhlbr" Jun 14 15:17:52.031988 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.031967 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 15:17:52.032109 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.032025 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 15:17:52.032172 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.032126 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hlgkn\"" Jun 14 15:17:52.036069 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.036045 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dc85674c-qhlbr"] Jun 14 15:17:52.112382 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.112348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/352f6600-a252-4819-9fc7-11896dae5318-webhook-cert\") pod \"maas-controller-6dc85674c-qhlbr\" (UID: \"352f6600-a252-4819-9fc7-11896dae5318\") " pod="opendatahub/maas-controller-6dc85674c-qhlbr" Jun 14 15:17:52.112527 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.112452 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw2dd\" (UniqueName: \"kubernetes.io/projected/352f6600-a252-4819-9fc7-11896dae5318-kube-api-access-fw2dd\") pod \"maas-controller-6dc85674c-qhlbr\" (UID: \"352f6600-a252-4819-9fc7-11896dae5318\") " pod="opendatahub/maas-controller-6dc85674c-qhlbr" Jun 14 15:17:52.213567 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.213478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw2dd\" (UniqueName: \"kubernetes.io/projected/352f6600-a252-4819-9fc7-11896dae5318-kube-api-access-fw2dd\") pod \"maas-controller-6dc85674c-qhlbr\" (UID: \"352f6600-a252-4819-9fc7-11896dae5318\") " pod="opendatahub/maas-controller-6dc85674c-qhlbr" Jun 14 15:17:52.213567 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.213539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/352f6600-a252-4819-9fc7-11896dae5318-webhook-cert\") pod \"maas-controller-6dc85674c-qhlbr\" (UID: \"352f6600-a252-4819-9fc7-11896dae5318\") " pod="opendatahub/maas-controller-6dc85674c-qhlbr" Jun 14 15:17:52.216060 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.216031 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/352f6600-a252-4819-9fc7-11896dae5318-webhook-cert\") pod \"maas-controller-6dc85674c-qhlbr\" (UID: \"352f6600-a252-4819-9fc7-11896dae5318\") " pod="opendatahub/maas-controller-6dc85674c-qhlbr" Jun 14 15:17:52.222507 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.222483 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw2dd\" (UniqueName: \"kubernetes.io/projected/352f6600-a252-4819-9fc7-11896dae5318-kube-api-access-fw2dd\") pod \"maas-controller-6dc85674c-qhlbr\" (UID: \"352f6600-a252-4819-9fc7-11896dae5318\") " pod="opendatahub/maas-controller-6dc85674c-qhlbr" Jun 14 15:17:52.340257 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.340213 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dc85674c-qhlbr" Jun 14 15:17:52.471500 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.471440 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dc85674c-qhlbr"] Jun 14 15:17:52.474122 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:17:52.474095 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352f6600_a252_4819_9fc7_11896dae5318.slice/crio-2fbfcf10525a0116da1092dfa7e679c6a821599faad46eb3bddba1ef7c3f4294 WatchSource:0}: Error finding container 2fbfcf10525a0116da1092dfa7e679c6a821599faad46eb3bddba1ef7c3f4294: Status 404 returned error can't find the container with id 2fbfcf10525a0116da1092dfa7e679c6a821599faad46eb3bddba1ef7c3f4294 Jun 14 15:17:52.475356 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.475340 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:17:52.626114 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:52.626079 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="826f1d32-615c-4b0d-b0f8-3bd1b26bd726" path="/var/lib/kubelet/pods/826f1d32-615c-4b0d-b0f8-3bd1b26bd726/volumes" Jun 14 15:17:53.263729 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:53.263646 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc85674c-qhlbr" event={"ID":"352f6600-a252-4819-9fc7-11896dae5318","Type":"ContainerStarted","Data":"b7a70cd22b5cfd33e5266b583fbf65de31fcbeb6f75b1d62ada815d7f1f164b2"} Jun 14 15:17:53.263729 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:53.263701 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc85674c-qhlbr" event={"ID":"352f6600-a252-4819-9fc7-11896dae5318","Type":"ContainerStarted","Data":"2fbfcf10525a0116da1092dfa7e679c6a821599faad46eb3bddba1ef7c3f4294"} Jun 14 15:17:53.263908 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:53.263766 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dc85674c-qhlbr" Jun 14 15:17:53.282406 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:17:53.282357 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dc85674c-qhlbr" podStartSLOduration=0.927473602 podStartE2EDuration="1.282340457s" totalImagesPullingTime="354.866855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:17:53.280437898 +0000 UTC m=+1377.169663297" watchObservedRunningTime="2026-06-14 15:17:53.282340457 +0000 UTC m=+1377.171565856" Jun 14 15:18:04.273662 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:18:04.273628 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dc85674c-qhlbr" Jun 14 15:18:31.780181 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:18:31.780146 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:31.874680 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:18:31.874639 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:41.069421 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:18:41.069381 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:46.198874 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:18:46.198793 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:46.299128 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:18:46.299091 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:56.148616 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:18:56.148581 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:05.150565 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:05.150524 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:05.214228 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:05.214179 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:18.418346 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:18.418314 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:18.510502 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:18.510468 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:42.364480 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:42.364445 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:48.575751 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:48.575721 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:48.648831 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:48.648794 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:48.743311 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:48.743279 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:48.870612 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:48.870527 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:49.120038 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:49.120005 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:49.221228 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:49.221114 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:56.665998 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:56.665970 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:19:56.668659 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:19:56.668635 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:20:05.623366 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:05.623332 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:05.765550 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:05.765519 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:05.925744 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:05.925655 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:12.901872 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:12.901838 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:13.038219 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:13.038159 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:21.142667 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:21.142569 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:21.351783 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:21.351753 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:21.518548 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:21.518446 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:37.965146 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:37.965102 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:38.083174 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:38.083133 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:38.180913 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:38.180860 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:43.922848 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:43.922813 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:20:43.988026 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:20:43.987967 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:00.225142 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:21:00.225103 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:00.323598 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:21:00.323564 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:00.423405 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:21:00.423374 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:06.110902 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:21:06.110866 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:07.101027 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:21:07.100996 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:12.157517 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:21:12.157480 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:12.223111 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:21:12.223075 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:21:41.984344 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:21:41.984298 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:23:13.115796 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:23:13.115758 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:23:13.197975 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:23:13.197941 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:24:56.697955 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:24:56.697926 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:24:56.700983 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:24:56.700960 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:26:04.015130 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:26:04.015092 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:29:49.131437 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:29:49.131377 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:29:50.075149 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:29:50.075096 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:29:56.723278 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:29:56.723251 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:29:56.726822 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:29:56.726802 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:31:52.805615 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:31:52.805585 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:32:14.341096 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:32:14.341017 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:33:31.361597 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:33:31.361555 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:34:56.747853 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:34:56.747737 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:34:56.752542 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:34:56.752519 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:35:30.193155 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:35:30.193119 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:35:31.248006 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:35:31.247974 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:38:46.295286 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:38:46.295254 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:38:46.359065 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:38:46.359036 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:39:56.774112 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:39:56.773955 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:39:56.778830 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:39:56.778811 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:40:00.877481 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:40:00.877443 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:41:19.943316 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:41:19.943233 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:41:56.452326 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:41:56.452290 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:41:56.513224 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:41:56.513175 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:43:56.978924 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:56.978895 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq"] Jun 14 15:43:56.982400 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:56.982378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:56.986139 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:56.986120 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1a8afa74-openshift-default-dockercfg-7mk9t\"" Jun 14 15:43:57.006248 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.006219 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq"] Jun 14 15:43:57.042515 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.042490 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:43:57.089367 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.089330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-istio-token\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.089563 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.089412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-socket\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.089563 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.089438 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-data\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.089563 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.089473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5552281c-db35-4ddc-a03a-15dd91411f12-istiod-ca-cert\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.089563 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.089529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5552281c-db35-4ddc-a03a-15dd91411f12-istio-podinfo\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.089764 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.089586 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-certs\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.089764 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.089657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-credential-socket\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.089764 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.089713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67q4j\" (UniqueName: \"kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-kube-api-access-67q4j\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.089871 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.089757 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-envoy\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.107245 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.107213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:43:57.190353 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.190317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-socket\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.190353 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.190354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-data\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.190829 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.190384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5552281c-db35-4ddc-a03a-15dd91411f12-istiod-ca-cert\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.190829 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.190412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5552281c-db35-4ddc-a03a-15dd91411f12-istio-podinfo\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.190829 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.190448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-certs\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.190829 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.190487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-credential-socket\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.190829 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.190530 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67q4j\" (UniqueName: \"kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-kube-api-access-67q4j\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.190829 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.190567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-envoy\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.190829 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.190605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-istio-token\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.191373 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.190842 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-certs\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.191373 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.191025 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-socket\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.191373 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.191040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-data\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.191373 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.191171 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-credential-socket\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.191595 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.191468 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5552281c-db35-4ddc-a03a-15dd91411f12-istiod-ca-cert\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.193427 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.193406 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-envoy\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.193538 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.193518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5552281c-db35-4ddc-a03a-15dd91411f12-istio-podinfo\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.199613 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.199586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-istio-token\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.199874 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.199852 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67q4j\" (UniqueName: \"kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-kube-api-access-67q4j\") pod \"e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.210160 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.210134 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:43:57.292456 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.292382 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:57.311990 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.311964 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:43:57.439927 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.439899 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq"] Jun 14 15:43:57.441655 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:43:57.441627 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5552281c_db35_4ddc_a03a_15dd91411f12.slice/crio-61ef0c8737677658caf42e8b34085274297abf832d47ded04c9a4a54d30fe4b6 WatchSource:0}: Error finding container 61ef0c8737677658caf42e8b34085274297abf832d47ded04c9a4a54d30fe4b6: Status 404 returned error can't find the container with id 61ef0c8737677658caf42e8b34085274297abf832d47ded04c9a4a54d30fe4b6 Jun 14 15:43:57.443795 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.443759 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:43:57.443936 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.443831 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:43:57.443936 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:57.443859 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:43:58.175363 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:58.175327 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" event={"ID":"5552281c-db35-4ddc-a03a-15dd91411f12","Type":"ContainerStarted","Data":"b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0"} Jun 14 15:43:58.175747 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:58.175377 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" event={"ID":"5552281c-db35-4ddc-a03a-15dd91411f12","Type":"ContainerStarted","Data":"61ef0c8737677658caf42e8b34085274297abf832d47ded04c9a4a54d30fe4b6"} Jun 14 15:43:58.199433 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:58.199387 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" podStartSLOduration=2.1993708610000002 podStartE2EDuration="2.199370861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:43:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:43:58.198306286 +0000 UTC m=+2942.087531714" watchObservedRunningTime="2026-06-14 15:43:58.199370861 +0000 UTC m=+2942.088596261" Jun 14 15:43:58.292550 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:58.292512 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:58.297077 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:58.297052 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:59.180042 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:59.180005 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:43:59.181092 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:43:59.181067 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:44:00.976258 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:00.976229 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:03.314755 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:03.314718 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:03.439823 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:03.439788 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq"] Jun 14 15:44:03.439999 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:03.439981 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" podUID="5552281c-db35-4ddc-a03a-15dd91411f12" containerName="istio-proxy" containerID="cri-o://b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0" gracePeriod=30 Jun 14 15:44:03.472484 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:03.472452 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:03.569434 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:03.569353 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:04.742403 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:04.742372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:08.684634 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.684610 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:44:08.789993 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.789901 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-credential-socket\") pod \"5552281c-db35-4ddc-a03a-15dd91411f12\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " Jun 14 15:44:08.789993 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.789962 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-socket\") pod \"5552281c-db35-4ddc-a03a-15dd91411f12\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " Jun 14 15:44:08.790246 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790007 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-envoy\") pod \"5552281c-db35-4ddc-a03a-15dd91411f12\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " Jun 14 15:44:08.790246 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790042 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-data\") pod \"5552281c-db35-4ddc-a03a-15dd91411f12\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " Jun 14 15:44:08.790246 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790087 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5552281c-db35-4ddc-a03a-15dd91411f12-istio-podinfo\") pod \"5552281c-db35-4ddc-a03a-15dd91411f12\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " Jun 14 15:44:08.790246 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790113 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-istio-token\") pod \"5552281c-db35-4ddc-a03a-15dd91411f12\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " Jun 14 15:44:08.790246 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790132 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-certs\") pod \"5552281c-db35-4ddc-a03a-15dd91411f12\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " Jun 14 15:44:08.790246 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790136 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5552281c-db35-4ddc-a03a-15dd91411f12" (UID: "5552281c-db35-4ddc-a03a-15dd91411f12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:44:08.790246 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790215 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5552281c-db35-4ddc-a03a-15dd91411f12-istiod-ca-cert\") pod \"5552281c-db35-4ddc-a03a-15dd91411f12\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " Jun 14 15:44:08.790246 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790244 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67q4j\" (UniqueName: \"kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-kube-api-access-67q4j\") pod \"5552281c-db35-4ddc-a03a-15dd91411f12\" (UID: \"5552281c-db35-4ddc-a03a-15dd91411f12\") " Jun 14 15:44:08.790625 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790291 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5552281c-db35-4ddc-a03a-15dd91411f12" (UID: "5552281c-db35-4ddc-a03a-15dd91411f12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:44:08.790625 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790398 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-data" (OuterVolumeSpecName: "istio-data") pod "5552281c-db35-4ddc-a03a-15dd91411f12" (UID: "5552281c-db35-4ddc-a03a-15dd91411f12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:44:08.790625 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790532 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-credential-socket\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:08.790625 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790547 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-socket\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:08.790625 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790557 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-data\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:08.790625 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790551 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5552281c-db35-4ddc-a03a-15dd91411f12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5552281c-db35-4ddc-a03a-15dd91411f12" (UID: "5552281c-db35-4ddc-a03a-15dd91411f12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:44:08.791085 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.790777 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5552281c-db35-4ddc-a03a-15dd91411f12" (UID: "5552281c-db35-4ddc-a03a-15dd91411f12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:44:08.792715 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.792685 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5552281c-db35-4ddc-a03a-15dd91411f12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5552281c-db35-4ddc-a03a-15dd91411f12" (UID: "5552281c-db35-4ddc-a03a-15dd91411f12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 14 15:44:08.792715 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.792702 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-kube-api-access-67q4j" (OuterVolumeSpecName: "kube-api-access-67q4j") pod "5552281c-db35-4ddc-a03a-15dd91411f12" (UID: "5552281c-db35-4ddc-a03a-15dd91411f12"). InnerVolumeSpecName "kube-api-access-67q4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:44:08.792858 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.792722 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-istio-token" (OuterVolumeSpecName: "istio-token") pod "5552281c-db35-4ddc-a03a-15dd91411f12" (UID: "5552281c-db35-4ddc-a03a-15dd91411f12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:44:08.792858 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.792688 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5552281c-db35-4ddc-a03a-15dd91411f12" (UID: "5552281c-db35-4ddc-a03a-15dd91411f12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:44:08.891426 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.891396 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5552281c-db35-4ddc-a03a-15dd91411f12-istio-podinfo\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:08.891426 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.891422 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-istio-token\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:08.891591 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.891436 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-workload-certs\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:08.891591 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.891448 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5552281c-db35-4ddc-a03a-15dd91411f12-istiod-ca-cert\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:08.891591 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.891461 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67q4j\" (UniqueName: \"kubernetes.io/projected/5552281c-db35-4ddc-a03a-15dd91411f12-kube-api-access-67q4j\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:08.891591 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:08.891473 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5552281c-db35-4ddc-a03a-15dd91411f12-istio-envoy\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:09.227551 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.227519 2561 generic.go:356] "Generic (PLEG): container finished" podID="5552281c-db35-4ddc-a03a-15dd91411f12" containerID="b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0" exitCode=0 Jun 14 15:44:09.227728 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.227568 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" Jun 14 15:44:09.227728 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.227609 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" event={"ID":"5552281c-db35-4ddc-a03a-15dd91411f12","Type":"ContainerDied","Data":"b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0"} Jun 14 15:44:09.227728 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.227669 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq" event={"ID":"5552281c-db35-4ddc-a03a-15dd91411f12","Type":"ContainerDied","Data":"61ef0c8737677658caf42e8b34085274297abf832d47ded04c9a4a54d30fe4b6"} Jun 14 15:44:09.227728 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.227695 2561 scope.go:117] "RemoveContainer" containerID="b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0" Jun 14 15:44:09.237401 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.237385 2561 scope.go:117] "RemoveContainer" containerID="b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0" Jun 14 15:44:09.237663 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:44:09.237646 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0\": container with ID starting with b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0 not found: ID does not exist" containerID="b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0" Jun 14 15:44:09.237718 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.237670 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0"} err="failed to get container status \"b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0\": rpc error: code = NotFound desc = could not find container \"b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0\": container with ID starting with b9be31e86709c513b98015c6b1616b620fd823780a93663433af41a3c16811b0 not found: ID does not exist" Jun 14 15:44:09.251158 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.251135 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq"] Jun 14 15:44:09.256053 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.256031 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1a8afa74-openshift-default-6557f78fb-wv4hq"] Jun 14 15:44:09.877433 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.877401 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:09.942656 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:09.942605 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:10.161576 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.161544 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh"] Jun 14 15:44:10.161916 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.161898 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5552281c-db35-4ddc-a03a-15dd91411f12" containerName="istio-proxy" Jun 14 15:44:10.161991 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.161919 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5552281c-db35-4ddc-a03a-15dd91411f12" containerName="istio-proxy" Jun 14 15:44:10.162046 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.162020 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5552281c-db35-4ddc-a03a-15dd91411f12" containerName="istio-proxy" Jun 14 15:44:10.166313 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.166293 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.169792 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.169772 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7e9a50d0-openshift-default-dockercfg-tz8l6\"" Jun 14 15:44:10.254325 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.254287 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:10.286624 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.286590 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh"] Jun 14 15:44:10.301795 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.301763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-token\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.301795 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.301795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-podinfo\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.301984 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.301833 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-socket\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.301984 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.301855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-certs\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.301984 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.301890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-envoy\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.301984 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.301905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n49zl\" (UniqueName: \"kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-kube-api-access-n49zl\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.301984 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.301957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-data\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.302155 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.301986 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/871e48be-ce79-4440-b20d-6b8fa5607a47-istiod-ca-cert\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.302155 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.302025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-credential-socket\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.400262 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.400156 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:10.403276 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-socket\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403334 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-certs\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403334 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-envoy\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403417 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n49zl\" (UniqueName: \"kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-kube-api-access-n49zl\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403417 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-data\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403417 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/871e48be-ce79-4440-b20d-6b8fa5607a47-istiod-ca-cert\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403564 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-credential-socket\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403614 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-token\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403614 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-podinfo\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403722 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403673 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-socket\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403959 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403802 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-data\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403959 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403860 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-credential-socket\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.403959 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.403930 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-certs\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.404154 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.404133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/871e48be-ce79-4440-b20d-6b8fa5607a47-istiod-ca-cert\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.405691 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.405673 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-envoy\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.406093 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.406077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-podinfo\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.417526 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.417507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-token\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.421601 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.421577 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n49zl\" (UniqueName: \"kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-kube-api-access-n49zl\") pod \"e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.476144 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.476111 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:10.626953 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:44:10.626921 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871e48be_ce79_4440_b20d_6b8fa5607a47.slice/crio-ddd42b652282bfab891605dd0e96fe9ac0420c35c90026609c088434098727ee WatchSource:0}: Error finding container ddd42b652282bfab891605dd0e96fe9ac0420c35c90026609c088434098727ee: Status 404 returned error can't find the container with id ddd42b652282bfab891605dd0e96fe9ac0420c35c90026609c088434098727ee Jun 14 15:44:10.627437 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.627414 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5552281c-db35-4ddc-a03a-15dd91411f12" path="/var/lib/kubelet/pods/5552281c-db35-4ddc-a03a-15dd91411f12/volumes" Jun 14 15:44:10.627711 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.627693 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh"] Jun 14 15:44:10.628958 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.628925 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:44:10.629065 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.628999 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:44:10.629065 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:10.629044 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 14 15:44:11.238351 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:11.238314 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" event={"ID":"871e48be-ce79-4440-b20d-6b8fa5607a47","Type":"ContainerStarted","Data":"83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249"} Jun 14 15:44:11.238833 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:11.238407 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" event={"ID":"871e48be-ce79-4440-b20d-6b8fa5607a47","Type":"ContainerStarted","Data":"ddd42b652282bfab891605dd0e96fe9ac0420c35c90026609c088434098727ee"} Jun 14 15:44:11.267399 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:11.267347 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" podStartSLOduration=1.267333597 podStartE2EDuration="1.267333597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:44:11.265685581 +0000 UTC m=+2955.154910980" watchObservedRunningTime="2026-06-14 15:44:11.267333597 +0000 UTC m=+2955.156558996" Jun 14 15:44:11.476252 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:11.476219 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:11.480962 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:11.480936 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:12.242588 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:12.242558 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:12.243375 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:12.243355 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:13.037747 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:13.037697 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:16.453250 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:16.453131 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:17.589107 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:17.589066 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh"] Jun 14 15:44:17.589516 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:17.589316 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" podUID="871e48be-ce79-4440-b20d-6b8fa5607a47" containerName="istio-proxy" containerID="cri-o://83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249" gracePeriod=30 Jun 14 15:44:17.612436 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:17.612409 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:17.711172 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:17.711142 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:20.096152 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:20.096114 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:22.833897 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.833870 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:22.908237 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908133 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n49zl\" (UniqueName: \"kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-kube-api-access-n49zl\") pod \"871e48be-ce79-4440-b20d-6b8fa5607a47\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " Jun 14 15:44:22.908237 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908179 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-socket\") pod \"871e48be-ce79-4440-b20d-6b8fa5607a47\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " Jun 14 15:44:22.908439 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908227 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-credential-socket\") pod \"871e48be-ce79-4440-b20d-6b8fa5607a47\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " Jun 14 15:44:22.908439 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908282 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-envoy\") pod \"871e48be-ce79-4440-b20d-6b8fa5607a47\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " Jun 14 15:44:22.908439 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908318 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-token\") pod \"871e48be-ce79-4440-b20d-6b8fa5607a47\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " Jun 14 15:44:22.908439 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908352 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-podinfo\") pod \"871e48be-ce79-4440-b20d-6b8fa5607a47\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " Jun 14 15:44:22.908439 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908371 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-data\") pod \"871e48be-ce79-4440-b20d-6b8fa5607a47\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " Jun 14 15:44:22.908439 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908401 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/871e48be-ce79-4440-b20d-6b8fa5607a47-istiod-ca-cert\") pod \"871e48be-ce79-4440-b20d-6b8fa5607a47\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " Jun 14 15:44:22.908439 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908439 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-certs\") pod \"871e48be-ce79-4440-b20d-6b8fa5607a47\" (UID: \"871e48be-ce79-4440-b20d-6b8fa5607a47\") " Jun 14 15:44:22.908951 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908885 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "871e48be-ce79-4440-b20d-6b8fa5607a47" (UID: "871e48be-ce79-4440-b20d-6b8fa5607a47"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:44:22.909094 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908970 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "871e48be-ce79-4440-b20d-6b8fa5607a47" (UID: "871e48be-ce79-4440-b20d-6b8fa5607a47"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:44:22.909094 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.908983 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-data" (OuterVolumeSpecName: "istio-data") pod "871e48be-ce79-4440-b20d-6b8fa5607a47" (UID: "871e48be-ce79-4440-b20d-6b8fa5607a47"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:44:22.909320 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.909292 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "871e48be-ce79-4440-b20d-6b8fa5607a47" (UID: "871e48be-ce79-4440-b20d-6b8fa5607a47"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:44:22.909770 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.909725 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871e48be-ce79-4440-b20d-6b8fa5607a47-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "871e48be-ce79-4440-b20d-6b8fa5607a47" (UID: "871e48be-ce79-4440-b20d-6b8fa5607a47"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:44:22.909954 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.909931 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-data\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:22.910018 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.909971 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/871e48be-ce79-4440-b20d-6b8fa5607a47-istiod-ca-cert\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:22.910018 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.909986 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-certs\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:22.910018 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.910000 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-workload-socket\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:22.910018 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.910014 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-credential-socket\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:22.914930 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.911181 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-kube-api-access-n49zl" (OuterVolumeSpecName: "kube-api-access-n49zl") pod "871e48be-ce79-4440-b20d-6b8fa5607a47" (UID: "871e48be-ce79-4440-b20d-6b8fa5607a47"). InnerVolumeSpecName "kube-api-access-n49zl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:44:22.914930 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.912799 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "871e48be-ce79-4440-b20d-6b8fa5607a47" (UID: "871e48be-ce79-4440-b20d-6b8fa5607a47"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:44:22.915650 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.915613 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "871e48be-ce79-4440-b20d-6b8fa5607a47" (UID: "871e48be-ce79-4440-b20d-6b8fa5607a47"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 14 15:44:22.916763 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:22.916736 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-token" (OuterVolumeSpecName: "istio-token") pod "871e48be-ce79-4440-b20d-6b8fa5607a47" (UID: "871e48be-ce79-4440-b20d-6b8fa5607a47"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:44:23.011326 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.011293 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n49zl\" (UniqueName: \"kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-kube-api-access-n49zl\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:23.011326 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.011321 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-envoy\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:23.011326 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.011331 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-token\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:23.011530 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.011339 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/871e48be-ce79-4440-b20d-6b8fa5607a47-istio-podinfo\") on node \"ip-10-0-134-188.ec2.internal\" DevicePath \"\"" Jun 14 15:44:23.290878 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.290777 2561 generic.go:356] "Generic (PLEG): container finished" podID="871e48be-ce79-4440-b20d-6b8fa5607a47" containerID="83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249" exitCode=0 Jun 14 15:44:23.290878 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.290846 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" Jun 14 15:44:23.291114 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.290866 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" event={"ID":"871e48be-ce79-4440-b20d-6b8fa5607a47","Type":"ContainerDied","Data":"83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249"} Jun 14 15:44:23.291114 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.290959 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh" event={"ID":"871e48be-ce79-4440-b20d-6b8fa5607a47","Type":"ContainerDied","Data":"ddd42b652282bfab891605dd0e96fe9ac0420c35c90026609c088434098727ee"} Jun 14 15:44:23.291114 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.290990 2561 scope.go:117] "RemoveContainer" containerID="83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249" Jun 14 15:44:23.300252 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.300230 2561 scope.go:117] "RemoveContainer" containerID="83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249" Jun 14 15:44:23.300519 ip-10-0-134-188 kubenswrapper[2561]: E0614 15:44:23.300499 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249\": container with ID starting with 83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249 not found: ID does not exist" containerID="83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249" Jun 14 15:44:23.300577 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.300526 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249"} err="failed to get container status \"83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249\": rpc error: code = NotFound desc = could not find container \"83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249\": container with ID starting with 83261b8811dac53be3ce5d331336559366f442eb6926577346853a85ff4a6249 not found: ID does not exist" Jun 14 15:44:23.317082 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.317053 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh"] Jun 14 15:44:23.321182 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.321160 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7e9a50d0-openshift-default-b9dd756d4-5qxmh"] Jun 14 15:44:23.770915 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.770883 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:23.871013 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:23.870982 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:24.627052 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:24.627020 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="871e48be-ce79-4440-b20d-6b8fa5607a47" path="/var/lib/kubelet/pods/871e48be-ce79-4440-b20d-6b8fa5607a47/volumes" Jun 14 15:44:34.993743 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:34.993716 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f68ccfc94-qd72q_c7587307-f933-423a-8b56-6e54a4cd7063/nginx/0.log" Jun 14 15:44:35.336275 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:35.336244 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5dd58bcd4c-4v4s2_d5d37154-9551-4a4d-9608-c43ba1ff2081/maas-api/0.log" Jun 14 15:44:35.676609 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:35.676529 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dc85674c-qhlbr_352f6600-a252-4819-9fc7-11896dae5318/manager/0.log" Jun 14 15:44:36.295351 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:36.295322 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-mqxfl_0f53f866-be92-4d9c-888e-d425cf4ac0a5/copy-manifests/0.log" Jun 14 15:44:36.308807 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:36.308778 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-mqxfl_0f53f866-be92-4d9c-888e-d425cf4ac0a5/manager/0.log" Jun 14 15:44:37.864049 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:37.864022 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g6zd4_32ff0340-fe81-45b2-8097-fdf0e4049b43/manager/0.log" Jun 14 15:44:38.200284 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:38.200212 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-spgxc_52607ae4-b0ba-43a4-932c-357bf2879aaf/registry-server/0.log" Jun 14 15:44:38.584769 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:38.584728 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-swxg7_a55a82f6-5973-45bc-ae0f-f49f5f875924/manager/0.log" Jun 14 15:44:38.922717 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:38.922628 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w54kb_0af4f781-f4c1-452c-8ce6-3e828c8b6b6c/istio-proxy/0.log" Jun 14 15:44:39.375877 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:39.375843 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j9hmv_1948e1fc-950a-4341-b695-1151e6d5baf7/istio-proxy/1.log" Jun 14 15:44:40.187993 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:40.187955 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-zxpjv_d1c11a46-ff3d-4972-9b79-36419b1560a9/storage-initializer/0.log" Jun 14 15:44:40.195130 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:40.195112 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-zxpjv_d1c11a46-ff3d-4972-9b79-36419b1560a9/main/0.log" Jun 14 15:44:40.556471 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:40.556386 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-q75wr_039af0d1-1a43-4551-bc52-38a619709d93/storage-initializer/0.log" Jun 14 15:44:40.563480 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:40.563459 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-q75wr_039af0d1-1a43-4551-bc52-38a619709d93/main/0.log" Jun 14 15:44:40.674933 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:40.674900 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-zbzmw_aec24a88-c1e8-41d5-9b7f-dd39e1418244/storage-initializer/0.log" Jun 14 15:44:40.682938 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:40.682915 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-zbzmw_aec24a88-c1e8-41d5-9b7f-dd39e1418244/main/0.log" Jun 14 15:44:45.209316 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:45.209274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:45.314344 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:45.314313 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" limit=1024 Jun 14 15:44:48.288963 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:48.288938 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hrhnq_eb586a37-c589-4617-9967-804838c873b8/global-pull-secret-syncer/0.log" Jun 14 15:44:48.384423 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:48.384391 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8pvk9_547b5340-60ab-4196-8d72-bc9e6e3d67ad/konnectivity-agent/0.log" Jun 14 15:44:48.520440 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:48.520407 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-188.ec2.internal_8ceb315acd6d802f9b9d0b94fadd4ba4/haproxy/0.log" Jun 14 15:44:53.795222 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:53.795174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g6zd4_32ff0340-fe81-45b2-8097-fdf0e4049b43/manager/0.log" Jun 14 15:44:53.925210 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:53.925165 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-spgxc_52607ae4-b0ba-43a4-932c-357bf2879aaf/registry-server/0.log" Jun 14 15:44:54.113715 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:54.113682 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-swxg7_a55a82f6-5973-45bc-ae0f-f49f5f875924/manager/0.log" Jun 14 15:44:56.105407 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:56.105384 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-55fjf_dde431ed-57d6-452d-8e8c-e16edddd02e5/node-exporter/0.log" Jun 14 15:44:56.131354 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:56.131328 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-55fjf_dde431ed-57d6-452d-8e8c-e16edddd02e5/kube-rbac-proxy/0.log" Jun 14 15:44:56.160237 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:56.160213 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-55fjf_dde431ed-57d6-452d-8e8c-e16edddd02e5/init-textfile/0.log" Jun 14 15:44:56.800740 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:56.800615 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:44:56.807729 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:44:56.805078 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msmgc_18d2357f-e492-4696-ac06-bbcd4106f338/ovn-acl-logging/0.log" Jun 14 15:45:00.132145 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.132108 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf"] Jun 14 15:45:00.132556 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.132443 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="871e48be-ce79-4440-b20d-6b8fa5607a47" containerName="istio-proxy" Jun 14 15:45:00.132556 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.132455 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="871e48be-ce79-4440-b20d-6b8fa5607a47" containerName="istio-proxy" Jun 14 15:45:00.132556 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.132520 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="871e48be-ce79-4440-b20d-6b8fa5607a47" containerName="istio-proxy" Jun 14 15:45:00.136851 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.136831 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.139755 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.139734 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z9pc6\"/\"openshift-service-ca.crt\"" Jun 14 15:45:00.140758 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.140741 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z9pc6\"/\"default-dockercfg-fng5t\"" Jun 14 15:45:00.140827 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.140794 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z9pc6\"/\"kube-root-ca.crt\"" Jun 14 15:45:00.151997 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.151973 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf"] Jun 14 15:45:00.208085 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.208055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlc2\" (UniqueName: \"kubernetes.io/projected/54173460-2b35-4b99-a43a-d5b009006532-kube-api-access-lqlc2\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.208252 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.208092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-lib-modules\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.208252 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.208127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-podres\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.208252 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.208217 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-sys\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.208368 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.208258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-proc\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.309235 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.309181 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlc2\" (UniqueName: \"kubernetes.io/projected/54173460-2b35-4b99-a43a-d5b009006532-kube-api-access-lqlc2\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.309394 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.309250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-lib-modules\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.309394 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.309286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-podres\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.309394 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.309311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-sys\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.309394 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.309331 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-proc\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.309607 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.309387 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-lib-modules\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.309607 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.309415 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-sys\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.309607 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.309427 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-proc\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.309607 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.309424 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54173460-2b35-4b99-a43a-d5b009006532-podres\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.317463 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.317443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlc2\" (UniqueName: \"kubernetes.io/projected/54173460-2b35-4b99-a43a-d5b009006532-kube-api-access-lqlc2\") pod \"perf-node-gather-daemonset-hfclf\" (UID: \"54173460-2b35-4b99-a43a-d5b009006532\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.446397 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.446313 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:00.584220 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:00.584175 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf"] Jun 14 15:45:00.586672 ip-10-0-134-188 kubenswrapper[2561]: W0614 15:45:00.586642 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod54173460_2b35_4b99_a43a_d5b009006532.slice/crio-cfe5f89ec8ad3126b2c544e989013f282671fd09840d77698c90bbdcf7b85e03 WatchSource:0}: Error finding container cfe5f89ec8ad3126b2c544e989013f282671fd09840d77698c90bbdcf7b85e03: Status 404 returned error can't find the container with id cfe5f89ec8ad3126b2c544e989013f282671fd09840d77698c90bbdcf7b85e03 Jun 14 15:45:01.465067 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:01.465035 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" event={"ID":"54173460-2b35-4b99-a43a-d5b009006532","Type":"ContainerStarted","Data":"a76ba88472ab554dc6d4ca45a43774c0bea4b68f2e8dc99b4e226cc6ecc09310"} Jun 14 15:45:01.465533 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:01.465084 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" event={"ID":"54173460-2b35-4b99-a43a-d5b009006532","Type":"ContainerStarted","Data":"cfe5f89ec8ad3126b2c544e989013f282671fd09840d77698c90bbdcf7b85e03"} Jun 14 15:45:01.465533 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:01.465126 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:01.483281 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:01.483234 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" podStartSLOduration=1.483220835 podStartE2EDuration="1.483220835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:45:01.481771151 +0000 UTC m=+3005.370996550" watchObservedRunningTime="2026-06-14 15:45:01.483220835 +0000 UTC m=+3005.372446234" Jun 14 15:45:01.596728 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:01.596678 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4spxt_42f499f6-f899-4b19-b75a-81851ac7f194/dns/0.log" Jun 14 15:45:01.636598 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:01.636572 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4spxt_42f499f6-f899-4b19-b75a-81851ac7f194/kube-rbac-proxy/0.log" Jun 14 15:45:01.936531 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:01.936502 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qddgd_a359273f-3646-4342-8e04-13ca25961257/dns-node-resolver/0.log" Jun 14 15:45:02.614960 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:02.614930 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vt5jr_64c9f8a5-ea6c-4120-b6eb-0f6328d5d127/node-ca/0.log" Jun 14 15:45:03.581274 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:03.581243 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w54kb_0af4f781-f4c1-452c-8ce6-3e828c8b6b6c/istio-proxy/0.log" Jun 14 15:45:03.779821 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:03.779788 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j9hmv_1948e1fc-950a-4341-b695-1151e6d5baf7/istio-proxy/0.log" Jun 14 15:45:03.808603 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:03.808571 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j9hmv_1948e1fc-950a-4341-b695-1151e6d5baf7/istio-proxy/1.log" Jun 14 15:45:04.622233 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:04.622205 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cvld6_31f5b369-91e9-4390-aa06-da598738aa47/serve-healthcheck-canary/0.log" Jun 14 15:45:05.397686 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:05.397657 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jxjg2_7675443c-f61f-4877-8d63-941dd02951d9/kube-rbac-proxy/0.log" Jun 14 15:45:05.443956 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:05.443930 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jxjg2_7675443c-f61f-4877-8d63-941dd02951d9/exporter/0.log" Jun 14 15:45:05.473169 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:05.473129 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jxjg2_7675443c-f61f-4877-8d63-941dd02951d9/extractor/0.log" Jun 14 15:45:07.480076 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:07.480047 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-hfclf" Jun 14 15:45:07.989615 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:07.989585 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f68ccfc94-qd72q_c7587307-f933-423a-8b56-6e54a4cd7063/nginx/0.log" Jun 14 15:45:08.173538 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:08.173501 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5dd58bcd4c-4v4s2_d5d37154-9551-4a4d-9608-c43ba1ff2081/maas-api/0.log" Jun 14 15:45:08.343811 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:08.343775 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dc85674c-qhlbr_352f6600-a252-4819-9fc7-11896dae5318/manager/0.log" Jun 14 15:45:08.643338 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:08.643257 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-mqxfl_0f53f866-be92-4d9c-888e-d425cf4ac0a5/manager/0.log" Jun 14 15:45:08.664472 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:08.664444 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-mqxfl_0f53f866-be92-4d9c-888e-d425cf4ac0a5/copy-manifests/0.log" Jun 14 15:45:10.534479 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:10.534393 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d55879689-hhw4g_ba2a705a-e545-477f-ba60-9c38fc124be6/manager/0.log" Jun 14 15:45:13.359576 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:13.359549 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w54kb_0af4f781-f4c1-452c-8ce6-3e828c8b6b6c/istio-proxy/0.log" Jun 14 15:45:13.530933 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:13.530899 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j9hmv_1948e1fc-950a-4341-b695-1151e6d5baf7/istio-proxy/0.log" Jun 14 15:45:13.570452 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:13.570423 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j9hmv_1948e1fc-950a-4341-b695-1151e6d5baf7/istio-proxy/1.log" Jun 14 15:45:14.981912 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:14.981882 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w54kb_0af4f781-f4c1-452c-8ce6-3e828c8b6b6c/istio-proxy/0.log" Jun 14 15:45:15.188252 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:15.188214 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j9hmv_1948e1fc-950a-4341-b695-1151e6d5baf7/istio-proxy/0.log" Jun 14 15:45:15.218505 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:15.218460 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j9hmv_1948e1fc-950a-4341-b695-1151e6d5baf7/istio-proxy/1.log" Jun 14 15:45:17.191406 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:17.191374 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w54kb_0af4f781-f4c1-452c-8ce6-3e828c8b6b6c/istio-proxy/0.log" Jun 14 15:45:17.460605 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:17.460493 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j9hmv_1948e1fc-950a-4341-b695-1151e6d5baf7/istio-proxy/0.log" Jun 14 15:45:17.495575 ip-10-0-134-188 kubenswrapper[2561]: I0614 15:45:17.495548 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-j9hmv_1948e1fc-950a-4341-b695-1151e6d5baf7/istio-proxy/1.log"