Jun 11 21:10:50.858740 ip-10-0-135-86 systemd[1]: Starting Kubernetes Kubelet... Jun 11 21:10:51.259757 ip-10-0-135-86 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:10:51.259757 ip-10-0-135-86 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 21:10:51.259757 ip-10-0-135-86 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:10:51.259757 ip-10-0-135-86 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 21:10:51.259757 ip-10-0-135-86 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:10:51.260637 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.260549 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 21:10:51.264892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264878 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:10:51.264892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264892 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264896 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264901 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264905 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264908 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264911 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264914 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264917 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264920 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264923 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264927 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264931 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264934 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264937 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264940 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264944 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264947 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264949 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264952 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:10:51.264954 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264955 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264958 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264961 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264963 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264966 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264969 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264972 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264975 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264977 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264980 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264983 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264986 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264989 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264991 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264994 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264996 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.264999 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265001 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265005 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265007 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:10:51.265413 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265010 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265012 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265015 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265017 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265020 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265022 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265025 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265027 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265030 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265032 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265035 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265037 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265040 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265042 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265045 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265048 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265051 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265054 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265058 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265061 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:10:51.265921 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265063 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265066 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265068 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265071 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265073 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265076 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265079 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265081 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265084 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265086 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265089 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265093 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265096 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265099 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265102 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265105 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265108 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265110 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265113 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:10:51.266411 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265116 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265119 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265121 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265124 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265127 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265129 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265132 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265135 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265138 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265141 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265143 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265146 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265148 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265151 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265153 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265156 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265158 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265161 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265163 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265166 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:10:51.266892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265857 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265863 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265866 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265871 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265875 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265881 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265884 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265887 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265890 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265893 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265895 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265898 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265901 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265904 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265906 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265909 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265911 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265914 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265917 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:10:51.267377 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265920 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265924 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265926 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265929 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265932 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265934 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265937 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265940 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265942 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265945 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265948 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265950 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265952 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265955 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265958 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265960 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265963 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265965 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265968 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265971 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:10:51.267867 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265974 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265976 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265979 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265983 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265986 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265990 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265992 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265995 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.265998 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266001 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266004 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266007 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266011 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266013 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266016 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266018 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266022 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266025 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266028 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:10:51.268354 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266030 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266033 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266036 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266038 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266041 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266043 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266046 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266050 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266052 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266055 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266059 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266061 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266064 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266067 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266070 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266072 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266075 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266078 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266080 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266083 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:10:51.268839 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266085 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266088 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266091 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266093 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266096 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266099 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266102 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266104 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266107 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266109 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266112 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266115 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266118 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266120 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266123 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266125 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266128 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266131 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266133 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266136 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:10:51.269348 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266139 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266548 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266554 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266558 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266561 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266565 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266568 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266571 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266574 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266578 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266582 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266585 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266588 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266592 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266595 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266598 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266601 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266605 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266607 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:10:51.269864 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266610 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266613 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266616 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266619 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266622 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266625 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266628 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266631 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266634 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266636 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266639 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266642 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266644 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266647 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266649 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266653 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266655 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266658 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266660 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:10:51.270331 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266664 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266666 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266669 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266671 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266674 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266676 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266679 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266682 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266685 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266687 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266690 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266693 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266695 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266698 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266700 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266703 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266705 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266708 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266713 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266715 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:10:51.270801 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266718 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266720 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266723 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266725 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266728 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266731 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266733 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266735 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266738 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266741 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266744 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266747 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266749 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266752 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266755 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266757 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266759 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266762 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266764 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266767 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:10:51.271329 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266769 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266772 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266774 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266777 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266779 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266781 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266784 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266786 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266789 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266792 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266796 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266799 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266801 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266804 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266806 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266809 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266811 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266814 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266816 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266819 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:10:51.271840 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266821 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.266824 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266886 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266893 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266903 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266907 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266915 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266919 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266922 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266926 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266930 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266933 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266936 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266940 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266943 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266946 2567 flags.go:64] FLAG: --cgroup-root="" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266949 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266952 2567 flags.go:64] FLAG: --client-ca-file="" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266954 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266957 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266962 2567 flags.go:64] FLAG: --cluster-domain="" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266965 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266969 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266972 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 21:10:51.272334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266975 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266980 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266983 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266986 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266989 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266992 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266995 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.266998 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267001 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267004 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267008 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267012 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267014 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267017 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267020 2567 flags.go:64] FLAG: --enable-server="true" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267024 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267028 2567 flags.go:64] FLAG: --event-burst="100" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267031 2567 flags.go:64] FLAG: --event-qps="50" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267034 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267037 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267040 2567 flags.go:64] FLAG: --eviction-hard="" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267043 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267046 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267049 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267052 2567 flags.go:64] FLAG: --eviction-soft="" Jun 11 21:10:51.273126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267055 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267058 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267061 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267064 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267066 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267071 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267074 2567 flags.go:64] FLAG: --feature-gates="" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267078 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267081 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267084 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267087 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267090 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267093 2567 flags.go:64] FLAG: --help="false" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267098 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267102 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267105 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267108 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267111 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267115 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267118 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267121 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267124 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267126 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 21:10:51.274272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267130 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267133 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267136 2567 flags.go:64] FLAG: --kube-reserved="" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267139 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267142 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267145 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267147 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267150 2567 flags.go:64] FLAG: --lock-file="" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267153 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267156 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267159 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267164 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267167 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267170 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267174 2567 flags.go:64] FLAG: --logging-format="text" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267177 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267180 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267183 2567 flags.go:64] FLAG: --manifest-url="" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267186 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267191 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267194 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267198 2567 flags.go:64] FLAG: --max-pods="110" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267201 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267204 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267207 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 21:10:51.275232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267210 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267213 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267216 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267232 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267239 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267243 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267246 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267250 2567 flags.go:64] FLAG: --pod-cidr="" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267253 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267259 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267262 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267265 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267267 2567 flags.go:64] FLAG: --port="10250" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267270 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267273 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08e1ace16d467566e" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267276 2567 flags.go:64] FLAG: --qos-reserved="" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267279 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267282 2567 flags.go:64] FLAG: --register-node="true" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267285 2567 flags.go:64] FLAG: --register-with-taints="" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267288 2567 flags.go:64] FLAG: --registry-burst="10" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267291 2567 flags.go:64] FLAG: --registry-qps="5" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267295 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267298 2567 flags.go:64] FLAG: --reserved-memory="" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267302 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267305 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 21:10:51.276106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267308 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267311 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267313 2567 flags.go:64] FLAG: --runonce="false" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267316 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267319 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267323 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267326 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267335 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267339 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267342 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267345 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267348 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267351 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267354 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267356 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267360 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267363 2567 flags.go:64] FLAG: --system-cgroups="" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267366 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267371 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267374 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267377 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267382 2567 flags.go:64] FLAG: --tls-min-version="" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267385 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267388 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267391 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 21:10:51.276737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267394 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267397 2567 flags.go:64] FLAG: --v="2" Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267400 2567 flags.go:64] FLAG: --version="false" Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267406 2567 flags.go:64] FLAG: --vmodule="" Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267409 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267412 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267538 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267542 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267545 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267548 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267551 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267554 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267559 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267561 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267564 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267567 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267570 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267572 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267575 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267579 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267582 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:10:51.277371 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267585 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267588 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267591 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267594 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267597 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267600 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267603 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267606 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267608 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267611 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267614 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267617 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267620 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267622 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267626 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267629 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267631 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267634 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267636 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267639 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:10:51.277908 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267641 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267644 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267647 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267651 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267653 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267656 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267658 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267661 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267664 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267667 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267669 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267671 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267674 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267677 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267679 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267682 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267685 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267687 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267690 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:10:51.278418 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267693 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267695 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267698 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267700 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267703 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267705 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267708 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267712 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267715 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267717 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267720 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267722 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267725 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267727 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267730 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267732 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267737 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267739 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267742 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:10:51.278892 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267745 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267747 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267749 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267752 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267755 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267758 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267760 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267763 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267765 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267768 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267770 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267773 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267776 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267780 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267783 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267786 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267788 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267794 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267796 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267812 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:10:51.279355 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267819 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267822 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267825 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267827 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267830 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.267833 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.267838 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.275800 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.275815 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.276569 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.276577 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276635 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276640 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276644 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:10:51.279924 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276647 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276650 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276652 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276655 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276658 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276661 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276663 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276666 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276669 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276671 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276674 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276677 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276680 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276683 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276685 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276688 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276691 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276693 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276696 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276698 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:10:51.280284 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276701 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276707 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276711 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276714 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276717 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276720 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276723 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276726 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276729 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276731 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276734 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276737 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276740 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276743 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276745 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276748 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276751 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276754 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276757 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:10:51.280933 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276760 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276762 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276765 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276767 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276771 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276774 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276776 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276779 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276782 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276784 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276787 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276789 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276792 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276795 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276799 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276802 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276805 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276808 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276811 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:10:51.281409 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276815 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276818 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276821 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276824 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276827 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276829 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276832 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276835 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276838 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276841 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276843 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276846 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276848 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276851 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276854 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276857 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276859 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276862 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276865 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276868 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:10:51.281889 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276870 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276874 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276877 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276880 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276883 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276886 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276889 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276891 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276894 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276897 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276900 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276903 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276906 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276909 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276912 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276915 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276917 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:10:51.282380 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.276920 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.276925 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277030 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277035 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277038 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277041 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277044 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277047 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277050 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277052 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277055 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277058 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277061 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277064 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:10:51.282823 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277067 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277069 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277072 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277074 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277077 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277079 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277082 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277085 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277087 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277090 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277093 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277095 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277098 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277100 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277103 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277106 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277108 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277111 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277113 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277116 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:10:51.283195 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277119 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277122 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277124 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277127 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277129 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277132 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277134 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277137 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277139 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277142 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277144 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277147 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277150 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277153 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277156 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277158 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277161 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277164 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277166 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277169 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:10:51.283683 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277171 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277174 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277176 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277180 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277184 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277186 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277190 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277192 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277196 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277198 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277201 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277204 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277207 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277209 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277212 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277214 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277217 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277220 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277223 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:10:51.284181 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277226 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277230 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277232 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277235 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277238 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277240 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277243 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277246 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277248 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277251 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277253 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277256 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277259 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277262 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277264 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277267 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277271 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277274 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277276 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277279 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:10:51.284656 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277282 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277285 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277288 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277290 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277293 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277295 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277298 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:51.277300 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.277306 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.277406 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.279397 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.280843 2567 server.go:1019] "Starting client certificate rotation" Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.280936 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:10:51.285141 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.280969 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:10:51.285549 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.283828 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:10:51.287268 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.287228 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:10:51.297968 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.297950 2567 log.go:25] "Validated CRI v1 runtime API" Jun 11 21:10:51.300728 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.300715 2567 log.go:25] "Validated CRI v1 image API" Jun 11 21:10:51.302232 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.302211 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 21:10:51.304726 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.304709 2567 fs.go:135] Filesystem UUIDs: map[67adeba3-003e-4106-87f0-7edde0e4294c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f872a87b-51ce-4cd9-bbff-f56df5788c63:/dev/nvme0n1p4] Jun 11 21:10:51.304783 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.304727 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 21:10:51.310388 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.310268 2567 manager.go:216] Machine: {Timestamp:2026-06-11 21:10:51.308883264 +0000 UTC m=+0.329484346 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101776 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2998811f272eac73188157091977cc SystemUUID:ec299881-1f27-2eac-7318-8157091977cc BootID:60198df5-974c-4957-949e-7a2934e8c2bb Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1d:9b:e5:07:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1d:9b:e5:07:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:d9:84:b6:70:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 21:10:51.310388 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.310388 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 21:10:51.310511 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.310479 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 21:10:51.311270 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.311254 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:10:51.314552 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.314530 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 21:10:51.314692 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.314556 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-86.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 21:10:51.315247 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.315238 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 21:10:51.315283 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.315250 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 21:10:51.315283 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.315257 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:10:51.315976 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.315966 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:10:51.317202 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.317192 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 21:10:51.320087 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.320075 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:10:51.320202 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.320192 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 21:10:51.320237 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.320223 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 11 21:10:51.320270 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.320237 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 21:10:51.320270 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.320255 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 21:10:51.320322 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.320270 2567 kubelet.go:398] "Adding apiserver pod source" Jun 11 21:10:51.320322 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.320284 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 21:10:51.322076 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.322055 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:10:51.322161 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.322089 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:10:51.324629 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.324613 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 21:10:51.325959 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.325946 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 21:10:51.326004 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.325977 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 21:10:51.326144 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326135 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 21:10:51.326174 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326150 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 21:10:51.326174 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326157 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 21:10:51.326174 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326162 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 21:10:51.326174 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326171 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 21:10:51.326174 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326176 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 21:10:51.326638 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326629 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 21:10:51.326638 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326638 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 21:10:51.326691 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326645 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 21:10:51.326691 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326651 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 21:10:51.326691 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326659 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 21:10:51.326691 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.326666 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 21:10:51.328035 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.328026 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 21:10:51.328066 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.328035 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 21:10:51.331225 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.331213 2567 server.go:1268] "Started kubelet" Jun 11 21:10:51.331367 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.331325 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 21:10:51.331367 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.331334 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 21:10:51.331528 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.331405 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 21:10:51.332058 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.332043 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-86.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 21:10:51.332138 ip-10-0-135-86 systemd[1]: Started Kubernetes Kubelet. Jun 11 21:10:51.332690 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.332631 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 21:10:51.332690 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.332632 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 21:10:51.333072 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.333047 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 21:10:51.333761 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.333740 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 11 21:10:51.337624 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.336596 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-86.ec2.internal.18b8231af62b3f40 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-86.ec2.internal,UID:ip-10-0-135-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-86.ec2.internal,},FirstTimestamp:2026-06-11 21:10:51.3311824 +0000 UTC m=+0.351783479,LastTimestamp:2026-06-11 21:10:51.3311824 +0000 UTC m=+0.351783479,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-86.ec2.internal,}" Jun 11 21:10:51.337874 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.337855 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 21:10:51.337979 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.337900 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 21:10:51.338031 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.337985 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:51.338398 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.338384 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 21:10:51.338520 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.338510 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 21:10:51.338615 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.338520 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 21:10:51.338615 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.338385 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 21:10:51.338716 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.338689 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 11 21:10:51.338716 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.338699 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 11 21:10:51.338987 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.338961 2567 factory.go:55] Registering systemd factory Jun 11 21:10:51.338987 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.338980 2567 factory.go:223] Registration of the systemd container factory successfully Jun 11 21:10:51.339161 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.339149 2567 factory.go:153] Registering CRI-O factory Jun 11 21:10:51.339218 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.339165 2567 factory.go:223] Registration of the crio container factory successfully Jun 11 21:10:51.339218 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.339214 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 21:10:51.339314 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.339245 2567 factory.go:103] Registering Raw factory Jun 11 21:10:51.339314 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.339262 2567 manager.go:1196] Started watching for new ooms in manager Jun 11 21:10:51.339621 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.339608 2567 manager.go:349] Starting recovery of all containers Jun 11 21:10:51.339926 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.339903 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 21:10:51.340079 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.340062 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 21:10:51.342298 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.342271 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wm8xw" Jun 11 21:10:51.350582 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.350320 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wm8xw" Jun 11 21:10:51.351151 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.351136 2567 manager.go:354] Recovery completed Jun 11 21:10:51.355296 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.355284 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:10:51.357771 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.357756 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:10:51.357837 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.357783 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:10:51.357837 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.357795 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:10:51.358376 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.358360 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 21:10:51.358376 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.358375 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 21:10:51.358481 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.358361 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:10:51.358481 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.358394 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:10:51.359040 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.359024 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:10:51.359104 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.359052 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:10:51.359104 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.359066 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:10:51.359358 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.359347 2567 policy_none.go:49] "None policy: Start" Jun 11 21:10:51.359389 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.359363 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 21:10:51.359389 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.359373 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 21:10:51.360378 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.360367 2567 policy_none.go:47] "Start" Jun 11 21:10:51.396058 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.396041 2567 manager.go:337] "Starting Device Plugin manager" Jun 11 21:10:51.396159 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.396074 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 21:10:51.396159 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.396084 2567 server.go:87] "Starting device plugin registration server" Jun 11 21:10:51.396354 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.396338 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 21:10:51.396611 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.396355 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 21:10:51.396611 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.396524 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 21:10:51.397104 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.396629 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 21:10:51.397104 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.396640 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 21:10:51.397191 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.397167 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 21:10:51.397225 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.397213 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:51.409313 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.409285 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 21:10:51.410441 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.410402 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 21:10:51.410527 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.410467 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 21:10:51.410527 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.410509 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 21:10:51.410602 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.410549 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 21:10:51.412326 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.412307 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:10:51.497354 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.497310 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:10:51.498301 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.498285 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:10:51.498411 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.498320 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:10:51.498411 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.498333 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:10:51.498411 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.498364 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.503915 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.503901 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.503967 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.503923 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-86.ec2.internal\": node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:51.510634 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.510582 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal"] Jun 11 21:10:51.510709 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.510647 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:10:51.511923 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.511904 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:10:51.511993 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.511935 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:10:51.511993 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.511948 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:10:51.513116 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.513104 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:10:51.513241 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.513228 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.513272 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.513258 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:10:51.513786 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.513771 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:10:51.513860 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.513783 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:10:51.513860 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.513797 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:10:51.513860 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.513808 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:10:51.513860 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.513821 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:10:51.513981 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.513808 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:10:51.514853 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.514838 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.514924 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.514861 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:10:51.515482 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.515466 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:10:51.515556 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.515494 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:10:51.515556 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.515504 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:10:51.516263 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.516245 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:51.529949 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.529925 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-86.ec2.internal\" not found" node="ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.533746 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.533728 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-86.ec2.internal\" not found" node="ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.616569 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.616546 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:51.639943 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.639922 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc112d94058de04bee31dbcd375853a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal\" (UID: \"bc112d94058de04bee31dbcd375853a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.640005 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.639948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc112d94058de04bee31dbcd375853a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal\" (UID: \"bc112d94058de04bee31dbcd375853a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.640005 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.639967 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/363076e54f25c3bd7b4f7bc4d102f35d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-86.ec2.internal\" (UID: \"363076e54f25c3bd7b4f7bc4d102f35d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.717094 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.717043 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:51.740358 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.740336 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc112d94058de04bee31dbcd375853a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal\" (UID: \"bc112d94058de04bee31dbcd375853a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.740416 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.740365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc112d94058de04bee31dbcd375853a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal\" (UID: \"bc112d94058de04bee31dbcd375853a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.740416 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.740380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/363076e54f25c3bd7b4f7bc4d102f35d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-86.ec2.internal\" (UID: \"363076e54f25c3bd7b4f7bc4d102f35d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.740494 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.740416 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/363076e54f25c3bd7b4f7bc4d102f35d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-86.ec2.internal\" (UID: \"363076e54f25c3bd7b4f7bc4d102f35d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.740523 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.740484 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc112d94058de04bee31dbcd375853a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal\" (UID: \"bc112d94058de04bee31dbcd375853a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.740523 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.740488 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc112d94058de04bee31dbcd375853a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal\" (UID: \"bc112d94058de04bee31dbcd375853a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.817719 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.817654 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:51.831962 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.831940 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.837040 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:51.837022 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal" Jun 11 21:10:51.917778 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:51.917726 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:52.018239 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:52.018188 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:52.118831 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:52.118749 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:52.219287 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:52.219254 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:52.280795 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.280765 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 21:10:52.281297 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.280912 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:10:52.320076 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:52.320050 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:52.354371 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.354310 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 21:05:51 +0000 UTC" deadline="2028-03-11 01:32:37.666459312 +0000 UTC" Jun 11 21:10:52.354371 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.354366 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15316h21m45.31209801s" Jun 11 21:10:52.356412 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.356393 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:10:52.420755 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:52.420685 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:52.459481 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:52.459416 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc112d94058de04bee31dbcd375853a0.slice/crio-b6f01c47fd2d5fa1a3754cfe482cdd8e0d222a5b5a342b7764a09447a688370d WatchSource:0}: Error finding container b6f01c47fd2d5fa1a3754cfe482cdd8e0d222a5b5a342b7764a09447a688370d: Status 404 returned error can't find the container with id b6f01c47fd2d5fa1a3754cfe482cdd8e0d222a5b5a342b7764a09447a688370d Jun 11 21:10:52.459788 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:52.459768 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363076e54f25c3bd7b4f7bc4d102f35d.slice/crio-85ed98b3d98ad31e4ed8105cc2c304d4973e4a3a17d2c2fa3f4817aeb05a586c WatchSource:0}: Error finding container 85ed98b3d98ad31e4ed8105cc2c304d4973e4a3a17d2c2fa3f4817aeb05a586c: Status 404 returned error can't find the container with id 85ed98b3d98ad31e4ed8105cc2c304d4973e4a3a17d2c2fa3f4817aeb05a586c Jun 11 21:10:52.464349 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.464330 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:10:52.518477 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.518442 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:10:52.521051 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:52.521030 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:52.621564 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:52.621511 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-86.ec2.internal\" not found" Jun 11 21:10:52.690112 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.690041 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:10:52.738975 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.738944 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" Jun 11 21:10:52.748722 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.748704 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:10:52.749702 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.749690 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal" Jun 11 21:10:52.757209 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:52.757196 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:10:53.322262 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.321971 2567 apiserver.go:52] "Watching apiserver" Jun 11 21:10:53.329239 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.329211 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 21:10:53.329728 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.329702 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-mws9g","openshift-network-operator/iptables-alerter-5g4lf","kube-system/global-pull-secret-syncer-4qt2x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4","openshift-cluster-node-tuning-operator/tuned-w6726","openshift-image-registry/node-ca-hx7mp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal","openshift-multus/multus-additional-cni-plugins-spg87","openshift-multus/network-metrics-daemon-zcvn9","openshift-ovn-kubernetes/ovnkube-node-kw9d9","kube-system/konnectivity-agent-7fwxv","kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal","openshift-dns/node-resolver-j255d","openshift-multus/multus-v86bl"] Jun 11 21:10:53.331660 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.331640 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.333592 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.333574 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.334706 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.334682 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 21:10:53.335241 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.335222 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 21:10:53.335511 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.335496 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 21:10:53.335577 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.335512 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6htvx\"" Jun 11 21:10:53.335867 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.335850 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 21:10:53.335943 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.335898 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 21:10:53.336100 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.336083 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lsxc6\"" Jun 11 21:10:53.336251 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.336233 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 21:10:53.336314 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.336260 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 21:10:53.336873 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.336684 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:53.336873 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.336773 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:10:53.337128 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.337091 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 21:10:53.337959 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.337916 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.338736 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.338687 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 21:10:53.339668 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.339293 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.340843 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.340659 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.342507 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.341913 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 21:10:53.342507 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.342056 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:10:53.342507 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.342090 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rdn6z\"" Jun 11 21:10:53.342507 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.342142 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f766s\"" Jun 11 21:10:53.342507 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.342150 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 21:10:53.342507 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.342056 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 21:10:53.343481 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.342885 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 21:10:53.343736 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.343714 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xghsj\"" Jun 11 21:10:53.344862 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.344003 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 21:10:53.344862 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.344320 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:53.344862 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.344389 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:10:53.345079 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.345057 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 21:10:53.345158 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.345090 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 21:10:53.346073 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.346054 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.347746 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347722 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-host\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.347820 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-tuned\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.347820 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347785 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.347820 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347809 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/affa242d-8f4e-4084-a666-61e4890730cb-env-overrides\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.347947 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.347947 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-sys-fs\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.347947 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347876 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-node-log\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.347947 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-lib-modules\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.347947 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpdw8\" (UniqueName: \"kubernetes.io/projected/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-kube-api-access-kpdw8\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.347947 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347945 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-run-ovn\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.348224 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.347977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f8fd8dd-f772-4263-9715-6b654738adaf-dbus\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:53.348224 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5q9g\" (UniqueName: \"kubernetes.io/projected/b0b95329-d40c-4a5c-8681-cd21b618ae1b-kube-api-access-f5q9g\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.348224 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348025 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-sysctl-conf\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.348224 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-run\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.348224 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-systemd-units\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.348224 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348090 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-slash\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.348224 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348111 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 21:10:53.348588 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348113 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-run-netns\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.348588 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-run-openvswitch\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.348588 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348580 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/affa242d-8f4e-4084-a666-61e4890730cb-ovnkube-config\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.348735 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rx5s\" (UniqueName: \"kubernetes.io/projected/7c147e51-b93b-410b-a81a-f5d7c57087e9-kube-api-access-5rx5s\") pod \"node-resolver-j255d\" (UID: \"7c147e51-b93b-410b-a81a-f5d7c57087e9\") " pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.348735 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348626 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 21:10:53.348735 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-sysconfig\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.348735 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-sysctl-d\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.348735 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348681 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-systemd\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.348735 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348630 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.348735 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-var-lib-openvswitch\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-etc-openvswitch\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-cni-netd\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c147e51-b93b-410b-a81a-f5d7c57087e9-tmp-dir\") pod \"node-resolver-j255d\" (UID: \"7c147e51-b93b-410b-a81a-f5d7c57087e9\") " pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348817 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-device-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348826 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348840 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c147e51-b93b-410b-a81a-f5d7c57087e9-hosts-file\") pod \"node-resolver-j255d\" (UID: \"7c147e51-b93b-410b-a81a-f5d7c57087e9\") " pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348919 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-socket-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-var-lib-kubelet\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.348997 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-sys\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349005 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wjxvz\"" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349019 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/affa242d-8f4e-4084-a666-61e4890730cb-ovn-node-metrics-cert\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.349055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npp2z\" (UniqueName: \"kubernetes.io/projected/affa242d-8f4e-4084-a666-61e4890730cb-kube-api-access-npp2z\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349128 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f8fd8dd-f772-4263-9715-6b654738adaf-kubelet-config\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349156 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-kubernetes\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349180 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-tmp\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-kubelet\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-cni-bin\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/affa242d-8f4e-4084-a666-61e4890730cb-ovnkube-script-lib\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349333 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-registration-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349381 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-modprobe-d\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349422 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-run-systemd\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.349729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-log-socket\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.350207 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.349998 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:10:53.350207 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.350060 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:10:53.350207 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.350092 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:10:53.350718 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.350698 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:10:53.351156 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.351139 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 21:10:53.351238 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.351217 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 21:10:53.351388 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.351373 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fpgfr\"" Jun 11 21:10:53.351699 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.351685 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:10:53.353403 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.353387 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.354778 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.354385 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 21:10:53.354778 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.354549 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jhvxt\"" Jun 11 21:10:53.354778 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.354637 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 21:10:53.355718 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.355594 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ct8dh\"" Jun 11 21:10:53.355718 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.355624 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 21:10:53.356266 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.356007 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 21:10:53.379276 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.379189 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6dgj2" Jun 11 21:10:53.387864 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.387841 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6dgj2" Jun 11 21:10:53.416214 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.416145 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal" event={"ID":"363076e54f25c3bd7b4f7bc4d102f35d","Type":"ContainerStarted","Data":"85ed98b3d98ad31e4ed8105cc2c304d4973e4a3a17d2c2fa3f4817aeb05a586c"} Jun 11 21:10:53.417490 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.417465 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" event={"ID":"bc112d94058de04bee31dbcd375853a0","Type":"ContainerStarted","Data":"b6f01c47fd2d5fa1a3754cfe482cdd8e0d222a5b5a342b7764a09447a688370d"} Jun 11 21:10:53.440348 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.440323 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 21:10:53.450019 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.449995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-var-lib-kubelet\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.450170 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450031 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-kubernetes\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.450170 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-tmp\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.450170 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450071 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-kubelet\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.450170 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450123 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-kubelet\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.450170 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450154 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-registration-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.450170 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-kubernetes\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450189 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f126d62-50e6-415c-bc14-d8f51a6c0adb-konnectivity-ca\") pod \"konnectivity-agent-7fwxv\" (UID: \"8f126d62-50e6-415c-bc14-d8f51a6c0adb\") " pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450221 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-registration-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-log-socket\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450273 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-tuned\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450274 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-log-socket\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/affa242d-8f4e-4084-a666-61e4890730cb-env-overrides\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-run-netns\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450382 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450488 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.450497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450490 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-cnibin\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-lib-modules\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f8fd8dd-f772-4263-9715-6b654738adaf-dbus\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-socket-dir-parent\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450634 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-run-k8s-cni-cncf-io\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450658 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f8fd8dd-f772-4263-9715-6b654738adaf-dbus\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kxvj\" (UniqueName: \"kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj\") pod \"network-check-target-mws9g\" (UID: \"75d2a821-eb0b-46dd-9275-a7165590e033\") " pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450715 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ddd45043-2295-4655-acd6-21b2a603d6f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450743 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-sysctl-conf\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450769 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-run-openvswitch\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-device-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450776 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-lib-modules\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450822 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-run-openvswitch\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-system-cni-dir\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-sysctl-d\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-device-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450889 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-cni-netd\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.451080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c147e51-b93b-410b-a81a-f5d7c57087e9-tmp-dir\") pod \"node-resolver-j255d\" (UID: \"7c147e51-b93b-410b-a81a-f5d7c57087e9\") " pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450921 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-sysctl-conf\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450943 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/518203f3-50cb-4827-b9bf-be3e6dc2541b-cni-binary-copy\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450941 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/affa242d-8f4e-4084-a666-61e4890730cb-env-overrides\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450953 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-cni-netd\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.450989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-var-lib-cni-bin\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451022 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-hostroot\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451024 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-sysctl-d\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-os-release\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451075 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-socket-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451138 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-conf-dir\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-var-lib-kubelet\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451182 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451196 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f8fd8dd-f772-4263-9715-6b654738adaf-kubelet-config\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qnzv\" (UniqueName: \"kubernetes.io/projected/97aa08b2-cf05-45fc-8126-2fa3fff3366a-kube-api-access-9qnzv\") pod \"iptables-alerter-5g4lf\" (UID: \"97aa08b2-cf05-45fc-8126-2fa3fff3366a\") " pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451225 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-socket-dir\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.451921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451223 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c147e51-b93b-410b-a81a-f5d7c57087e9-tmp-dir\") pod \"node-resolver-j255d\" (UID: \"7c147e51-b93b-410b-a81a-f5d7c57087e9\") " pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451248 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-var-lib-kubelet\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451262 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-cni-bin\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451284 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/affa242d-8f4e-4084-a666-61e4890730cb-ovnkube-script-lib\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451300 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-cni-bin\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451300 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f8fd8dd-f772-4263-9715-6b654738adaf-kubelet-config\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.451392 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.451475 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret podName:8f8fd8dd-f772-4263-9715-6b654738adaf nodeName:}" failed. No retries permitted until 2026-06-11 21:10:53.951453815 +0000 UTC m=+2.972054881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret") pod "global-pull-secret-syncer-4qt2x" (UID: "8f8fd8dd-f772-4263-9715-6b654738adaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-os-release\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451519 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-modprobe-d\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-run-systemd\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-run-systemd\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451617 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-host\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451646 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-modprobe-d\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451663 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.452729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-sys-fs\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451716 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f126d62-50e6-415c-bc14-d8f51a6c0adb-agent-certs\") pod \"konnectivity-agent-7fwxv\" (UID: \"8f126d62-50e6-415c-bc14-d8f51a6c0adb\") " pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-host\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-cni-dir\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451756 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-sys-fs\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97aa08b2-cf05-45fc-8126-2fa3fff3366a-iptables-alerter-script\") pod \"iptables-alerter-5g4lf\" (UID: \"97aa08b2-cf05-45fc-8126-2fa3fff3366a\") " pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451761 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0b95329-d40c-4a5c-8681-cd21b618ae1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97aa08b2-cf05-45fc-8126-2fa3fff3366a-host-slash\") pod \"iptables-alerter-5g4lf\" (UID: \"97aa08b2-cf05-45fc-8126-2fa3fff3366a\") " pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451816 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-node-log\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451840 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpdw8\" (UniqueName: \"kubernetes.io/projected/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-kube-api-access-kpdw8\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/affa242d-8f4e-4084-a666-61e4890730cb-ovnkube-script-lib\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-run-ovn\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451900 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-run-ovn\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451909 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5q9g\" (UniqueName: \"kubernetes.io/projected/b0b95329-d40c-4a5c-8681-cd21b618ae1b-kube-api-access-f5q9g\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451927 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-node-log\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451934 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgv86\" (UniqueName: \"kubernetes.io/projected/7c16c48d-30ea-4a15-9a07-2e6659bb2474-kube-api-access-zgv86\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/344ad448-ef00-4d68-ace8-a0375e86d7bb-host\") pod \"node-ca-hx7mp\" (UID: \"344ad448-ef00-4d68-ace8-a0375e86d7bb\") " pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.453555 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.451997 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz4h6\" (UniqueName: \"kubernetes.io/projected/344ad448-ef00-4d68-ace8-a0375e86d7bb-kube-api-access-lz4h6\") pod \"node-ca-hx7mp\" (UID: \"344ad448-ef00-4d68-ace8-a0375e86d7bb\") " pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452026 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-etc-kubernetes\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-run\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-systemd-units\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-slash\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452110 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-run\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452132 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-systemd-units\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-run-netns\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/affa242d-8f4e-4084-a666-61e4890730cb-ovnkube-config\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452184 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-run-netns\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452147 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-slash\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452197 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rx5s\" (UniqueName: \"kubernetes.io/projected/7c147e51-b93b-410b-a81a-f5d7c57087e9-kube-api-access-5rx5s\") pod \"node-resolver-j255d\" (UID: \"7c147e51-b93b-410b-a81a-f5d7c57087e9\") " pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452236 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-daemon-config\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4ktx\" (UniqueName: \"kubernetes.io/projected/518203f3-50cb-4827-b9bf-be3e6dc2541b-kube-api-access-d4ktx\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-sysconfig\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-systemd\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452335 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-var-lib-openvswitch\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452351 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-etc-openvswitch\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.454328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452365 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-sysconfig\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452372 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/344ad448-ef00-4d68-ace8-a0375e86d7bb-serviceca\") pod \"node-ca-hx7mp\" (UID: \"344ad448-ef00-4d68-ace8-a0375e86d7bb\") " pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-cnibin\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452406 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-var-lib-openvswitch\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452465 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-etc-openvswitch\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-run-multus-certs\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ddd45043-2295-4655-acd6-21b2a603d6f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452514 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-systemd\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452528 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c147e51-b93b-410b-a81a-f5d7c57087e9-hosts-file\") pod \"node-resolver-j255d\" (UID: \"7c147e51-b93b-410b-a81a-f5d7c57087e9\") " pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/affa242d-8f4e-4084-a666-61e4890730cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452591 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-system-cni-dir\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ddd45043-2295-4655-acd6-21b2a603d6f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452625 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c147e51-b93b-410b-a81a-f5d7c57087e9-hosts-file\") pod \"node-resolver-j255d\" (UID: \"7c147e51-b93b-410b-a81a-f5d7c57087e9\") " pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452672 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/affa242d-8f4e-4084-a666-61e4890730cb-ovnkube-config\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn4wr\" (UniqueName: \"kubernetes.io/projected/ddd45043-2295-4655-acd6-21b2a603d6f5-kube-api-access-sn4wr\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.455197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452741 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-sys\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.456037 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/affa242d-8f4e-4084-a666-61e4890730cb-ovn-node-metrics-cert\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.456037 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npp2z\" (UniqueName: \"kubernetes.io/projected/affa242d-8f4e-4084-a666-61e4890730cb-kube-api-access-npp2z\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.456037 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-sys\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.456037 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.452815 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-var-lib-cni-multus\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.456037 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.453953 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-etc-tuned\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.456037 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.454017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-tmp\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.456037 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.455220 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/affa242d-8f4e-4084-a666-61e4890730cb-ovn-node-metrics-cert\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.462939 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.462909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5q9g\" (UniqueName: \"kubernetes.io/projected/b0b95329-d40c-4a5c-8681-cd21b618ae1b-kube-api-access-f5q9g\") pod \"aws-ebs-csi-driver-node-d9vx4\" (UID: \"b0b95329-d40c-4a5c-8681-cd21b618ae1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.463250 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.463232 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rx5s\" (UniqueName: \"kubernetes.io/projected/7c147e51-b93b-410b-a81a-f5d7c57087e9-kube-api-access-5rx5s\") pod \"node-resolver-j255d\" (UID: \"7c147e51-b93b-410b-a81a-f5d7c57087e9\") " pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.463341 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.463294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npp2z\" (UniqueName: \"kubernetes.io/projected/affa242d-8f4e-4084-a666-61e4890730cb-kube-api-access-npp2z\") pod \"ovnkube-node-kw9d9\" (UID: \"affa242d-8f4e-4084-a666-61e4890730cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.464325 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.464310 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpdw8\" (UniqueName: \"kubernetes.io/projected/aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6-kube-api-access-kpdw8\") pod \"tuned-w6726\" (UID: \"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6\") " pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.554033 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.553998 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-system-cni-dir\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554033 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/518203f3-50cb-4827-b9bf-be3e6dc2541b-cni-binary-copy\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554061 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-var-lib-cni-bin\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-hostroot\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554107 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-os-release\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554110 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-system-cni-dir\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-conf-dir\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qnzv\" (UniqueName: \"kubernetes.io/projected/97aa08b2-cf05-45fc-8126-2fa3fff3366a-kube-api-access-9qnzv\") pod \"iptables-alerter-5g4lf\" (UID: \"97aa08b2-cf05-45fc-8126-2fa3fff3366a\") " pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554184 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-var-lib-cni-bin\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-os-release\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554194 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-hostroot\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554189 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-os-release\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554217 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-conf-dir\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:53.554282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554286 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f126d62-50e6-415c-bc14-d8f51a6c0adb-agent-certs\") pod \"konnectivity-agent-7fwxv\" (UID: \"8f126d62-50e6-415c-bc14-d8f51a6c0adb\") " pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-cni-dir\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554333 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97aa08b2-cf05-45fc-8126-2fa3fff3366a-iptables-alerter-script\") pod \"iptables-alerter-5g4lf\" (UID: \"97aa08b2-cf05-45fc-8126-2fa3fff3366a\") " pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.554359 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554393 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-os-release\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.554444 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs podName:7c16c48d-30ea-4a15-9a07-2e6659bb2474 nodeName:}" failed. No retries permitted until 2026-06-11 21:10:54.05440667 +0000 UTC m=+3.075007753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs") pod "network-metrics-daemon-zcvn9" (UID: "7c16c48d-30ea-4a15-9a07-2e6659bb2474") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97aa08b2-cf05-45fc-8126-2fa3fff3366a-host-slash\") pod \"iptables-alerter-5g4lf\" (UID: \"97aa08b2-cf05-45fc-8126-2fa3fff3366a\") " pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554482 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgv86\" (UniqueName: \"kubernetes.io/projected/7c16c48d-30ea-4a15-9a07-2e6659bb2474-kube-api-access-zgv86\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554397 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97aa08b2-cf05-45fc-8126-2fa3fff3366a-host-slash\") pod \"iptables-alerter-5g4lf\" (UID: \"97aa08b2-cf05-45fc-8126-2fa3fff3366a\") " pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554510 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/344ad448-ef00-4d68-ace8-a0375e86d7bb-host\") pod \"node-ca-hx7mp\" (UID: \"344ad448-ef00-4d68-ace8-a0375e86d7bb\") " pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554538 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz4h6\" (UniqueName: \"kubernetes.io/projected/344ad448-ef00-4d68-ace8-a0375e86d7bb-kube-api-access-lz4h6\") pod \"node-ca-hx7mp\" (UID: \"344ad448-ef00-4d68-ace8-a0375e86d7bb\") " pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554562 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-etc-kubernetes\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/344ad448-ef00-4d68-ace8-a0375e86d7bb-host\") pod \"node-ca-hx7mp\" (UID: \"344ad448-ef00-4d68-ace8-a0375e86d7bb\") " pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-daemon-config\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554634 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-cni-dir\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ktx\" (UniqueName: \"kubernetes.io/projected/518203f3-50cb-4827-b9bf-be3e6dc2541b-kube-api-access-d4ktx\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/344ad448-ef00-4d68-ace8-a0375e86d7bb-serviceca\") pod \"node-ca-hx7mp\" (UID: \"344ad448-ef00-4d68-ace8-a0375e86d7bb\") " pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-cnibin\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.554912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-run-multus-certs\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ddd45043-2295-4655-acd6-21b2a603d6f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-system-cni-dir\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554792 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/518203f3-50cb-4827-b9bf-be3e6dc2541b-cni-binary-copy\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ddd45043-2295-4655-acd6-21b2a603d6f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn4wr\" (UniqueName: \"kubernetes.io/projected/ddd45043-2295-4655-acd6-21b2a603d6f5-kube-api-access-sn4wr\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-var-lib-cni-multus\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554908 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-var-lib-kubelet\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f126d62-50e6-415c-bc14-d8f51a6c0adb-konnectivity-ca\") pod \"konnectivity-agent-7fwxv\" (UID: \"8f126d62-50e6-415c-bc14-d8f51a6c0adb\") " pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-cnibin\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554964 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-run-netns\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554990 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-cnibin\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.554999 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-run-multus-certs\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555016 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-socket-dir-parent\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555041 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-run-k8s-cni-cncf-io\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555068 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kxvj\" (UniqueName: \"kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj\") pod \"network-check-target-mws9g\" (UID: \"75d2a821-eb0b-46dd-9275-a7165590e033\") " pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:10:53.555747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555076 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-system-cni-dir\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555094 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ddd45043-2295-4655-acd6-21b2a603d6f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ddd45043-2295-4655-acd6-21b2a603d6f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555575 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ddd45043-2295-4655-acd6-21b2a603d6f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555585 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ddd45043-2295-4655-acd6-21b2a603d6f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555646 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-var-lib-kubelet\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555658 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555725 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-socket-dir-parent\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555767 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-run-netns\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555806 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ddd45043-2295-4655-acd6-21b2a603d6f5-cnibin\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555042 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-var-lib-cni-multus\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555871 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-host-run-k8s-cni-cncf-io\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.555921 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/518203f3-50cb-4827-b9bf-be3e6dc2541b-etc-kubernetes\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.556115 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f126d62-50e6-415c-bc14-d8f51a6c0adb-konnectivity-ca\") pod \"konnectivity-agent-7fwxv\" (UID: \"8f126d62-50e6-415c-bc14-d8f51a6c0adb\") " pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.556116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97aa08b2-cf05-45fc-8126-2fa3fff3366a-iptables-alerter-script\") pod \"iptables-alerter-5g4lf\" (UID: \"97aa08b2-cf05-45fc-8126-2fa3fff3366a\") " pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.556309 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/344ad448-ef00-4d68-ace8-a0375e86d7bb-serviceca\") pod \"node-ca-hx7mp\" (UID: \"344ad448-ef00-4d68-ace8-a0375e86d7bb\") " pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.556550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.556363 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/518203f3-50cb-4827-b9bf-be3e6dc2541b-multus-daemon-config\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.557162 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.557146 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f126d62-50e6-415c-bc14-d8f51a6c0adb-agent-certs\") pod \"konnectivity-agent-7fwxv\" (UID: \"8f126d62-50e6-415c-bc14-d8f51a6c0adb\") " pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:10:53.563810 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.563785 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:10:53.563938 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.563815 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:10:53.563938 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.563830 2567 projected.go:196] Error preparing data for projected volume kube-api-access-8kxvj for pod openshift-network-diagnostics/network-check-target-mws9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:10:53.563938 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.563893 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj podName:75d2a821-eb0b-46dd-9275-a7165590e033 nodeName:}" failed. No retries permitted until 2026-06-11 21:10:54.063876251 +0000 UTC m=+3.084477331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8kxvj" (UniqueName: "kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj") pod "network-check-target-mws9g" (UID: "75d2a821-eb0b-46dd-9275-a7165590e033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:10:53.565008 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.564989 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qnzv\" (UniqueName: \"kubernetes.io/projected/97aa08b2-cf05-45fc-8126-2fa3fff3366a-kube-api-access-9qnzv\") pod \"iptables-alerter-5g4lf\" (UID: \"97aa08b2-cf05-45fc-8126-2fa3fff3366a\") " pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.565352 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.565319 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz4h6\" (UniqueName: \"kubernetes.io/projected/344ad448-ef00-4d68-ace8-a0375e86d7bb-kube-api-access-lz4h6\") pod \"node-ca-hx7mp\" (UID: \"344ad448-ef00-4d68-ace8-a0375e86d7bb\") " pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.565630 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.565610 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgv86\" (UniqueName: \"kubernetes.io/projected/7c16c48d-30ea-4a15-9a07-2e6659bb2474-kube-api-access-zgv86\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:53.566563 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.566306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4ktx\" (UniqueName: \"kubernetes.io/projected/518203f3-50cb-4827-b9bf-be3e6dc2541b-kube-api-access-d4ktx\") pod \"multus-v86bl\" (UID: \"518203f3-50cb-4827-b9bf-be3e6dc2541b\") " pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.568927 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.568907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn4wr\" (UniqueName: \"kubernetes.io/projected/ddd45043-2295-4655-acd6-21b2a603d6f5-kube-api-access-sn4wr\") pod \"multus-additional-cni-plugins-spg87\" (UID: \"ddd45043-2295-4655-acd6-21b2a603d6f5\") " pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.649688 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.649604 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:10:53.657252 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.657231 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j255d" Jun 11 21:10:53.665778 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.665759 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" Jun 11 21:10:53.673300 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.673284 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w6726" Jun 11 21:10:53.681892 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.681869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hx7mp" Jun 11 21:10:53.688540 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.688508 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v86bl" Jun 11 21:10:53.697163 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.697145 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5g4lf" Jun 11 21:10:53.705715 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.705694 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:10:53.711332 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.711314 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:10:53.711518 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.711496 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-spg87" Jun 11 21:10:53.958442 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:53.958342 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:53.958588 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.958509 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:10:53.958588 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:53.958584 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret podName:8f8fd8dd-f772-4263-9715-6b654738adaf nodeName:}" failed. No retries permitted until 2026-06-11 21:10:54.958565108 +0000 UTC m=+3.979166177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret") pod "global-pull-secret-syncer-4qt2x" (UID: "8f8fd8dd-f772-4263-9715-6b654738adaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:10:54.059485 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:54.059440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:54.059665 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:54.059586 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:10:54.059665 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:54.059656 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs podName:7c16c48d-30ea-4a15-9a07-2e6659bb2474 nodeName:}" failed. No retries permitted until 2026-06-11 21:10:55.059636259 +0000 UTC m=+4.080237336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs") pod "network-metrics-daemon-zcvn9" (UID: "7c16c48d-30ea-4a15-9a07-2e6659bb2474") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:10:54.160252 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:54.160219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kxvj\" (UniqueName: \"kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj\") pod \"network-check-target-mws9g\" (UID: \"75d2a821-eb0b-46dd-9275-a7165590e033\") " pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:10:54.160409 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:54.160391 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:10:54.160467 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:54.160415 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:10:54.160467 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:54.160444 2567 projected.go:196] Error preparing data for projected volume kube-api-access-8kxvj for pod openshift-network-diagnostics/network-check-target-mws9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:10:54.160557 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:54.160499 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj podName:75d2a821-eb0b-46dd-9275-a7165590e033 nodeName:}" failed. No retries permitted until 2026-06-11 21:10:55.160483146 +0000 UTC m=+4.181084228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kxvj" (UniqueName: "kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj") pod "network-check-target-mws9g" (UID: "75d2a821-eb0b-46dd-9275-a7165590e033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:10:54.391011 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:54.390876 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:05:53 +0000 UTC" deadline="2027-12-09 15:05:36.479656269 +0000 UTC" Jun 11 21:10:54.391011 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:54.390966 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13097h54m42.088692896s" Jun 11 21:10:54.441735 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:54.441703 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518203f3_50cb_4827_b9bf_be3e6dc2541b.slice/crio-6da25c45c10c9ae90fcdbd74e7d593add81aef6895b81893b9fdb0babc80d5ef WatchSource:0}: Error finding container 6da25c45c10c9ae90fcdbd74e7d593add81aef6895b81893b9fdb0babc80d5ef: Status 404 returned error can't find the container with id 6da25c45c10c9ae90fcdbd74e7d593add81aef6895b81893b9fdb0babc80d5ef Jun 11 21:10:54.443585 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:54.443417 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344ad448_ef00_4d68_ace8_a0375e86d7bb.slice/crio-75910f8ebe86c095e877f767b5ebd0b8dd44060858438452555fd5f42579413e WatchSource:0}: Error finding container 75910f8ebe86c095e877f767b5ebd0b8dd44060858438452555fd5f42579413e: Status 404 returned error can't find the container with id 75910f8ebe86c095e877f767b5ebd0b8dd44060858438452555fd5f42579413e Jun 11 21:10:54.449741 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:54.449696 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd45043_2295_4655_acd6_21b2a603d6f5.slice/crio-708458abc5a1879a5aab5a6ebd983f48d0ff4681a72bd64f9e63914b69bf791f WatchSource:0}: Error finding container 708458abc5a1879a5aab5a6ebd983f48d0ff4681a72bd64f9e63914b69bf791f: Status 404 returned error can't find the container with id 708458abc5a1879a5aab5a6ebd983f48d0ff4681a72bd64f9e63914b69bf791f Jun 11 21:10:54.450695 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:54.450538 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b95329_d40c_4a5c_8681_cd21b618ae1b.slice/crio-ba4858f2c4584ad12d305c139d8e49a8e24602122de7dfa3ef6154bf332b8448 WatchSource:0}: Error finding container ba4858f2c4584ad12d305c139d8e49a8e24602122de7dfa3ef6154bf332b8448: Status 404 returned error can't find the container with id ba4858f2c4584ad12d305c139d8e49a8e24602122de7dfa3ef6154bf332b8448 Jun 11 21:10:54.450948 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:54.450930 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2df8e8_1b68_4c1b_8708_8cb38d4d27d6.slice/crio-22525863495e4d6cb0c1046d0e2b88d04ec8a8e6c3f5fb629b5d8f11812ae380 WatchSource:0}: Error finding container 22525863495e4d6cb0c1046d0e2b88d04ec8a8e6c3f5fb629b5d8f11812ae380: Status 404 returned error can't find the container with id 22525863495e4d6cb0c1046d0e2b88d04ec8a8e6c3f5fb629b5d8f11812ae380 Jun 11 21:10:54.451695 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:54.451672 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97aa08b2_cf05_45fc_8126_2fa3fff3366a.slice/crio-e0bdb978747b515638d410359b09b0f65430a7a929fde3b03f5f490ea5f8907e WatchSource:0}: Error finding container e0bdb978747b515638d410359b09b0f65430a7a929fde3b03f5f490ea5f8907e: Status 404 returned error can't find the container with id e0bdb978747b515638d410359b09b0f65430a7a929fde3b03f5f490ea5f8907e Jun 11 21:10:54.452793 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:10:54.452667 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c147e51_b93b_410b_a81a_f5d7c57087e9.slice/crio-694ef86d62c1a9f4e17cb6ea1ec4952ce449faad5096aaef98341829b5cbf373 WatchSource:0}: Error finding container 694ef86d62c1a9f4e17cb6ea1ec4952ce449faad5096aaef98341829b5cbf373: Status 404 returned error can't find the container with id 694ef86d62c1a9f4e17cb6ea1ec4952ce449faad5096aaef98341829b5cbf373 Jun 11 21:10:54.967852 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:54.967084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:54.967852 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:54.967229 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:10:54.967852 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:54.967287 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret podName:8f8fd8dd-f772-4263-9715-6b654738adaf nodeName:}" failed. No retries permitted until 2026-06-11 21:10:56.967269662 +0000 UTC m=+5.987870741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret") pod "global-pull-secret-syncer-4qt2x" (UID: "8f8fd8dd-f772-4263-9715-6b654738adaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:10:55.068703 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.068030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:55.068703 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:55.068181 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:10:55.068703 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:55.068245 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs podName:7c16c48d-30ea-4a15-9a07-2e6659bb2474 nodeName:}" failed. No retries permitted until 2026-06-11 21:10:57.068227529 +0000 UTC m=+6.088828613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs") pod "network-metrics-daemon-zcvn9" (UID: "7c16c48d-30ea-4a15-9a07-2e6659bb2474") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:10:55.169328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.168669 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kxvj\" (UniqueName: \"kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj\") pod \"network-check-target-mws9g\" (UID: \"75d2a821-eb0b-46dd-9275-a7165590e033\") " pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:10:55.169328 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:55.168885 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:10:55.169328 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:55.168907 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:10:55.169328 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:55.168920 2567 projected.go:196] Error preparing data for projected volume kube-api-access-8kxvj for pod openshift-network-diagnostics/network-check-target-mws9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:10:55.169328 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:55.168980 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj podName:75d2a821-eb0b-46dd-9275-a7165590e033 nodeName:}" failed. No retries permitted until 2026-06-11 21:10:57.16896141 +0000 UTC m=+6.189562480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kxvj" (UniqueName: "kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj") pod "network-check-target-mws9g" (UID: "75d2a821-eb0b-46dd-9275-a7165590e033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:10:55.391327 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.391201 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:05:53 +0000 UTC" deadline="2028-01-14 10:07:52.843224339 +0000 UTC" Jun 11 21:10:55.391327 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.391246 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13956h56m57.45198428s" Jun 11 21:10:55.414325 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.413515 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:10:55.414325 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:55.413631 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:10:55.414325 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.414031 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:55.414325 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:55.414122 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:10:55.414325 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.414184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:55.414325 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:55.414272 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:10:55.434332 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.434295 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v86bl" event={"ID":"518203f3-50cb-4827-b9bf-be3e6dc2541b","Type":"ContainerStarted","Data":"6da25c45c10c9ae90fcdbd74e7d593add81aef6895b81893b9fdb0babc80d5ef"} Jun 11 21:10:55.448636 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.448222 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal" event={"ID":"363076e54f25c3bd7b4f7bc4d102f35d","Type":"ContainerStarted","Data":"84d744854e1df65f79c4c5dd9e26e2f33789c5c23d9c18a631f8ffd815b4d7fe"} Jun 11 21:10:55.459185 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.457727 2567 generic.go:356] "Generic (PLEG): container finished" podID="bc112d94058de04bee31dbcd375853a0" containerID="39756b67b2e392fb7bbae24e15aab3917184a37300fcdc286dda0e72de7549be" exitCode=0 Jun 11 21:10:55.459185 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.457824 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" event={"ID":"bc112d94058de04bee31dbcd375853a0","Type":"ContainerDied","Data":"39756b67b2e392fb7bbae24e15aab3917184a37300fcdc286dda0e72de7549be"} Jun 11 21:10:55.464721 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.464665 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j255d" event={"ID":"7c147e51-b93b-410b-a81a-f5d7c57087e9","Type":"ContainerStarted","Data":"694ef86d62c1a9f4e17cb6ea1ec4952ce449faad5096aaef98341829b5cbf373"} Jun 11 21:10:55.472024 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.471993 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7fwxv" event={"ID":"8f126d62-50e6-415c-bc14-d8f51a6c0adb","Type":"ContainerStarted","Data":"7a007f6021145578790cce4ace0d1bfad9b1bbb8e0e43c938037a7fe300b2255"} Jun 11 21:10:55.478901 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.478850 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-86.ec2.internal" podStartSLOduration=3.478833113 podStartE2EDuration="3.478833113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:10:55.467071272 +0000 UTC m=+4.487672368" watchObservedRunningTime="2026-06-11 21:10:55.478833113 +0000 UTC m=+4.499434200" Jun 11 21:10:55.485665 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.482906 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" event={"ID":"affa242d-8f4e-4084-a666-61e4890730cb","Type":"ContainerStarted","Data":"c00cfe29149c66a870cd0c26fa39eafe8bcd8aa15df44f8225f8b5d9955d6937"} Jun 11 21:10:55.500678 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.500646 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5g4lf" event={"ID":"97aa08b2-cf05-45fc-8126-2fa3fff3366a","Type":"ContainerStarted","Data":"e0bdb978747b515638d410359b09b0f65430a7a929fde3b03f5f490ea5f8907e"} Jun 11 21:10:55.521234 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.521197 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w6726" event={"ID":"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6","Type":"ContainerStarted","Data":"22525863495e4d6cb0c1046d0e2b88d04ec8a8e6c3f5fb629b5d8f11812ae380"} Jun 11 21:10:55.540707 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.540609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" event={"ID":"b0b95329-d40c-4a5c-8681-cd21b618ae1b","Type":"ContainerStarted","Data":"ba4858f2c4584ad12d305c139d8e49a8e24602122de7dfa3ef6154bf332b8448"} Jun 11 21:10:55.560719 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.560662 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spg87" event={"ID":"ddd45043-2295-4655-acd6-21b2a603d6f5","Type":"ContainerStarted","Data":"708458abc5a1879a5aab5a6ebd983f48d0ff4681a72bd64f9e63914b69bf791f"} Jun 11 21:10:55.572318 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:55.572287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hx7mp" event={"ID":"344ad448-ef00-4d68-ace8-a0375e86d7bb","Type":"ContainerStarted","Data":"75910f8ebe86c095e877f767b5ebd0b8dd44060858438452555fd5f42579413e"} Jun 11 21:10:56.596155 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:56.596079 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" event={"ID":"bc112d94058de04bee31dbcd375853a0","Type":"ContainerStarted","Data":"5f1f342e6aeec1ac1702a5cc438dbab764e74bc1aaf7649cd8a9bcaaf100c58a"} Jun 11 21:10:56.610373 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:56.610315 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-86.ec2.internal" podStartSLOduration=4.610293034 podStartE2EDuration="4.610293034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:10:56.610025001 +0000 UTC m=+5.630626089" watchObservedRunningTime="2026-06-11 21:10:56.610293034 +0000 UTC m=+5.630894133" Jun 11 21:10:56.982560 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:56.982473 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:56.982731 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:56.982688 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:10:56.982786 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:56.982754 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret podName:8f8fd8dd-f772-4263-9715-6b654738adaf nodeName:}" failed. No retries permitted until 2026-06-11 21:11:00.982736634 +0000 UTC m=+10.003337714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret") pod "global-pull-secret-syncer-4qt2x" (UID: "8f8fd8dd-f772-4263-9715-6b654738adaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:10:57.082995 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:57.082952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:57.083190 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:57.083165 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:10:57.083297 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:57.083281 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs podName:7c16c48d-30ea-4a15-9a07-2e6659bb2474 nodeName:}" failed. No retries permitted until 2026-06-11 21:11:01.083244906 +0000 UTC m=+10.103845974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs") pod "network-metrics-daemon-zcvn9" (UID: "7c16c48d-30ea-4a15-9a07-2e6659bb2474") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:10:57.184887 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:57.184211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kxvj\" (UniqueName: \"kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj\") pod \"network-check-target-mws9g\" (UID: \"75d2a821-eb0b-46dd-9275-a7165590e033\") " pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:10:57.184887 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:57.184443 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:10:57.184887 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:57.184465 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:10:57.184887 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:57.184478 2567 projected.go:196] Error preparing data for projected volume kube-api-access-8kxvj for pod openshift-network-diagnostics/network-check-target-mws9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:10:57.184887 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:57.184539 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj podName:75d2a821-eb0b-46dd-9275-a7165590e033 nodeName:}" failed. No retries permitted until 2026-06-11 21:11:01.184520714 +0000 UTC m=+10.205121782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kxvj" (UniqueName: "kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj") pod "network-check-target-mws9g" (UID: "75d2a821-eb0b-46dd-9275-a7165590e033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:10:57.412186 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:57.411608 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:10:57.412186 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:57.411743 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:10:57.412186 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:57.412064 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:57.412186 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:57.412175 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:10:57.412518 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:57.412207 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:57.412518 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:57.412288 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:10:59.411920 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:59.411778 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:10:59.411920 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:59.411789 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:10:59.411920 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:59.411907 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:10:59.411920 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:10:59.411928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:10:59.412571 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:59.412022 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:10:59.412571 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:10:59.412101 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:01.015638 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:01.015053 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:01.015638 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.015220 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:11:01.015638 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.015287 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret podName:8f8fd8dd-f772-4263-9715-6b654738adaf nodeName:}" failed. No retries permitted until 2026-06-11 21:11:09.015266491 +0000 UTC m=+18.035867560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret") pod "global-pull-secret-syncer-4qt2x" (UID: "8f8fd8dd-f772-4263-9715-6b654738adaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:11:01.115974 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:01.115937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:01.116146 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.116100 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:11:01.116202 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.116165 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs podName:7c16c48d-30ea-4a15-9a07-2e6659bb2474 nodeName:}" failed. No retries permitted until 2026-06-11 21:11:09.116146334 +0000 UTC m=+18.136747405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs") pod "network-metrics-daemon-zcvn9" (UID: "7c16c48d-30ea-4a15-9a07-2e6659bb2474") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:11:01.216886 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:01.216852 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kxvj\" (UniqueName: \"kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj\") pod \"network-check-target-mws9g\" (UID: \"75d2a821-eb0b-46dd-9275-a7165590e033\") " pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:01.217077 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.217052 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:11:01.217148 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.217090 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:11:01.217148 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.217104 2567 projected.go:196] Error preparing data for projected volume kube-api-access-8kxvj for pod openshift-network-diagnostics/network-check-target-mws9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:11:01.217249 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.217165 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj podName:75d2a821-eb0b-46dd-9275-a7165590e033 nodeName:}" failed. No retries permitted until 2026-06-11 21:11:09.217143877 +0000 UTC m=+18.237744944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kxvj" (UniqueName: "kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj") pod "network-check-target-mws9g" (UID: "75d2a821-eb0b-46dd-9275-a7165590e033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:11:01.412016 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:01.411944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:01.412152 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.412037 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:01.412152 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:01.412096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:01.412252 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.412162 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:01.412252 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:01.412215 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:01.412337 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:01.412322 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:03.412032 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:03.411700 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:03.412032 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:03.411834 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:03.412032 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:03.411700 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:03.412032 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:03.411920 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:03.412032 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:03.411943 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:03.412032 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:03.412022 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:05.411230 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:05.411185 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:05.411230 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:05.411224 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:05.411771 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:05.411185 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:05.411771 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:05.411330 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:05.411771 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:05.411410 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:05.411771 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:05.411549 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:07.411636 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:07.411605 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:07.412094 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:07.411728 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:07.412094 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:07.411751 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:07.412094 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:07.411829 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:07.412094 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:07.411873 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:07.412094 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:07.411940 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:09.073957 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:09.073916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:09.074356 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.074073 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:11:09.074356 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.074144 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret podName:8f8fd8dd-f772-4263-9715-6b654738adaf nodeName:}" failed. No retries permitted until 2026-06-11 21:11:25.074124436 +0000 UTC m=+34.094725502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret") pod "global-pull-secret-syncer-4qt2x" (UID: "8f8fd8dd-f772-4263-9715-6b654738adaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:11:09.174467 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:09.174442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:09.174569 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.174549 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:11:09.174640 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.174629 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs podName:7c16c48d-30ea-4a15-9a07-2e6659bb2474 nodeName:}" failed. No retries permitted until 2026-06-11 21:11:25.174606704 +0000 UTC m=+34.195207783 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs") pod "network-metrics-daemon-zcvn9" (UID: "7c16c48d-30ea-4a15-9a07-2e6659bb2474") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:11:09.275871 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:09.275787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kxvj\" (UniqueName: \"kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj\") pod \"network-check-target-mws9g\" (UID: \"75d2a821-eb0b-46dd-9275-a7165590e033\") " pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:09.276038 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.275970 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:11:09.276038 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.275992 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:11:09.276038 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.276003 2567 projected.go:196] Error preparing data for projected volume kube-api-access-8kxvj for pod openshift-network-diagnostics/network-check-target-mws9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:11:09.276185 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.276065 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj podName:75d2a821-eb0b-46dd-9275-a7165590e033 nodeName:}" failed. No retries permitted until 2026-06-11 21:11:25.276046113 +0000 UTC m=+34.296647196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kxvj" (UniqueName: "kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj") pod "network-check-target-mws9g" (UID: "75d2a821-eb0b-46dd-9275-a7165590e033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:11:09.411310 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:09.411272 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:09.411511 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:09.411319 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:09.411511 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:09.411457 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:09.411511 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.411441 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:09.411689 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.411564 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:09.411689 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:09.411661 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:11.411832 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:11.411779 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:11.412278 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:11.411888 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:11.412278 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:11.411902 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:11.412278 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:11.412013 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:11.412278 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:11.412058 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:11.412278 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:11.412121 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:13.411468 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.411291 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:13.412067 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.411292 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:13.412067 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:13.411575 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:13.412067 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.411292 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:13.412067 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:13.411648 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:13.412067 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:13.411794 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:13.626763 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.626735 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" event={"ID":"b0b95329-d40c-4a5c-8681-cd21b618ae1b","Type":"ContainerStarted","Data":"d1ee3568d51adb6af81a4737f4d10bcf8f7831b7c0358b726d71f5126eaf2038"} Jun 11 21:11:13.628160 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.628135 2567 generic.go:356] "Generic (PLEG): container finished" podID="ddd45043-2295-4655-acd6-21b2a603d6f5" containerID="7de288a59a4160e39e0e0d3c8629d54f4f0678c10398c9ee447eb717e02502fb" exitCode=0 Jun 11 21:11:13.628275 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.628184 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spg87" event={"ID":"ddd45043-2295-4655-acd6-21b2a603d6f5","Type":"ContainerDied","Data":"7de288a59a4160e39e0e0d3c8629d54f4f0678c10398c9ee447eb717e02502fb"} Jun 11 21:11:13.629640 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.629622 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hx7mp" event={"ID":"344ad448-ef00-4d68-ace8-a0375e86d7bb","Type":"ContainerStarted","Data":"f32eb344fca69051486b3ae91c457196c2986362841eaa64b8cfe59ec4c5d493"} Jun 11 21:11:13.634226 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.634199 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v86bl" event={"ID":"518203f3-50cb-4827-b9bf-be3e6dc2541b","Type":"ContainerStarted","Data":"86ee06d4267d7cc4103d992020fd802af8fc3c9191b04f790157bb7a8fde9b1e"} Jun 11 21:11:13.638420 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.638312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j255d" event={"ID":"7c147e51-b93b-410b-a81a-f5d7c57087e9","Type":"ContainerStarted","Data":"1184a69c795416e2555680b34a46e3e164bb8bc7946276a92bbe9b69389c354d"} Jun 11 21:11:13.640451 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.640393 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7fwxv" event={"ID":"8f126d62-50e6-415c-bc14-d8f51a6c0adb","Type":"ContainerStarted","Data":"1e0f45ab9f76c2a3ddd5721b32c2bae89fe7eff181ffa252c6f3bf6a4494ba2a"} Jun 11 21:11:13.642541 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.642521 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:11:13.642870 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.642845 2567 generic.go:356] "Generic (PLEG): container finished" podID="affa242d-8f4e-4084-a666-61e4890730cb" containerID="964effd6d5f0b12b2e54fe1b1fcdb47a87c20bf62b21f0d49078e7fb30656ce4" exitCode=1 Jun 11 21:11:13.642954 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.642902 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" event={"ID":"affa242d-8f4e-4084-a666-61e4890730cb","Type":"ContainerStarted","Data":"dffb9b48e7aaad035cbfe909ceb99eca21fa4e4042b8d20436d254d3b68ee83d"} Jun 11 21:11:13.643002 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.642957 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" event={"ID":"affa242d-8f4e-4084-a666-61e4890730cb","Type":"ContainerDied","Data":"964effd6d5f0b12b2e54fe1b1fcdb47a87c20bf62b21f0d49078e7fb30656ce4"} Jun 11 21:11:13.643002 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.642993 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" event={"ID":"affa242d-8f4e-4084-a666-61e4890730cb","Type":"ContainerStarted","Data":"6836ad8e79adf222483a88ea099b42ae279b311b35815d1b7fd9a7ef845fec4f"} Jun 11 21:11:13.644360 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.644340 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w6726" event={"ID":"aa2df8e8-1b68-4c1b-8708-8cb38d4d27d6","Type":"ContainerStarted","Data":"595d36598c7a2eee4f93e0c7cbe91e88353c50a0418c44c434e44198c552c2ce"} Jun 11 21:11:13.665055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.665010 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v86bl" podStartSLOduration=3.786869283 podStartE2EDuration="22.664993834s" totalImagesPullingTime="18.878124551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:13.663913357 +0000 UTC m=+22.684514462" watchObservedRunningTime="2026-06-11 21:11:13.664993834 +0000 UTC m=+22.685594919" Jun 11 21:11:13.680134 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.679921 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j255d" podStartSLOduration=4.140986583 podStartE2EDuration="22.679904826s" totalImagesPullingTime="18.538918243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:13.679081411 +0000 UTC m=+22.699682500" watchObservedRunningTime="2026-06-11 21:11:13.679904826 +0000 UTC m=+22.700505916" Jun 11 21:11:13.694889 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.694616 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w6726" podStartSLOduration=4.15306305 podStartE2EDuration="22.694596244s" totalImagesPullingTime="18.541533194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:13.693901561 +0000 UTC m=+22.714502669" watchObservedRunningTime="2026-06-11 21:11:13.694596244 +0000 UTC m=+22.715197335" Jun 11 21:11:13.722234 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.722179 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hx7mp" podStartSLOduration=4.242817588 podStartE2EDuration="22.722159823s" totalImagesPullingTime="18.479342235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:13.722014855 +0000 UTC m=+22.742615942" watchObservedRunningTime="2026-06-11 21:11:13.722159823 +0000 UTC m=+22.742760913" Jun 11 21:11:13.722794 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.722757 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7fwxv" podStartSLOduration=4.247818226 podStartE2EDuration="22.72274221s" totalImagesPullingTime="18.474923984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:13.707916993 +0000 UTC m=+22.728518080" watchObservedRunningTime="2026-06-11 21:11:13.72274221 +0000 UTC m=+22.743343303" Jun 11 21:11:13.781628 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.781596 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:13.861327 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:13.861294 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:14.560309 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:14.560285 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 21:11:14.649142 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:14.649072 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:11:14.649417 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:14.649391 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" event={"ID":"affa242d-8f4e-4084-a666-61e4890730cb","Type":"ContainerStarted","Data":"43103dc5d7e1383758c516a41490efaea6b9be12e887c0f18097213b2cfe9428"} Jun 11 21:11:14.649554 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:14.649531 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" event={"ID":"affa242d-8f4e-4084-a666-61e4890730cb","Type":"ContainerStarted","Data":"bf009ea34a40cdd869754a341d62d2d05c119005a56aef84f845ccf646944dbd"} Jun 11 21:11:14.649611 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:14.649586 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" event={"ID":"affa242d-8f4e-4084-a666-61e4890730cb","Type":"ContainerStarted","Data":"93ebd37ca68ed0590c25cb5e66cddc6fe50b74400183a0299fc4a55129a83f39"} Jun 11 21:11:14.650893 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:14.650873 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5g4lf" event={"ID":"97aa08b2-cf05-45fc-8126-2fa3fff3366a","Type":"ContainerStarted","Data":"8548e40afd0fc709cac4cf4c7f17d4663e2e71b23d60045ca8c432981c2f2ba0"} Jun 11 21:11:14.652476 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:14.652447 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" event={"ID":"b0b95329-d40c-4a5c-8681-cd21b618ae1b","Type":"ContainerStarted","Data":"565e254d80d75299b0723476f2bec46922fc2c7fd02b9c20024cf4a8557973f1"} Jun 11 21:11:14.665212 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:14.665168 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5g4lf" podStartSLOduration=5.119020411 podStartE2EDuration="23.665156912s" totalImagesPullingTime="18.546136501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:14.664822958 +0000 UTC m=+23.685424044" watchObservedRunningTime="2026-06-11 21:11:14.665156912 +0000 UTC m=+23.685757998" Jun 11 21:11:14.783775 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:14.783742 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:14.842730 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:14.842676 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:15.408787 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:15.408694 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T21:11:14.560304426Z","UUID":"9dafa8bd-38bf-4c50-94e7-a97895ba8bbf","Handler":null,"Name":"","Endpoint":""} Jun 11 21:11:15.410132 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:15.410109 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 21:11:15.410275 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:15.410154 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 21:11:15.410825 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:15.410748 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:15.410825 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:15.410784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:15.410984 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:15.410850 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:15.410984 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:15.410860 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:15.410984 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:15.410961 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:15.411124 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:15.411045 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:16.659345 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:16.659170 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:11:16.659793 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:16.659715 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" event={"ID":"affa242d-8f4e-4084-a666-61e4890730cb","Type":"ContainerStarted","Data":"4239e9b2c7dbfc49ae7f18c8b6318936be0781d619409102ed4e0e128e46903c"} Jun 11 21:11:16.661728 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:16.661692 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" event={"ID":"b0b95329-d40c-4a5c-8681-cd21b618ae1b","Type":"ContainerStarted","Data":"7fb2589f45ca8b848c8a8cc1eabcff70c35d18f791569c590496ad62ae72fb98"} Jun 11 21:11:16.678726 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:16.678684 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9vx4" podStartSLOduration=4.949063172 podStartE2EDuration="25.678671027s" totalImagesPullingTime="20.729607855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:16.678556199 +0000 UTC m=+25.699157305" watchObservedRunningTime="2026-06-11 21:11:16.678671027 +0000 UTC m=+25.699272174" Jun 11 21:11:17.411243 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:17.411209 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:17.411488 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:17.411225 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:17.411488 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:17.411368 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:17.411488 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:17.411334 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:17.411655 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:17.411515 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:17.411655 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:17.411618 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:18.060372 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:18.060345 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:11:18.061025 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:18.060973 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:11:18.665979 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:18.665950 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:11:18.666598 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:18.666576 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7fwxv" Jun 11 21:11:18.722712 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:18.722677 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:19.411711 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.411474 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:19.412329 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.411474 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:19.412329 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.411475 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:19.412329 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:19.411856 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:19.412329 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:19.411963 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:19.412329 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:19.412046 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:19.671196 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.671130 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:11:19.671521 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.671497 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" event={"ID":"affa242d-8f4e-4084-a666-61e4890730cb","Type":"ContainerStarted","Data":"85347a292afeded1d8c447c629d66e4ac968cff57dfcc7a561aed3ecf24d523b"} Jun 11 21:11:19.671724 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.671701 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:11:19.671860 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.671776 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:11:19.671946 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.671928 2567 scope.go:117] "RemoveContainer" containerID="964effd6d5f0b12b2e54fe1b1fcdb47a87c20bf62b21f0d49078e7fb30656ce4" Jun 11 21:11:19.673549 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.673527 2567 generic.go:356] "Generic (PLEG): container finished" podID="ddd45043-2295-4655-acd6-21b2a603d6f5" containerID="76fb287120f0a1cb48b390aebea8da66eaecd45dd930fc19abbad070d168863d" exitCode=0 Jun 11 21:11:19.673651 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.673616 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spg87" event={"ID":"ddd45043-2295-4655-acd6-21b2a603d6f5","Type":"ContainerDied","Data":"76fb287120f0a1cb48b390aebea8da66eaecd45dd930fc19abbad070d168863d"} Jun 11 21:11:19.687582 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:19.687563 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:11:20.679020 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:20.678992 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:11:20.679558 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:20.679316 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" event={"ID":"affa242d-8f4e-4084-a666-61e4890730cb","Type":"ContainerStarted","Data":"907b13f2cadd6b5172eae3e2721c3943e35e4db853512bb176c84c51be1ac78b"} Jun 11 21:11:20.679558 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:20.679474 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:11:20.694252 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:20.694228 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:11:20.705277 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:20.705230 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" podStartSLOduration=11.137445386 podStartE2EDuration="29.7052176s" totalImagesPullingTime="18.567772214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:20.703885972 +0000 UTC m=+29.724487082" watchObservedRunningTime="2026-06-11 21:11:20.7052176 +0000 UTC m=+29.725818687" Jun 11 21:11:21.070240 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:21.070016 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4qt2x"] Jun 11 21:11:21.070378 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:21.070358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:21.070550 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:21.070492 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:21.073187 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:21.073161 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mws9g"] Jun 11 21:11:21.073337 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:21.073267 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:21.073411 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:21.073360 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:21.073796 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:21.073777 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zcvn9"] Jun 11 21:11:21.073875 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:21.073865 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:21.073955 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:21.073941 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:21.683118 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:21.683085 2567 generic.go:356] "Generic (PLEG): container finished" podID="ddd45043-2295-4655-acd6-21b2a603d6f5" containerID="5e6bf29a314471e015e0c44f726cb2c8cd851b950d13b9aa01d72bd3af75adbb" exitCode=0 Jun 11 21:11:21.683514 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:21.683175 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spg87" event={"ID":"ddd45043-2295-4655-acd6-21b2a603d6f5","Type":"ContainerDied","Data":"5e6bf29a314471e015e0c44f726cb2c8cd851b950d13b9aa01d72bd3af75adbb"} Jun 11 21:11:22.411208 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:22.411130 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:22.411208 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:22.411177 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:22.411444 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:22.411260 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:22.411444 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:22.411407 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:22.881589 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:22.881562 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:22.932396 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:22.932364 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:23.411374 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:23.411343 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:23.411555 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:23.411471 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:23.689916 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:23.689878 2567 generic.go:356] "Generic (PLEG): container finished" podID="ddd45043-2295-4655-acd6-21b2a603d6f5" containerID="58a69998d721ebb7f34573c0a22ab2f1faec5940d5b6c01e545ba98334c99ed2" exitCode=0 Jun 11 21:11:23.690102 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:23.689932 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spg87" event={"ID":"ddd45043-2295-4655-acd6-21b2a603d6f5","Type":"ContainerDied","Data":"58a69998d721ebb7f34573c0a22ab2f1faec5940d5b6c01e545ba98334c99ed2"} Jun 11 21:11:24.411154 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:24.411072 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:24.411538 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:24.411179 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mws9g" podUID="75d2a821-eb0b-46dd-9275-a7165590e033" Jun 11 21:11:24.411538 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:24.411234 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:24.411538 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:24.411332 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qt2x" podUID="8f8fd8dd-f772-4263-9715-6b654738adaf" Jun 11 21:11:25.094558 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:25.094520 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:25.094725 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:25.094660 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:11:25.094725 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:25.094717 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret podName:8f8fd8dd-f772-4263-9715-6b654738adaf nodeName:}" failed. No retries permitted until 2026-06-11 21:11:57.094703775 +0000 UTC m=+66.115304839 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret") pod "global-pull-secret-syncer-4qt2x" (UID: "8f8fd8dd-f772-4263-9715-6b654738adaf") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:11:25.195603 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:25.195569 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:25.195791 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:25.195753 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:11:25.195863 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:25.195830 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs podName:7c16c48d-30ea-4a15-9a07-2e6659bb2474 nodeName:}" failed. No retries permitted until 2026-06-11 21:11:57.195809513 +0000 UTC m=+66.216410577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs") pod "network-metrics-daemon-zcvn9" (UID: "7c16c48d-30ea-4a15-9a07-2e6659bb2474") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:11:25.296867 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:25.296826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kxvj\" (UniqueName: \"kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj\") pod \"network-check-target-mws9g\" (UID: \"75d2a821-eb0b-46dd-9275-a7165590e033\") " pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:25.297048 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:25.296969 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:11:25.297048 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:25.296991 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:11:25.297048 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:25.297002 2567 projected.go:196] Error preparing data for projected volume kube-api-access-8kxvj for pod openshift-network-diagnostics/network-check-target-mws9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:11:25.297220 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:25.297057 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj podName:75d2a821-eb0b-46dd-9275-a7165590e033 nodeName:}" failed. No retries permitted until 2026-06-11 21:11:57.297042647 +0000 UTC m=+66.317643726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8kxvj" (UniqueName: "kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj") pod "network-check-target-mws9g" (UID: "75d2a821-eb0b-46dd-9275-a7165590e033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:11:25.411460 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:25.411363 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:25.411923 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:25.411496 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:11:26.286558 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.286523 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-86.ec2.internal" event="NodeReady" Jun 11 21:11:26.286755 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.286695 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 21:11:26.332246 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.332214 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5hdj2"] Jun 11 21:11:26.342175 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.342141 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zsdqt"] Jun 11 21:11:26.342314 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.342261 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.344623 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.344598 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 21:11:26.344744 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.344648 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6v9mc\"" Jun 11 21:11:26.344802 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.344779 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 21:11:26.365937 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.365915 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5hdj2"] Jun 11 21:11:26.366024 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.365959 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zsdqt"] Jun 11 21:11:26.366070 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.366026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zsdqt" Jun 11 21:11:26.368622 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.368448 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 21:11:26.368622 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.368607 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rttxf\"" Jun 11 21:11:26.368828 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.368607 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 21:11:26.382167 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.382144 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 21:11:26.411160 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.411123 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:26.411324 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.411298 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:26.413761 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.413714 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:11:26.413761 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.413733 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9kn59\"" Jun 11 21:11:26.413761 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.413741 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:11:26.413761 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.413741 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:11:26.507885 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.507856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-config-volume\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.507885 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.507887 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.508092 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.507909 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c844507d-8ab2-40f2-8570-0c08231b4556-cert\") pod \"ingress-canary-zsdqt\" (UID: \"c844507d-8ab2-40f2-8570-0c08231b4556\") " pod="openshift-ingress-canary/ingress-canary-zsdqt" Jun 11 21:11:26.508092 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.508003 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdvpg\" (UniqueName: \"kubernetes.io/projected/c844507d-8ab2-40f2-8570-0c08231b4556-kube-api-access-vdvpg\") pod \"ingress-canary-zsdqt\" (UID: \"c844507d-8ab2-40f2-8570-0c08231b4556\") " pod="openshift-ingress-canary/ingress-canary-zsdqt" Jun 11 21:11:26.508092 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.508045 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-tmp-dir\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.508092 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.508067 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dnp5\" (UniqueName: \"kubernetes.io/projected/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-kube-api-access-2dnp5\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.609221 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.609142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-config-volume\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.609221 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.609176 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.609221 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.609206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c844507d-8ab2-40f2-8570-0c08231b4556-cert\") pod \"ingress-canary-zsdqt\" (UID: \"c844507d-8ab2-40f2-8570-0c08231b4556\") " pod="openshift-ingress-canary/ingress-canary-zsdqt" Jun 11 21:11:26.609492 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:26.609325 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:11:26.609492 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:26.609409 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls podName:51a7e4df-67f9-4904-9c16-6d0cbf47db7d nodeName:}" failed. No retries permitted until 2026-06-11 21:11:27.109385867 +0000 UTC m=+36.129986954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls") pod "dns-default-5hdj2" (UID: "51a7e4df-67f9-4904-9c16-6d0cbf47db7d") : secret "dns-default-metrics-tls" not found Jun 11 21:11:26.609492 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.609455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdvpg\" (UniqueName: \"kubernetes.io/projected/c844507d-8ab2-40f2-8570-0c08231b4556-kube-api-access-vdvpg\") pod \"ingress-canary-zsdqt\" (UID: \"c844507d-8ab2-40f2-8570-0c08231b4556\") " pod="openshift-ingress-canary/ingress-canary-zsdqt" Jun 11 21:11:26.609645 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.609502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-tmp-dir\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.609645 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.609533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dnp5\" (UniqueName: \"kubernetes.io/projected/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-kube-api-access-2dnp5\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.609917 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.609893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-config-volume\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.610092 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.610069 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-tmp-dir\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.614329 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.614308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c844507d-8ab2-40f2-8570-0c08231b4556-cert\") pod \"ingress-canary-zsdqt\" (UID: \"c844507d-8ab2-40f2-8570-0c08231b4556\") " pod="openshift-ingress-canary/ingress-canary-zsdqt" Jun 11 21:11:26.617748 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.617726 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dnp5\" (UniqueName: \"kubernetes.io/projected/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-kube-api-access-2dnp5\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:26.617933 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.617908 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdvpg\" (UniqueName: \"kubernetes.io/projected/c844507d-8ab2-40f2-8570-0c08231b4556-kube-api-access-vdvpg\") pod \"ingress-canary-zsdqt\" (UID: \"c844507d-8ab2-40f2-8570-0c08231b4556\") " pod="openshift-ingress-canary/ingress-canary-zsdqt" Jun 11 21:11:26.675817 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.675789 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zsdqt" Jun 11 21:11:26.844153 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.844121 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zsdqt"] Jun 11 21:11:26.848270 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:11:26.848242 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc844507d_8ab2_40f2_8570_0c08231b4556.slice/crio-4983fc857da5946f18417d2713e80f337de88cd53ce0a624663e7844f8fcfcf1 WatchSource:0}: Error finding container 4983fc857da5946f18417d2713e80f337de88cd53ce0a624663e7844f8fcfcf1: Status 404 returned error can't find the container with id 4983fc857da5946f18417d2713e80f337de88cd53ce0a624663e7844f8fcfcf1 Jun 11 21:11:26.965925 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:26.965814 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:27.066295 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:27.066255 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:27.113350 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:27.113318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:27.113499 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:27.113418 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:11:27.113499 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:27.113500 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls podName:51a7e4df-67f9-4904-9c16-6d0cbf47db7d nodeName:}" failed. No retries permitted until 2026-06-11 21:11:28.113485667 +0000 UTC m=+37.134086733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls") pod "dns-default-5hdj2" (UID: "51a7e4df-67f9-4904-9c16-6d0cbf47db7d") : secret "dns-default-metrics-tls" not found Jun 11 21:11:27.410964 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:27.410928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:27.413638 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:27.413611 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:11:27.413971 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:27.413849 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-thzvh\"" Jun 11 21:11:27.701590 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:27.701515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zsdqt" event={"ID":"c844507d-8ab2-40f2-8570-0c08231b4556","Type":"ContainerStarted","Data":"4983fc857da5946f18417d2713e80f337de88cd53ce0a624663e7844f8fcfcf1"} Jun 11 21:11:28.121913 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:28.121874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:28.122099 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:28.122054 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:11:28.122176 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:28.122131 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls podName:51a7e4df-67f9-4904-9c16-6d0cbf47db7d nodeName:}" failed. No retries permitted until 2026-06-11 21:11:30.122110352 +0000 UTC m=+39.142711434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls") pod "dns-default-5hdj2" (UID: "51a7e4df-67f9-4904-9c16-6d0cbf47db7d") : secret "dns-default-metrics-tls" not found Jun 11 21:11:30.136201 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:30.136172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:30.136527 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:30.136310 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:11:30.136527 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:30.136379 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls podName:51a7e4df-67f9-4904-9c16-6d0cbf47db7d nodeName:}" failed. No retries permitted until 2026-06-11 21:11:34.136360595 +0000 UTC m=+43.156961673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls") pod "dns-default-5hdj2" (UID: "51a7e4df-67f9-4904-9c16-6d0cbf47db7d") : secret "dns-default-metrics-tls" not found Jun 11 21:11:30.709116 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:30.708911 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zsdqt" event={"ID":"c844507d-8ab2-40f2-8570-0c08231b4556","Type":"ContainerStarted","Data":"69ef1c7df785ae32f86b7a0915afa7d4909a631c49e835029aa8c314707585da"} Jun 11 21:11:30.711504 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:30.711479 2567 generic.go:356] "Generic (PLEG): container finished" podID="ddd45043-2295-4655-acd6-21b2a603d6f5" containerID="f281fee1f58759b3b09e6ec67dadacd54d6f65e2fa006b12aedf00da20aed1dc" exitCode=0 Jun 11 21:11:30.711634 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:30.711513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spg87" event={"ID":"ddd45043-2295-4655-acd6-21b2a603d6f5","Type":"ContainerDied","Data":"f281fee1f58759b3b09e6ec67dadacd54d6f65e2fa006b12aedf00da20aed1dc"} Jun 11 21:11:30.724532 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:30.724466 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zsdqt" podStartSLOduration=1.5351589749999999 podStartE2EDuration="4.724448785s" totalImagesPullingTime="3.18928981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:30.724033983 +0000 UTC m=+39.744635071" watchObservedRunningTime="2026-06-11 21:11:30.724448785 +0000 UTC m=+39.745049865" Jun 11 21:11:31.716781 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:31.716747 2567 generic.go:356] "Generic (PLEG): container finished" podID="ddd45043-2295-4655-acd6-21b2a603d6f5" containerID="3e8d04b80ee06600e32ba2b885ff46438a723dfa8c69f704b631c2662d765f1c" exitCode=0 Jun 11 21:11:31.717496 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:31.716814 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spg87" event={"ID":"ddd45043-2295-4655-acd6-21b2a603d6f5","Type":"ContainerDied","Data":"3e8d04b80ee06600e32ba2b885ff46438a723dfa8c69f704b631c2662d765f1c"} Jun 11 21:11:31.728944 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:31.728916 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:31.826255 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:31.826222 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:32.722779 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:32.722746 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-spg87" event={"ID":"ddd45043-2295-4655-acd6-21b2a603d6f5","Type":"ContainerStarted","Data":"5b06a3c0f163e4641fcb51134bd333d80ffc210be126d143acb3f1edb371b91b"} Jun 11 21:11:32.745332 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:32.745282 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-spg87" podStartSLOduration=8.996508616 podStartE2EDuration="41.745267842s" totalImagesPullingTime="32.748759226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:32.743715346 +0000 UTC m=+41.764316434" watchObservedRunningTime="2026-06-11 21:11:32.745267842 +0000 UTC m=+41.765868929" Jun 11 21:11:32.843810 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:32.843769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:32.905190 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:32.905152 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:34.162337 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.162294 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:34.162751 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:34.162460 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:11:34.162751 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:34.162524 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls podName:51a7e4df-67f9-4904-9c16-6d0cbf47db7d nodeName:}" failed. No retries permitted until 2026-06-11 21:11:42.162505644 +0000 UTC m=+51.183106730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls") pod "dns-default-5hdj2" (UID: "51a7e4df-67f9-4904-9c16-6d0cbf47db7d") : secret "dns-default-metrics-tls" not found Jun 11 21:11:34.852287 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.852249 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh"] Jun 11 21:11:34.853998 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.853983 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:34.855271 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.855215 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2"] Jun 11 21:11:34.856495 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.856411 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 21:11:34.856495 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.856453 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 21:11:34.856495 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.856462 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 21:11:34.856694 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.856412 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 21:11:34.857261 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.857247 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:34.859663 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.859642 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 21:11:34.859761 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.859665 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 21:11:34.859761 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.859687 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 21:11:34.859881 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.859666 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 21:11:34.865140 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.865122 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh"] Jun 11 21:11:34.871246 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.871224 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2"] Jun 11 21:11:34.968476 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.968403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-hub\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:34.968476 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.968473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6aa31f7-b514-4ae1-be4f-791a14eceb52-tmp\") pod \"klusterlet-addon-workmgr-85dbc8bbf4-5sdfh\" (UID: \"a6aa31f7-b514-4ae1-be4f-791a14eceb52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:34.968689 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.968532 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:34.968689 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.968549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:34.968689 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.968600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6aa31f7-b514-4ae1-be4f-791a14eceb52-klusterlet-config\") pod \"klusterlet-addon-workmgr-85dbc8bbf4-5sdfh\" (UID: \"a6aa31f7-b514-4ae1-be4f-791a14eceb52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:34.968689 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.968631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gghc2\" (UniqueName: \"kubernetes.io/projected/a6aa31f7-b514-4ae1-be4f-791a14eceb52-kube-api-access-gghc2\") pod \"klusterlet-addon-workmgr-85dbc8bbf4-5sdfh\" (UID: \"a6aa31f7-b514-4ae1-be4f-791a14eceb52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:34.968689 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.968659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-ca\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:34.968689 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.968689 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8gn\" (UniqueName: \"kubernetes.io/projected/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-kube-api-access-5n8gn\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:34.968877 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:34.968751 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.069899 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.069854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8gn\" (UniqueName: \"kubernetes.io/projected/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-kube-api-access-5n8gn\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.069899 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.069910 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.070094 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.070071 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-hub\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.070152 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.070118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6aa31f7-b514-4ae1-be4f-791a14eceb52-tmp\") pod \"klusterlet-addon-workmgr-85dbc8bbf4-5sdfh\" (UID: \"a6aa31f7-b514-4ae1-be4f-791a14eceb52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:35.070212 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.070186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.070266 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.070221 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.070266 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.070251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6aa31f7-b514-4ae1-be4f-791a14eceb52-klusterlet-config\") pod \"klusterlet-addon-workmgr-85dbc8bbf4-5sdfh\" (UID: \"a6aa31f7-b514-4ae1-be4f-791a14eceb52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:35.070366 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.070277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gghc2\" (UniqueName: \"kubernetes.io/projected/a6aa31f7-b514-4ae1-be4f-791a14eceb52-kube-api-access-gghc2\") pod \"klusterlet-addon-workmgr-85dbc8bbf4-5sdfh\" (UID: \"a6aa31f7-b514-4ae1-be4f-791a14eceb52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:35.070366 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.070309 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-ca\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.071291 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.071262 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6aa31f7-b514-4ae1-be4f-791a14eceb52-tmp\") pod \"klusterlet-addon-workmgr-85dbc8bbf4-5sdfh\" (UID: \"a6aa31f7-b514-4ae1-be4f-791a14eceb52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:35.071669 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.071643 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.077254 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.075915 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-ca\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.077254 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.075930 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.077254 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.076033 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a6aa31f7-b514-4ae1-be4f-791a14eceb52-klusterlet-config\") pod \"klusterlet-addon-workmgr-85dbc8bbf4-5sdfh\" (UID: \"a6aa31f7-b514-4ae1-be4f-791a14eceb52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:35.077254 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.076161 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.078386 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.078362 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-hub\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.078490 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.078400 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8gn\" (UniqueName: \"kubernetes.io/projected/0ee2f43c-664e-4487-8e39-c0a82f13b6ed-kube-api-access-5n8gn\") pod \"cluster-proxy-proxy-agent-7697cc6669-67gg2\" (UID: \"0ee2f43c-664e-4487-8e39-c0a82f13b6ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.078840 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.078824 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gghc2\" (UniqueName: \"kubernetes.io/projected/a6aa31f7-b514-4ae1-be4f-791a14eceb52-kube-api-access-gghc2\") pod \"klusterlet-addon-workmgr-85dbc8bbf4-5sdfh\" (UID: \"a6aa31f7-b514-4ae1-be4f-791a14eceb52\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:35.164513 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.164421 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:35.175667 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.175643 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:11:35.301412 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.301358 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh"] Jun 11 21:11:35.304689 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:11:35.304661 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6aa31f7_b514_4ae1_be4f_791a14eceb52.slice/crio-961dcf7360bcb30637ebfded89c05cebd55c7624283951803eb85953a4b356f9 WatchSource:0}: Error finding container 961dcf7360bcb30637ebfded89c05cebd55c7624283951803eb85953a4b356f9: Status 404 returned error can't find the container with id 961dcf7360bcb30637ebfded89c05cebd55c7624283951803eb85953a4b356f9 Jun 11 21:11:35.316680 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.316655 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2"] Jun 11 21:11:35.319961 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:11:35.319940 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ee2f43c_664e_4487_8e39_c0a82f13b6ed.slice/crio-54e37c3b1f7469f484495c7dfbdcf55c633e3fe6e21d0821acf02451441c5aa5 WatchSource:0}: Error finding container 54e37c3b1f7469f484495c7dfbdcf55c633e3fe6e21d0821acf02451441c5aa5: Status 404 returned error can't find the container with id 54e37c3b1f7469f484495c7dfbdcf55c633e3fe6e21d0821acf02451441c5aa5 Jun 11 21:11:35.731911 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.731879 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" event={"ID":"a6aa31f7-b514-4ae1-be4f-791a14eceb52","Type":"ContainerStarted","Data":"961dcf7360bcb30637ebfded89c05cebd55c7624283951803eb85953a4b356f9"} Jun 11 21:11:35.732815 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:35.732792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" event={"ID":"0ee2f43c-664e-4487-8e39-c0a82f13b6ed","Type":"ContainerStarted","Data":"54e37c3b1f7469f484495c7dfbdcf55c633e3fe6e21d0821acf02451441c5aa5"} Jun 11 21:11:41.751195 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:41.751152 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" event={"ID":"a6aa31f7-b514-4ae1-be4f-791a14eceb52","Type":"ContainerStarted","Data":"a73d3e100ceecb3bcb92400f91f90d2b286e3ca7b3d817c4463ca4b977193419"} Jun 11 21:11:41.751678 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:41.751294 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:41.753129 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:41.753110 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:11:41.753442 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:41.753411 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" event={"ID":"0ee2f43c-664e-4487-8e39-c0a82f13b6ed","Type":"ContainerStarted","Data":"c702ec2fb4e867e289532810ae2b840250232636f961e864251f135287fc982a"} Jun 11 21:11:41.753496 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:41.753458 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" event={"ID":"0ee2f43c-664e-4487-8e39-c0a82f13b6ed","Type":"ContainerStarted","Data":"81f08bb6dd552e4a14accbf3375d026d67df9395a11f0e59429a6410f594840d"} Jun 11 21:11:41.753496 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:41.753471 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" event={"ID":"0ee2f43c-664e-4487-8e39-c0a82f13b6ed","Type":"ContainerStarted","Data":"f20a173320ab22b13da791b7e8125701a75bc000a34df3b2ebe7007f8048af0e"} Jun 11 21:11:41.765687 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:41.765650 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" podStartSLOduration=2.052632576 podStartE2EDuration="7.765639635s" totalImagesPullingTime="5.713007059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:41.765475841 +0000 UTC m=+50.786076928" watchObservedRunningTime="2026-06-11 21:11:41.765639635 +0000 UTC m=+50.786240721" Jun 11 21:11:41.781094 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:41.781043 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" podStartSLOduration=2.098399657 podStartE2EDuration="7.781027129s" totalImagesPullingTime="5.682627472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:11:41.780028723 +0000 UTC m=+50.800629811" watchObservedRunningTime="2026-06-11 21:11:41.781027129 +0000 UTC m=+50.801628217" Jun 11 21:11:42.225844 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:42.225800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:42.226011 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:42.225918 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:11:42.226011 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:42.225969 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls podName:51a7e4df-67f9-4904-9c16-6d0cbf47db7d nodeName:}" failed. No retries permitted until 2026-06-11 21:11:58.22595674 +0000 UTC m=+67.246557805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls") pod "dns-default-5hdj2" (UID: "51a7e4df-67f9-4904-9c16-6d0cbf47db7d") : secret "dns-default-metrics-tls" not found Jun 11 21:11:52.695360 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:52.695326 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kw9d9" Jun 11 21:11:52.797562 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:52.797524 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:52.850019 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:52.849988 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:52.899947 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:52.899894 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:11:57.128929 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.128880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:57.131401 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.131382 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:11:57.141488 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.141456 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f8fd8dd-f772-4263-9715-6b654738adaf-original-pull-secret\") pod \"global-pull-secret-syncer-4qt2x\" (UID: \"8f8fd8dd-f772-4263-9715-6b654738adaf\") " pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:57.229782 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.229745 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:11:57.232391 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.232371 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:11:57.240283 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:57.240269 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:11:57.240354 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:57.240321 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs podName:7c16c48d-30ea-4a15-9a07-2e6659bb2474 nodeName:}" failed. No retries permitted until 2026-06-11 21:13:01.2403066 +0000 UTC m=+130.260907664 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs") pod "network-metrics-daemon-zcvn9" (UID: "7c16c48d-30ea-4a15-9a07-2e6659bb2474") : secret "metrics-daemon-secret" not found Jun 11 21:11:57.322009 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.321979 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qt2x" Jun 11 21:11:57.330994 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.330971 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kxvj\" (UniqueName: \"kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj\") pod \"network-check-target-mws9g\" (UID: \"75d2a821-eb0b-46dd-9275-a7165590e033\") " pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:57.333775 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.333745 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:11:57.344333 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.344307 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:11:57.354527 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.354507 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kxvj\" (UniqueName: \"kubernetes.io/projected/75d2a821-eb0b-46dd-9275-a7165590e033-kube-api-access-8kxvj\") pod \"network-check-target-mws9g\" (UID: \"75d2a821-eb0b-46dd-9275-a7165590e033\") " pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:57.456029 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.455949 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4qt2x"] Jun 11 21:11:57.458376 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:11:57.458348 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8fd8dd_f772_4263_9715_6b654738adaf.slice/crio-979825d9577fc119fcf6a29575df6768940e868823590903880b4a2fc2644ce3 WatchSource:0}: Error finding container 979825d9577fc119fcf6a29575df6768940e868823590903880b4a2fc2644ce3: Status 404 returned error can't find the container with id 979825d9577fc119fcf6a29575df6768940e868823590903880b4a2fc2644ce3 Jun 11 21:11:57.630692 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.630662 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9kn59\"" Jun 11 21:11:57.638753 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.638731 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:11:57.757156 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.757124 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mws9g"] Jun 11 21:11:57.760595 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:11:57.760564 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d2a821_eb0b_46dd_9275_a7165590e033.slice/crio-cecb1178995dbdc826b17b62e207bd133659ecf3f80db05671a508adfcdfa729 WatchSource:0}: Error finding container cecb1178995dbdc826b17b62e207bd133659ecf3f80db05671a508adfcdfa729: Status 404 returned error can't find the container with id cecb1178995dbdc826b17b62e207bd133659ecf3f80db05671a508adfcdfa729 Jun 11 21:11:57.793088 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.793055 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mws9g" event={"ID":"75d2a821-eb0b-46dd-9275-a7165590e033","Type":"ContainerStarted","Data":"cecb1178995dbdc826b17b62e207bd133659ecf3f80db05671a508adfcdfa729"} Jun 11 21:11:57.794171 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:57.794140 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4qt2x" event={"ID":"8f8fd8dd-f772-4263-9715-6b654738adaf","Type":"ContainerStarted","Data":"979825d9577fc119fcf6a29575df6768940e868823590903880b4a2fc2644ce3"} Jun 11 21:11:58.237256 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:11:58.237215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:11:58.237655 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:58.237337 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:11:58.237655 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:11:58.237390 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls podName:51a7e4df-67f9-4904-9c16-6d0cbf47db7d nodeName:}" failed. No retries permitted until 2026-06-11 21:12:30.237377001 +0000 UTC m=+99.257978066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls") pod "dns-default-5hdj2" (UID: "51a7e4df-67f9-4904-9c16-6d0cbf47db7d") : secret "dns-default-metrics-tls" not found Jun 11 21:12:02.810601 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:12:02.810566 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mws9g" event={"ID":"75d2a821-eb0b-46dd-9275-a7165590e033","Type":"ContainerStarted","Data":"70f3cde4fcd4589ade8953b5d21a90046e548c2a0ae33cf725eb1d7e2bb5ea35"} Jun 11 21:12:02.810916 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:12:02.810700 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:12:02.829462 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:12:02.828417 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mws9g" podStartSLOduration=66.914865744 podStartE2EDuration="1m11.828399312s" totalImagesPullingTime="4.913533568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:02.826744809 +0000 UTC m=+71.847345896" watchObservedRunningTime="2026-06-11 21:12:02.828399312 +0000 UTC m=+71.849000401" Jun 11 21:12:03.815197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:12:03.815153 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4qt2x" event={"ID":"8f8fd8dd-f772-4263-9715-6b654738adaf","Type":"ContainerStarted","Data":"88f150caad4d1bea0e79900941722863d43728e824add40c04c5fada62cf53a4"} Jun 11 21:12:03.828956 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:12:03.828902 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4qt2x" podStartSLOduration=67.577636087 podStartE2EDuration="1m12.828885961s" totalImagesPullingTime="5.251249874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:03.82814251 +0000 UTC m=+72.848743597" watchObservedRunningTime="2026-06-11 21:12:03.828885961 +0000 UTC m=+72.849487047" Jun 11 21:12:30.265528 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:12:30.265477 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:12:30.266004 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:12:30.265627 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:12:30.266004 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:12:30.265695 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls podName:51a7e4df-67f9-4904-9c16-6d0cbf47db7d nodeName:}" failed. No retries permitted until 2026-06-11 21:13:34.265677733 +0000 UTC m=+163.286278799 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls") pod "dns-default-5hdj2" (UID: "51a7e4df-67f9-4904-9c16-6d0cbf47db7d") : secret "dns-default-metrics-tls" not found Jun 11 21:12:33.817779 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:12:33.817745 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mws9g" Jun 11 21:12:48.163118 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:12:48.163064 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:01.281739 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:01.281701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:13:01.282272 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:13:01.281885 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:13:01.282272 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:13:01.281982 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs podName:7c16c48d-30ea-4a15-9a07-2e6659bb2474 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:03.281959379 +0000 UTC m=+252.302560465 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs") pod "network-metrics-daemon-zcvn9" (UID: "7c16c48d-30ea-4a15-9a07-2e6659bb2474") : secret "metrics-daemon-secret" not found Jun 11 21:13:29.354283 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:13:29.354225 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5hdj2" podUID="51a7e4df-67f9-4904-9c16-6d0cbf47db7d" Jun 11 21:13:30.053287 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:30.053259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5hdj2" Jun 11 21:13:30.422981 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:13:30.422906 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zcvn9" podUID="7c16c48d-30ea-4a15-9a07-2e6659bb2474" Jun 11 21:13:31.305491 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:31.305452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:34.317048 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:34.317010 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:13:34.317475 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:13:34.317126 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:13:34.317475 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:13:34.317179 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls podName:51a7e4df-67f9-4904-9c16-6d0cbf47db7d nodeName:}" failed. No retries permitted until 2026-06-11 21:15:36.317165206 +0000 UTC m=+285.337766271 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls") pod "dns-default-5hdj2" (UID: "51a7e4df-67f9-4904-9c16-6d0cbf47db7d") : secret "dns-default-metrics-tls" not found Jun 11 21:13:41.412714 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:41.412633 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:13:41.752257 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:41.752165 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" podUID="a6aa31f7-b514-4ae1-be4f-791a14eceb52" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 11 21:13:42.088840 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:42.088805 2567 generic.go:356] "Generic (PLEG): container finished" podID="a6aa31f7-b514-4ae1-be4f-791a14eceb52" containerID="a73d3e100ceecb3bcb92400f91f90d2b286e3ca7b3d817c4463ca4b977193419" exitCode=1 Jun 11 21:13:42.089005 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:42.088878 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" event={"ID":"a6aa31f7-b514-4ae1-be4f-791a14eceb52","Type":"ContainerDied","Data":"a73d3e100ceecb3bcb92400f91f90d2b286e3ca7b3d817c4463ca4b977193419"} Jun 11 21:13:42.089234 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:42.089221 2567 scope.go:117] "RemoveContainer" containerID="a73d3e100ceecb3bcb92400f91f90d2b286e3ca7b3d817c4463ca4b977193419" Jun 11 21:13:43.093311 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:43.093281 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" event={"ID":"a6aa31f7-b514-4ae1-be4f-791a14eceb52","Type":"ContainerStarted","Data":"7557d5c6423710fc0406c3ca5212c985f6734d660a500107555da9804558c3da"} Jun 11 21:13:43.093707 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:43.093533 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:13:43.094045 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:13:43.094031 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85dbc8bbf4-5sdfh" Jun 11 21:14:02.670603 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:02.670568 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:03.739915 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:03.739877 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:05.261695 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:05.261658 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:05.362830 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:05.362802 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:07.428655 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.428628 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bf64n"] Jun 11 21:14:07.430478 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.430462 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.432900 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.432875 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 21:14:07.433161 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.433146 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w9gk6\"" Jun 11 21:14:07.433877 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.433855 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 21:14:07.433980 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.433906 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 21:14:07.433980 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.433857 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 21:14:07.442751 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.442730 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bf64n"] Jun 11 21:14:07.461162 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.461140 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:07.518853 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.518831 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:07.548676 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.548653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.548780 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.548716 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee14ce04-4b48-48ed-8caa-f471a5c34963-crio-socket\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.548780 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.548733 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee14ce04-4b48-48ed-8caa-f471a5c34963-data-volume\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.548780 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.548749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.548780 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.548773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmkbd\" (UniqueName: \"kubernetes.io/projected/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-api-access-zmkbd\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.592801 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.592773 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:07.649892 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.649863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee14ce04-4b48-48ed-8caa-f471a5c34963-crio-socket\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.650034 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.649896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee14ce04-4b48-48ed-8caa-f471a5c34963-data-volume\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.650034 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.649921 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.650034 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.649986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee14ce04-4b48-48ed-8caa-f471a5c34963-crio-socket\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.650034 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:07.649994 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:14:07.650288 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.650032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmkbd\" (UniqueName: \"kubernetes.io/projected/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-api-access-zmkbd\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.650288 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:07.650083 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:08.150053435 +0000 UTC m=+197.170654517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : configmap "kube-rbac-proxy" not found Jun 11 21:14:07.650288 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.650119 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.650288 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.650208 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee14ce04-4b48-48ed-8caa-f471a5c34963-data-volume\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.650288 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:07.650231 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:14:07.650288 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:07.650272 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:08.150261039 +0000 UTC m=+197.170862104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : secret "insights-runtime-extractor-tls" not found Jun 11 21:14:07.659730 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.659714 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmkbd\" (UniqueName: \"kubernetes.io/projected/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-api-access-zmkbd\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:07.693255 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.693170 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:07.789925 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.789887 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:07.891150 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:07.891118 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:08.069850 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:08.069817 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:08.154442 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:08.154404 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:08.154562 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:08.154482 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:08.154562 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:08.154526 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:14:08.154629 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:08.154581 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:14:08.154629 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:08.154598 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:09.154580976 +0000 UTC m=+198.175182054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : configmap "kube-rbac-proxy" not found Jun 11 21:14:08.154702 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:08.154634 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:09.154621339 +0000 UTC m=+198.175222403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : secret "insights-runtime-extractor-tls" not found Jun 11 21:14:08.534445 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:08.534397 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:08.634801 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:08.634767 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:09.162106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:09.162074 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:09.162310 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:09.162129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:09.162310 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:09.162183 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:14:09.162310 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:09.162248 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:14:09.162310 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:09.162254 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:11.162234437 +0000 UTC m=+200.182835514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : configmap "kube-rbac-proxy" not found Jun 11 21:14:09.162499 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:09.162335 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:11.162319261 +0000 UTC m=+200.182920327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : secret "insights-runtime-extractor-tls" not found Jun 11 21:14:09.396839 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:09.396813 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j255d_7c147e51-b93b-410b-a81a-f5d7c57087e9/dns-node-resolver/0.log" Jun 11 21:14:10.187335 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:10.187299 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:10.295300 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:10.295268 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:10.395166 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:10.395130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:10.396125 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:10.396106 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hx7mp_344ad448-ef00-4d68-ace8-a0375e86d7bb/node-ca/0.log" Jun 11 21:14:11.108244 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:11.108209 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:11.178621 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:11.178590 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:11.178784 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:11.178667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:11.178784 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:11.178733 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:14:11.178784 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:11.178750 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:14:11.178784 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:11.178785 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:15.178772514 +0000 UTC m=+204.199373579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : configmap "kube-rbac-proxy" not found Jun 11 21:14:11.178918 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:11.178805 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:15.178793178 +0000 UTC m=+204.199394247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : secret "insights-runtime-extractor-tls" not found Jun 11 21:14:11.196578 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:11.196552 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zsdqt_c844507d-8ab2-40f2-8570-0c08231b4556/serve-healthcheck-canary/0.log" Jun 11 21:14:14.083093 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:14.083063 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:14.182653 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:14.182621 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:14.445743 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:14.445658 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:14.545948 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:14.545918 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:14.647058 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:14.647012 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:14.865424 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:14.865390 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:15.207677 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:15.207578 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:15.207677 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:15.207669 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:15.208096 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:15.207729 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:14:15.208096 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:15.207740 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:14:15.208096 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:15.207785 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:23.207768458 +0000 UTC m=+212.228369524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : configmap "kube-rbac-proxy" not found Jun 11 21:14:15.208096 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:15.207798 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:23.207791938 +0000 UTC m=+212.228393002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : secret "insights-runtime-extractor-tls" not found Jun 11 21:14:15.463596 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:15.463482 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:15.663195 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:15.663160 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:16.669553 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:16.669516 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:17.065888 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:17.065852 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:17.264805 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:17.264772 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:17.397531 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:17.397420 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:17.497664 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:17.497631 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:17.860756 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:17.860721 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:18.060663 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:18.060626 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:18.551294 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:18.551259 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:18.665382 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:18.665350 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:19.063810 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:19.063777 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:19.262328 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:19.262301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:19.468492 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:19.468396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:19.664664 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:19.664630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:20.483850 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:20.483811 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:20.533875 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:20.533848 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:20.752520 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:20.752425 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:20.872557 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:20.872522 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:21.072460 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:21.072416 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:21.464548 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:21.464461 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:22.263672 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:22.263644 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:22.461134 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:22.461107 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:22.662168 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:22.662138 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:22.861995 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:22.861957 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:23.270258 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:23.270226 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:23.270738 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:23.270298 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:23.270738 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:23.270373 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:14:23.270738 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:23.270456 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls podName:ee14ce04-4b48-48ed-8caa-f471a5c34963 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:39.270425705 +0000 UTC m=+228.291026770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bf64n" (UID: "ee14ce04-4b48-48ed-8caa-f471a5c34963") : secret "insights-runtime-extractor-tls" not found Jun 11 21:14:23.270844 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:23.270808 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14ce04-4b48-48ed-8caa-f471a5c34963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:23.384708 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:23.384667 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:23.484940 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:23.484904 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:23.661443 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:23.661399 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:24.065213 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:24.065180 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:24.470465 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:24.470372 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:24.668310 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:24.668276 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:24.865291 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:24.865256 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:34.498819 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:34.498773 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:34.596337 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:34.596307 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:34.719723 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:34.719687 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:34.770743 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:34.770644 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:35.177279 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:35.177246 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" podUID="0ee2f43c-664e-4487-8e39-c0a82f13b6ed" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 21:14:35.727863 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:35.727832 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:37.425233 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:37.425203 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:37.497371 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:37.497344 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:37.571074 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:37.571038 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:37.623385 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:37.623334 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:37.784924 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:37.784883 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:37.839828 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:37.839799 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:39.293393 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:39.293360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:39.295620 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:39.295597 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14ce04-4b48-48ed-8caa-f471a5c34963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf64n\" (UID: \"ee14ce04-4b48-48ed-8caa-f471a5c34963\") " pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:39.539583 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:39.539532 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bf64n" Jun 11 21:14:39.659099 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:39.659062 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bf64n"] Jun 11 21:14:39.661727 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:14:39.661702 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee14ce04_4b48_48ed_8caa_f471a5c34963.slice/crio-ad5c49544cd1c942c2cbb25f642e392f47dd51afeb1490770f4b572d08c35a65 WatchSource:0}: Error finding container ad5c49544cd1c942c2cbb25f642e392f47dd51afeb1490770f4b572d08c35a65: Status 404 returned error can't find the container with id ad5c49544cd1c942c2cbb25f642e392f47dd51afeb1490770f4b572d08c35a65 Jun 11 21:14:40.252112 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:40.252020 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bf64n" event={"ID":"ee14ce04-4b48-48ed-8caa-f471a5c34963","Type":"ContainerStarted","Data":"ad5c49544cd1c942c2cbb25f642e392f47dd51afeb1490770f4b572d08c35a65"} Jun 11 21:14:40.503574 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:40.503419 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:40.604974 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:40.604893 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:40.672759 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:40.672713 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:41.402740 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:41.402700 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:43.262215 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:43.262178 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bf64n" event={"ID":"ee14ce04-4b48-48ed-8caa-f471a5c34963","Type":"ContainerStarted","Data":"50bbd15615f889cf19a7dc21dbe4e441368119ae3161ca13a310dee44bbe6a6e"} Jun 11 21:14:44.266285 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:44.266251 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bf64n" event={"ID":"ee14ce04-4b48-48ed-8caa-f471a5c34963","Type":"ContainerStarted","Data":"1ccbad42ba424a283159c8702114e7753b4c992a714e5e66eb41de6d5a4a2102"} Jun 11 21:14:44.808354 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:44.808300 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:45.177951 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:45.177864 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" podUID="0ee2f43c-664e-4487-8e39-c0a82f13b6ed" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 21:14:46.274883 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.274846 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bf64n" event={"ID":"ee14ce04-4b48-48ed-8caa-f471a5c34963","Type":"ContainerStarted","Data":"7a3e6a66da93c3b8accea8c186b4da581b9b5d76d9551de8946f1d72fd4a652b"} Jun 11 21:14:46.292009 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.291960 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bf64n" podStartSLOduration=33.605481083 podStartE2EDuration="39.291946147s" totalImagesPullingTime="5.686465064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:14:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:14:46.290373968 +0000 UTC m=+235.310975067" watchObservedRunningTime="2026-06-11 21:14:46.291946147 +0000 UTC m=+235.312547234" Jun 11 21:14:46.714611 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.714567 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:46.865637 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.865609 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:46.938495 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.938456 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z"] Jun 11 21:14:46.938931 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.938891 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:46.941735 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.941720 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:46.944173 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.944148 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 21:14:46.944173 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.944163 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 21:14:46.944558 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.944541 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2lxpc\"" Jun 11 21:14:46.945087 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.945073 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 21:14:46.945183 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.945168 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 21:14:46.945269 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.945229 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 21:14:46.953722 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.953699 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z"] Jun 11 21:14:46.969338 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.969251 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bvvgq"] Jun 11 21:14:46.972402 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.972385 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:46.975740 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.975719 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 21:14:46.975835 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.975750 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zl2ql\"" Jun 11 21:14:46.975835 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.975776 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 21:14:46.975835 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:46.975723 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 21:14:47.054622 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.054622 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b5jv\" (UniqueName: \"kubernetes.io/projected/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-kube-api-access-2b5jv\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.054857 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.054857 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-tls\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.054857 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054729 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-metrics-client-ca\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.054857 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054806 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-sys\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.054857 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.054857 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-root\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.055074 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054885 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.055074 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054908 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-wtmp\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.055074 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054924 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clfmg\" (UniqueName: \"kubernetes.io/projected/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-kube-api-access-clfmg\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.055074 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.055074 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.054966 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-textfile\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.086409 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.086369 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:47.155658 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.155627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-wtmp\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.155658 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.155659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clfmg\" (UniqueName: \"kubernetes.io/projected/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-kube-api-access-clfmg\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.155816 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.155680 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.155816 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.155794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-textfile\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.155886 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.155815 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-wtmp\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.155921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.155885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.155921 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.155912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b5jv\" (UniqueName: \"kubernetes.io/projected/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-kube-api-access-2b5jv\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.155985 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.155943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.155985 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.155967 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-tls\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.156083 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.155985 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-metrics-client-ca\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.156083 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.156025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-sys\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.156083 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.156051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.156083 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.156076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-root\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.156275 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.156101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.156275 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:47.156204 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 21:14:47.156275 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:47.156255 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-openshift-state-metrics-tls podName:01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:47.656238906 +0000 UTC m=+236.676839986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-pqt9z" (UID: "01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9") : secret "openshift-state-metrics-tls" not found Jun 11 21:14:47.156275 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.156257 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-textfile\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.156512 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:47.156364 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 21:14:47.156512 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:14:47.156420 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-tls podName:074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e nodeName:}" failed. No retries permitted until 2026-06-11 21:14:47.656404352 +0000 UTC m=+236.677005419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-tls") pod "node-exporter-bvvgq" (UID: "074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e") : secret "node-exporter-tls" not found Jun 11 21:14:47.156512 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.156424 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-root\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.156512 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.156494 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-sys\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.156709 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.156616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.156709 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.156683 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-metrics-client-ca\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.156786 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.156727 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.158263 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.158243 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.158458 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.158418 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.165654 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.165633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b5jv\" (UniqueName: \"kubernetes.io/projected/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-kube-api-access-2b5jv\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.166539 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.166512 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clfmg\" (UniqueName: \"kubernetes.io/projected/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-kube-api-access-clfmg\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.206336 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.206185 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:47.306117 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.306077 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:47.361283 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.361250 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:47.543312 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.543278 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:47.659966 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.659897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-tls\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.659966 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.659939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.662213 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.662180 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e-node-exporter-tls\") pod \"node-exporter-bvvgq\" (UID: \"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e\") " pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.662323 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.662236 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-pqt9z\" (UID: \"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.850170 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.850131 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" Jun 11 21:14:47.881180 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.881157 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bvvgq" Jun 11 21:14:47.892626 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:14:47.892596 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074852ba_ffe5_4f1f_a4ed_7f5adf1a3f3e.slice/crio-737f0999f4547abc968b0e317635f4a9b7d18202912ec1650b0b0ee6d8876de4 WatchSource:0}: Error finding container 737f0999f4547abc968b0e317635f4a9b7d18202912ec1650b0b0ee6d8876de4: Status 404 returned error can't find the container with id 737f0999f4547abc968b0e317635f4a9b7d18202912ec1650b0b0ee6d8876de4 Jun 11 21:14:47.927996 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.927902 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:47.979668 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:47.979511 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z"] Jun 11 21:14:47.982034 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:14:47.982007 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a1d8a1_b0e0_4c0a_8db0_bbf72af7d8e9.slice/crio-2f8781f5097a15ef5eb64dd0fe4f363db6dd453ae26265246566c64e13c31a00 WatchSource:0}: Error finding container 2f8781f5097a15ef5eb64dd0fe4f363db6dd453ae26265246566c64e13c31a00: Status 404 returned error can't find the container with id 2f8781f5097a15ef5eb64dd0fe4f363db6dd453ae26265246566c64e13c31a00 Jun 11 21:14:48.002954 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.002927 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:48.282179 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.282139 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" event={"ID":"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9","Type":"ContainerStarted","Data":"c1d315d898e910a7f710af9dbf6dcdacc2d3518c557dd2fb191bdfd2771f5e71"} Jun 11 21:14:48.282343 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.282244 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" event={"ID":"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9","Type":"ContainerStarted","Data":"bda843e7a1607b328b0330bd8eb427e99d0437da144fffe6ce3bd7446197135f"} Jun 11 21:14:48.282343 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.282273 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" event={"ID":"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9","Type":"ContainerStarted","Data":"2f8781f5097a15ef5eb64dd0fe4f363db6dd453ae26265246566c64e13c31a00"} Jun 11 21:14:48.283160 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.283137 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvvgq" event={"ID":"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e","Type":"ContainerStarted","Data":"737f0999f4547abc968b0e317635f4a9b7d18202912ec1650b0b0ee6d8876de4"} Jun 11 21:14:48.444135 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.444102 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:48.615809 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.615737 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-szvfg"] Jun 11 21:14:48.618751 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.618727 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-szvfg" Jun 11 21:14:48.620922 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.620895 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-spfj2\"" Jun 11 21:14:48.621059 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.620954 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 21:14:48.621334 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.621311 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 21:14:48.627995 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.627970 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-szvfg"] Jun 11 21:14:48.631501 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.631476 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:48.726648 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.726603 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:48.768651 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.768614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gtwd\" (UniqueName: \"kubernetes.io/projected/ac58a2f2-b700-421d-8144-40de2ee4395c-kube-api-access-8gtwd\") pod \"downloads-694c955b9-szvfg\" (UID: \"ac58a2f2-b700-421d-8144-40de2ee4395c\") " pod="openshift-console/downloads-694c955b9-szvfg" Jun 11 21:14:48.827578 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.827549 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:48.869570 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.869487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gtwd\" (UniqueName: \"kubernetes.io/projected/ac58a2f2-b700-421d-8144-40de2ee4395c-kube-api-access-8gtwd\") pod \"downloads-694c955b9-szvfg\" (UID: \"ac58a2f2-b700-421d-8144-40de2ee4395c\") " pod="openshift-console/downloads-694c955b9-szvfg" Jun 11 21:14:48.887636 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.887607 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gtwd\" (UniqueName: \"kubernetes.io/projected/ac58a2f2-b700-421d-8144-40de2ee4395c-kube-api-access-8gtwd\") pod \"downloads-694c955b9-szvfg\" (UID: \"ac58a2f2-b700-421d-8144-40de2ee4395c\") " pod="openshift-console/downloads-694c955b9-szvfg" Jun 11 21:14:48.930547 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.930513 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-szvfg" Jun 11 21:14:48.938580 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:48.938549 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:49.125012 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:49.124918 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-szvfg"] Jun 11 21:14:49.246766 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:14:49.246731 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac58a2f2_b700_421d_8144_40de2ee4395c.slice/crio-6b623cb0205b53bb2707ddb3ff6290b1d85b66b8a8a3d1ea96b44737c6139154 WatchSource:0}: Error finding container 6b623cb0205b53bb2707ddb3ff6290b1d85b66b8a8a3d1ea96b44737c6139154: Status 404 returned error can't find the container with id 6b623cb0205b53bb2707ddb3ff6290b1d85b66b8a8a3d1ea96b44737c6139154 Jun 11 21:14:49.288054 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:49.288020 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-szvfg" event={"ID":"ac58a2f2-b700-421d-8144-40de2ee4395c","Type":"ContainerStarted","Data":"6b623cb0205b53bb2707ddb3ff6290b1d85b66b8a8a3d1ea96b44737c6139154"} Jun 11 21:14:49.706565 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:49.706484 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:49.761295 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:49.761253 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:49.875905 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:49.875836 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:49.950410 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:49.950374 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:50.002169 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:50.002081 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:50.080841 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:50.080808 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:50.181264 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:50.181218 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:50.292710 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:50.292680 2567 generic.go:356] "Generic (PLEG): container finished" podID="074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e" containerID="16f1c966b6c41a7580c5933ae46f772df107f1cbb67f486d255a775758585f88" exitCode=0 Jun 11 21:14:50.292901 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:50.292777 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvvgq" event={"ID":"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e","Type":"ContainerDied","Data":"16f1c966b6c41a7580c5933ae46f772df107f1cbb67f486d255a775758585f88"} Jun 11 21:14:50.294813 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:50.294792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" event={"ID":"01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9","Type":"ContainerStarted","Data":"d3c69f6b88f991c2b50bce3138e08c9a7aaa1aea7473d9888e2552ab8266edf4"} Jun 11 21:14:50.301417 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:50.301395 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:50.330075 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:50.330009 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pqt9z" podStartSLOduration=3.180110007 podStartE2EDuration="4.32999353s" totalImagesPullingTime="1.149883523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:14:50.328651899 +0000 UTC m=+239.349252991" watchObservedRunningTime="2026-06-11 21:14:50.32999353 +0000 UTC m=+239.350594617" Jun 11 21:14:50.617273 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:50.617183 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:51.300177 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:51.300140 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvvgq" event={"ID":"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e","Type":"ContainerStarted","Data":"01524dc93e84c7593a78316b2227625a4c743aca84cf6bdc55ede1b9f6976f90"} Jun 11 21:14:51.300667 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:51.300201 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvvgq" event={"ID":"074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e","Type":"ContainerStarted","Data":"ab0c23d086158974e8f6262943fbe5097408175b05a8a5f3051d2b9c8096e1cf"} Jun 11 21:14:51.320419 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:51.320364 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bvvgq" podStartSLOduration=3.852675099 podStartE2EDuration="5.32034881s" totalImagesPullingTime="1.40014477s" totalInitContainerRuntime="67.528941ms" isStatefulPod=true podCreationTimestamp="2026-06-11 21:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:14:51.318396045 +0000 UTC m=+240.338997150" watchObservedRunningTime="2026-06-11 21:14:51.32034881 +0000 UTC m=+240.340949896" Jun 11 21:14:51.726459 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:51.726360 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:51.821400 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:51.821361 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:51.921204 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:51.921168 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:52.320444 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:52.320409 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:52.368037 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:52.367991 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:53.165911 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:53.165861 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:14:55.176652 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:55.176612 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" podUID="0ee2f43c-664e-4487-8e39-c0a82f13b6ed" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 21:14:55.176997 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:55.176688 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" Jun 11 21:14:55.177181 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:55.177145 2567 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c702ec2fb4e867e289532810ae2b840250232636f961e864251f135287fc982a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 21:14:55.177217 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:55.177200 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" podUID="0ee2f43c-664e-4487-8e39-c0a82f13b6ed" containerName="service-proxy" containerID="cri-o://c702ec2fb4e867e289532810ae2b840250232636f961e864251f135287fc982a" gracePeriod=30 Jun 11 21:14:55.317938 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:55.317907 2567 generic.go:356] "Generic (PLEG): container finished" podID="0ee2f43c-664e-4487-8e39-c0a82f13b6ed" containerID="c702ec2fb4e867e289532810ae2b840250232636f961e864251f135287fc982a" exitCode=2 Jun 11 21:14:55.318080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:55.317982 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" event={"ID":"0ee2f43c-664e-4487-8e39-c0a82f13b6ed","Type":"ContainerDied","Data":"c702ec2fb4e867e289532810ae2b840250232636f961e864251f135287fc982a"} Jun 11 21:14:56.323823 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:14:56.323783 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7697cc6669-67gg2" event={"ID":"0ee2f43c-664e-4487-8e39-c0a82f13b6ed","Type":"ContainerStarted","Data":"30fb763589aef8d8e0f51d95a8a674ff432f99ec8cf3db16f29f3d5ebb3597d7"} Jun 11 21:15:01.526038 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.525961 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d95bc94fc-z6msk"] Jun 11 21:15:01.528315 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.528299 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.530574 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.530553 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 21:15:01.531394 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.531377 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 21:15:01.531510 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.531425 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 21:15:01.531510 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.531448 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 21:15:01.531510 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.531501 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l6465\"" Jun 11 21:15:01.531668 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.531594 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 21:15:01.535985 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.535967 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 21:15:01.538475 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.538456 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d95bc94fc-z6msk"] Jun 11 21:15:01.542188 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.542143 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:01.571645 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.571619 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-oauth-config\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.571767 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.571661 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-trusted-ca-bundle\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.571767 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.571693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-service-ca\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.571875 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.571784 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-oauth-serving-cert\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.571875 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.571823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9rsp\" (UniqueName: \"kubernetes.io/projected/c40d9513-63eb-4047-80bf-949cd3ab139a-kube-api-access-v9rsp\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.571951 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.571901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-console-config\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.571951 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.571925 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-serving-cert\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.593202 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.593162 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:01.673308 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.673272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-console-config\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.673308 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.673317 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-serving-cert\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.673560 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.673371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-oauth-config\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.673560 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.673404 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-trusted-ca-bundle\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.673560 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.673444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-service-ca\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.673560 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.673478 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-oauth-serving-cert\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.673560 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.673500 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9rsp\" (UniqueName: \"kubernetes.io/projected/c40d9513-63eb-4047-80bf-949cd3ab139a-kube-api-access-v9rsp\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.674168 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.674138 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-console-config\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.674289 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.674216 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-service-ca\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.674394 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.674368 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-oauth-serving-cert\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.674522 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.674407 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-trusted-ca-bundle\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.676140 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.676116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-oauth-config\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.676298 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.676275 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-serving-cert\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.681408 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.681385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9rsp\" (UniqueName: \"kubernetes.io/projected/c40d9513-63eb-4047-80bf-949cd3ab139a-kube-api-access-v9rsp\") pod \"console-d95bc94fc-z6msk\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.837461 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.837416 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:01.973214 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:01.973179 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d95bc94fc-z6msk"] Jun 11 21:15:01.976287 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:15:01.976261 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40d9513_63eb_4047_80bf_949cd3ab139a.slice/crio-1dfd74783a9c383817733efa080391fe2178e3d9b494746f0190d878c342ae76 WatchSource:0}: Error finding container 1dfd74783a9c383817733efa080391fe2178e3d9b494746f0190d878c342ae76: Status 404 returned error can't find the container with id 1dfd74783a9c383817733efa080391fe2178e3d9b494746f0190d878c342ae76 Jun 11 21:15:02.345004 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:02.344969 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d95bc94fc-z6msk" event={"ID":"c40d9513-63eb-4047-80bf-949cd3ab139a","Type":"ContainerStarted","Data":"1dfd74783a9c383817733efa080391fe2178e3d9b494746f0190d878c342ae76"} Jun 11 21:15:02.528050 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:02.527949 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:03.288144 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:03.288109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:15:03.290885 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:03.290842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c16c48d-30ea-4a15-9a07-2e6659bb2474-metrics-certs\") pod \"network-metrics-daemon-zcvn9\" (UID: \"7c16c48d-30ea-4a15-9a07-2e6659bb2474\") " pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:15:03.316200 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:03.316160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-thzvh\"" Jun 11 21:15:03.324180 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:03.324152 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcvn9" Jun 11 21:15:05.325546 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:05.325483 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:05.372722 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:05.372682 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:06.120400 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:06.120354 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:06.172619 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:06.172581 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:11.162173 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.162077 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zcvn9"] Jun 11 21:15:11.164902 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:15:11.164876 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c16c48d_30ea_4a15_9a07_2e6659bb2474.slice/crio-1953002f068cb48934003cd5c9b746e18d2e1526c1149aa206625ac70d232606 WatchSource:0}: Error finding container 1953002f068cb48934003cd5c9b746e18d2e1526c1149aa206625ac70d232606: Status 404 returned error can't find the container with id 1953002f068cb48934003cd5c9b746e18d2e1526c1149aa206625ac70d232606 Jun 11 21:15:11.378756 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.378668 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-szvfg" event={"ID":"ac58a2f2-b700-421d-8144-40de2ee4395c","Type":"ContainerStarted","Data":"0f223704490c95fb41f36937dd868f7e41265f28c4b168c78bcf8e496ecdd3d8"} Jun 11 21:15:11.378922 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.378865 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-szvfg" Jun 11 21:15:11.380523 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.380482 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d95bc94fc-z6msk" event={"ID":"c40d9513-63eb-4047-80bf-949cd3ab139a","Type":"ContainerStarted","Data":"f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041"} Jun 11 21:15:11.381774 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.381749 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zcvn9" event={"ID":"7c16c48d-30ea-4a15-9a07-2e6659bb2474","Type":"ContainerStarted","Data":"1953002f068cb48934003cd5c9b746e18d2e1526c1149aa206625ac70d232606"} Jun 11 21:15:11.385887 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.385863 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-szvfg" Jun 11 21:15:11.396644 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.396587 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-szvfg" podStartSLOduration=1.567250777 podStartE2EDuration="23.396571989s" totalImagesPullingTime="21.829321212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:11.396275843 +0000 UTC m=+260.416876931" watchObservedRunningTime="2026-06-11 21:15:11.396571989 +0000 UTC m=+260.417173076" Jun 11 21:15:11.413381 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.413318 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d95bc94fc-z6msk" podStartSLOduration=1.353386759 podStartE2EDuration="10.41329484s" totalImagesPullingTime="9.059908081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:11.412124344 +0000 UTC m=+260.432725436" watchObservedRunningTime="2026-06-11 21:15:11.41329484 +0000 UTC m=+260.433895930" Jun 11 21:15:11.837963 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.837857 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:11.837963 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.837972 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:11.839333 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.839283 2567 patch_prober.go:28] interesting pod/console-d95bc94fc-z6msk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jun 11 21:15:11.839542 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:11.839341 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-d95bc94fc-z6msk" podUID="c40d9513-63eb-4047-80bf-949cd3ab139a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jun 11 21:15:12.389832 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:12.389755 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zcvn9" event={"ID":"7c16c48d-30ea-4a15-9a07-2e6659bb2474","Type":"ContainerStarted","Data":"4ea08c076bb466f1c05c26d245c9c00e618a7a9e4a8b48be07aa8ab40c5e2531"} Jun 11 21:15:13.397056 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:13.397021 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zcvn9" event={"ID":"7c16c48d-30ea-4a15-9a07-2e6659bb2474","Type":"ContainerStarted","Data":"5526a0fc0eb70cadba872236bff576508454f0368abedf3142b458311e886ef9"} Jun 11 21:15:13.413052 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:13.412998 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zcvn9" podStartSLOduration=261.366042628 podStartE2EDuration="4m22.412977691s" totalImagesPullingTime="1.046935063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:13.411417406 +0000 UTC m=+262.432018495" watchObservedRunningTime="2026-06-11 21:15:13.412977691 +0000 UTC m=+262.433578777" Jun 11 21:15:13.493188 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:13.493151 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:13.558896 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:13.558859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:13.611185 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:13.611139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:17.899981 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:17.899938 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:17.945930 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:17.945888 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:18.713378 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:18.713353 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvvgq_074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e/init-textfile/0.log" Jun 11 21:15:18.915148 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:18.915114 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvvgq_074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e/node-exporter/0.log" Jun 11 21:15:19.113552 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:19.113520 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvvgq_074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e/kube-rbac-proxy/0.log" Jun 11 21:15:19.912746 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:19.912711 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pqt9z_01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9/kube-rbac-proxy-main/0.log" Jun 11 21:15:20.113659 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:20.113630 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pqt9z_01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9/kube-rbac-proxy-self/0.log" Jun 11 21:15:20.313255 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:20.313227 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pqt9z_01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9/openshift-state-metrics/0.log" Jun 11 21:15:21.842020 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:21.841988 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:21.845615 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:21.845591 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:15:21.987152 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:21.987110 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:22.037945 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:22.037907 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:22.089490 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:22.089450 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:22.137141 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:22.137053 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:22.340873 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:22.340841 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:22.440699 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:22.440611 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:23.380837 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:23.380802 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:23.427752 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:23.427708 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:24.113101 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:24.113062 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:24.162724 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:24.162693 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:24.514122 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:24.514046 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d95bc94fc-z6msk_c40d9513-63eb-4047-80bf-949cd3ab139a/console/0.log" Jun 11 21:15:24.716044 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:24.716013 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-szvfg_ac58a2f2-b700-421d-8144-40de2ee4395c/download-server/0.log" Jun 11 21:15:26.312797 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:26.312771 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j255d_7c147e51-b93b-410b-a81a-f5d7c57087e9/dns-node-resolver/0.log" Jun 11 21:15:27.317504 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:27.317476 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hx7mp_344ad448-ef00-4d68-ace8-a0375e86d7bb/node-ca/0.log" Jun 11 21:15:28.113274 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:28.113246 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zsdqt_c844507d-8ab2-40f2-8570-0c08231b4556/serve-healthcheck-canary/0.log" Jun 11 21:15:28.615687 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:28.615655 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:28.718722 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:28.718690 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:28.817999 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:28.817966 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:33.054347 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:15:33.054308 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5hdj2" podUID="51a7e4df-67f9-4904-9c16-6d0cbf47db7d" Jun 11 21:15:33.196955 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:33.196913 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:33.297768 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:33.297734 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:33.472980 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:33.472902 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5hdj2" Jun 11 21:15:34.875048 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:34.875014 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:34.975813 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:34.975779 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:35.076687 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:35.076654 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:36.372447 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:36.372402 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:15:36.374730 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:36.374711 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51a7e4df-67f9-4904-9c16-6d0cbf47db7d-metrics-tls\") pod \"dns-default-5hdj2\" (UID: \"51a7e4df-67f9-4904-9c16-6d0cbf47db7d\") " pod="openshift-dns/dns-default-5hdj2" Jun 11 21:15:36.475579 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:36.475548 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6v9mc\"" Jun 11 21:15:36.484262 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:36.484244 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5hdj2" Jun 11 21:15:36.636254 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:36.635757 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5hdj2"] Jun 11 21:15:36.638404 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:15:36.638378 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a7e4df_67f9_4904_9c16_6d0cbf47db7d.slice/crio-129034bb6298b585db740fcdba9702e86796e9155fdf411a7c2d9a1f77503aed WatchSource:0}: Error finding container 129034bb6298b585db740fcdba9702e86796e9155fdf411a7c2d9a1f77503aed: Status 404 returned error can't find the container with id 129034bb6298b585db740fcdba9702e86796e9155fdf411a7c2d9a1f77503aed Jun 11 21:15:36.719300 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:36.719263 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:36.768601 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:36.768564 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:37.487108 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:37.487070 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5hdj2" event={"ID":"51a7e4df-67f9-4904-9c16-6d0cbf47db7d","Type":"ContainerStarted","Data":"129034bb6298b585db740fcdba9702e86796e9155fdf411a7c2d9a1f77503aed"} Jun 11 21:15:38.382485 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:38.382444 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:38.483201 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:38.483140 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:40.503581 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:40.503548 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5hdj2" event={"ID":"51a7e4df-67f9-4904-9c16-6d0cbf47db7d","Type":"ContainerStarted","Data":"6282249a6dbfb3a9e91f159c9a432fdc9194176548c697f1babc4079f45626c4"} Jun 11 21:15:40.504003 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:40.503624 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5hdj2" event={"ID":"51a7e4df-67f9-4904-9c16-6d0cbf47db7d","Type":"ContainerStarted","Data":"4f6a837202733b81872c5c15435189cdd268dd681980229c191faf5e0e91e4a7"} Jun 11 21:15:40.504003 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:40.503708 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5hdj2" Jun 11 21:15:40.520207 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:40.520153 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5hdj2" podStartSLOduration=251.723521646 podStartE2EDuration="4m14.520138933s" totalImagesPullingTime="2.796617287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:15:40.518664308 +0000 UTC m=+289.539265407" watchObservedRunningTime="2026-06-11 21:15:40.520138933 +0000 UTC m=+289.540740020" Jun 11 21:15:41.941844 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:41.941812 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:42.041278 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:42.041241 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:50.508220 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:50.508191 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5hdj2" Jun 11 21:15:51.359799 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:51.359772 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:15:51.359993 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:51.359966 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:15:51.362972 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:51.362949 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 21:15:53.380080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:53.380044 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:53.431020 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:53.430985 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:54.733984 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:54.733947 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:54.834323 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:54.834277 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:54.935729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:54.935685 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:59.635273 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:15:59.635236 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:02.985075 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:02.985041 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:03.034497 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:03.034459 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:06.123383 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:06.123351 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:06.406804 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:06.406719 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:08.378787 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:08.378745 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:08.445880 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:08.445831 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:12.236380 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:12.236344 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:15.618722 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:15.618685 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:15.665407 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:15.665372 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:23.376340 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:23.376299 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:23.423338 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:23.423303 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:26.916084 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:26.916055 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d95bc94fc-z6msk"] Jun 11 21:16:27.014880 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:27.014842 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:27.067042 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:27.067015 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:27.117667 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:27.117638 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:43.681693 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:43.681632 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:43.730752 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:43.730718 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:51.935079 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:51.935017 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d95bc94fc-z6msk" podUID="c40d9513-63eb-4047-80bf-949cd3ab139a" containerName="console" containerID="cri-o://f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041" gracePeriod=15 Jun 11 21:16:52.164656 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.164630 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:16:52.313120 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313088 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-oauth-config\") pod \"c40d9513-63eb-4047-80bf-949cd3ab139a\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " Jun 11 21:16:52.313281 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313142 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-oauth-serving-cert\") pod \"c40d9513-63eb-4047-80bf-949cd3ab139a\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " Jun 11 21:16:52.313281 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313167 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-trusted-ca-bundle\") pod \"c40d9513-63eb-4047-80bf-949cd3ab139a\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " Jun 11 21:16:52.313281 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313184 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-service-ca\") pod \"c40d9513-63eb-4047-80bf-949cd3ab139a\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " Jun 11 21:16:52.313281 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313209 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9rsp\" (UniqueName: \"kubernetes.io/projected/c40d9513-63eb-4047-80bf-949cd3ab139a-kube-api-access-v9rsp\") pod \"c40d9513-63eb-4047-80bf-949cd3ab139a\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " Jun 11 21:16:52.313281 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313227 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-console-config\") pod \"c40d9513-63eb-4047-80bf-949cd3ab139a\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " Jun 11 21:16:52.313281 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313267 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-serving-cert\") pod \"c40d9513-63eb-4047-80bf-949cd3ab139a\" (UID: \"c40d9513-63eb-4047-80bf-949cd3ab139a\") " Jun 11 21:16:52.313745 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313694 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-console-config" (OuterVolumeSpecName: "console-config") pod "c40d9513-63eb-4047-80bf-949cd3ab139a" (UID: "c40d9513-63eb-4047-80bf-949cd3ab139a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:16:52.313745 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313707 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-service-ca" (OuterVolumeSpecName: "service-ca") pod "c40d9513-63eb-4047-80bf-949cd3ab139a" (UID: "c40d9513-63eb-4047-80bf-949cd3ab139a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:16:52.313745 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313702 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c40d9513-63eb-4047-80bf-949cd3ab139a" (UID: "c40d9513-63eb-4047-80bf-949cd3ab139a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:16:52.313956 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.313772 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c40d9513-63eb-4047-80bf-949cd3ab139a" (UID: "c40d9513-63eb-4047-80bf-949cd3ab139a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:16:52.315446 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.315408 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c40d9513-63eb-4047-80bf-949cd3ab139a-kube-api-access-v9rsp" (OuterVolumeSpecName: "kube-api-access-v9rsp") pod "c40d9513-63eb-4047-80bf-949cd3ab139a" (UID: "c40d9513-63eb-4047-80bf-949cd3ab139a"). InnerVolumeSpecName "kube-api-access-v9rsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:16:52.315545 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.315469 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c40d9513-63eb-4047-80bf-949cd3ab139a" (UID: "c40d9513-63eb-4047-80bf-949cd3ab139a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:16:52.315545 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.315497 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c40d9513-63eb-4047-80bf-949cd3ab139a" (UID: "c40d9513-63eb-4047-80bf-949cd3ab139a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:16:52.414533 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.414502 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9rsp\" (UniqueName: \"kubernetes.io/projected/c40d9513-63eb-4047-80bf-949cd3ab139a-kube-api-access-v9rsp\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:16:52.414533 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.414529 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-console-config\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:16:52.414533 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.414539 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-serving-cert\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:16:52.414752 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.414550 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c40d9513-63eb-4047-80bf-949cd3ab139a-console-oauth-config\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:16:52.414752 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.414559 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-oauth-serving-cert\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:16:52.414752 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.414568 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-trusted-ca-bundle\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:16:52.414752 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.414576 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c40d9513-63eb-4047-80bf-949cd3ab139a-service-ca\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:16:52.744524 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.744441 2567 generic.go:356] "Generic (PLEG): container finished" podID="c40d9513-63eb-4047-80bf-949cd3ab139a" containerID="f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041" exitCode=0 Jun 11 21:16:52.744524 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.744490 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d95bc94fc-z6msk" Jun 11 21:16:52.744702 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.744521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d95bc94fc-z6msk" event={"ID":"c40d9513-63eb-4047-80bf-949cd3ab139a","Type":"ContainerDied","Data":"f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041"} Jun 11 21:16:52.744702 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.744564 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d95bc94fc-z6msk" event={"ID":"c40d9513-63eb-4047-80bf-949cd3ab139a","Type":"ContainerDied","Data":"1dfd74783a9c383817733efa080391fe2178e3d9b494746f0190d878c342ae76"} Jun 11 21:16:52.744702 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.744584 2567 scope.go:117] "RemoveContainer" containerID="f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041" Jun 11 21:16:52.752808 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.752790 2567 scope.go:117] "RemoveContainer" containerID="f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041" Jun 11 21:16:52.753079 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:16:52.753062 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041\": container with ID starting with f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041 not found: ID does not exist" containerID="f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041" Jun 11 21:16:52.753149 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.753086 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041"} err="failed to get container status \"f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041\": rpc error: code = NotFound desc = could not find container \"f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041\": container with ID starting with f5b6a43fd3ca7908e2cb272f949db0c348c0b40608bfdb761c69f9d3f1145041 not found: ID does not exist" Jun 11 21:16:52.763494 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.763473 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d95bc94fc-z6msk"] Jun 11 21:16:52.767212 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:52.767193 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d95bc94fc-z6msk"] Jun 11 21:16:53.415291 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:16:53.415259 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c40d9513-63eb-4047-80bf-949cd3ab139a" path="/var/lib/kubelet/pods/c40d9513-63eb-4047-80bf-949cd3ab139a/volumes" Jun 11 21:17:21.379252 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:21.379202 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:21.432705 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:21.432672 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:29.383241 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:29.383206 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:29.433121 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:29.433072 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:29.535752 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:29.535715 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:29.579802 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:29.579773 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:30.128155 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:30.128127 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:30.228353 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:30.228321 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:33.186765 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:33.186725 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:33.236110 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:33.236076 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:38.386991 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:38.386956 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:38.486510 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:38.486474 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:38.535121 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:38.535091 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:38.815252 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:38.815218 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:40.320606 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:40.320571 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:40.379215 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:40.379178 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:40.431754 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:40.431721 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:59.539347 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:17:59.539302 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:09.525524 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:09.525488 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:09.572162 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:09.572118 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:35.969468 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:35.969417 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:37.307304 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:37.307266 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:37.899178 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:37.899143 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z"] Jun 11 21:18:37.899468 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:37.899444 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c40d9513-63eb-4047-80bf-949cd3ab139a" containerName="console" Jun 11 21:18:37.899468 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:37.899465 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c40d9513-63eb-4047-80bf-949cd3ab139a" containerName="console" Jun 11 21:18:37.899622 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:37.899520 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c40d9513-63eb-4047-80bf-949cd3ab139a" containerName="console" Jun 11 21:18:37.902271 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:37.902255 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" Jun 11 21:18:37.904684 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:37.904661 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-srjch\"" Jun 11 21:18:37.904809 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:37.904703 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:18:37.904809 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:37.904767 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 21:18:37.917048 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:37.916561 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z"] Jun 11 21:18:38.047219 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:38.047180 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75a4e815-adbb-4c12-93e5-18207c98ef08-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wsj8z\" (UID: \"75a4e815-adbb-4c12-93e5-18207c98ef08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" Jun 11 21:18:38.047219 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:38.047221 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kjgd\" (UniqueName: \"kubernetes.io/projected/75a4e815-adbb-4c12-93e5-18207c98ef08-kube-api-access-5kjgd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wsj8z\" (UID: \"75a4e815-adbb-4c12-93e5-18207c98ef08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" Jun 11 21:18:38.147703 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:38.147650 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75a4e815-adbb-4c12-93e5-18207c98ef08-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wsj8z\" (UID: \"75a4e815-adbb-4c12-93e5-18207c98ef08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" Jun 11 21:18:38.147703 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:38.147711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kjgd\" (UniqueName: \"kubernetes.io/projected/75a4e815-adbb-4c12-93e5-18207c98ef08-kube-api-access-5kjgd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wsj8z\" (UID: \"75a4e815-adbb-4c12-93e5-18207c98ef08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" Jun 11 21:18:38.148056 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:38.148033 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75a4e815-adbb-4c12-93e5-18207c98ef08-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wsj8z\" (UID: \"75a4e815-adbb-4c12-93e5-18207c98ef08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" Jun 11 21:18:38.158066 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:38.158017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kjgd\" (UniqueName: \"kubernetes.io/projected/75a4e815-adbb-4c12-93e5-18207c98ef08-kube-api-access-5kjgd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wsj8z\" (UID: \"75a4e815-adbb-4c12-93e5-18207c98ef08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" Jun 11 21:18:38.211038 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:38.211003 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" Jun 11 21:18:38.354994 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:38.354959 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z"] Jun 11 21:18:38.358591 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:18:38.358567 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a4e815_adbb_4c12_93e5_18207c98ef08.slice/crio-68cf2fca7d8f22147e0859f0954a8c218f20b0bdfca55b484a4fe5046b91f93d WatchSource:0}: Error finding container 68cf2fca7d8f22147e0859f0954a8c218f20b0bdfca55b484a4fe5046b91f93d: Status 404 returned error can't find the container with id 68cf2fca7d8f22147e0859f0954a8c218f20b0bdfca55b484a4fe5046b91f93d Jun 11 21:18:38.361126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:38.361113 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:18:39.096244 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:39.096177 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" event={"ID":"75a4e815-adbb-4c12-93e5-18207c98ef08","Type":"ContainerStarted","Data":"68cf2fca7d8f22147e0859f0954a8c218f20b0bdfca55b484a4fe5046b91f93d"} Jun 11 21:18:39.568611 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:39.568570 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:39.668171 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:39.668130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:41.105088 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:41.104985 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" event={"ID":"75a4e815-adbb-4c12-93e5-18207c98ef08","Type":"ContainerStarted","Data":"a9f9201b57ebc470856c2434ec3a295702e1ea5d76fb7668154886d809549b6a"} Jun 11 21:18:41.125625 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:41.125561 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wsj8z" podStartSLOduration=1.674982407 podStartE2EDuration="4.125541322s" totalImagesPullingTime="2.450558915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:18:41.12352181 +0000 UTC m=+470.144122901" watchObservedRunningTime="2026-06-11 21:18:41.125541322 +0000 UTC m=+470.146142414" Jun 11 21:18:41.479248 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:41.479166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:41.589293 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:41.589235 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:41.707597 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:41.707560 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:41.810209 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:41.810175 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:45.167067 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:45.167031 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:45.573053 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:45.573007 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:46.554391 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:46.554356 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:46.603361 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:46.603324 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:50.437341 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:50.437300 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:50.537643 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:50.537609 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:52.759713 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:52.759680 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:54.236919 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:54.236886 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:54.336665 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:54.336621 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:18:56.008465 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.008414 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln"] Jun 11 21:18:56.011572 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.011555 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" Jun 11 21:18:56.014654 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.014630 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zbhbg\"" Jun 11 21:18:56.014775 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.014630 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:18:56.015539 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.015525 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 21:18:56.022110 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.022090 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln"] Jun 11 21:18:56.187246 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.187214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xxw8\" (UniqueName: \"kubernetes.io/projected/6468f3c8-8f85-442f-9bcb-5f0c8885a200-kube-api-access-8xxw8\") pod \"openshift-lws-operator-fd8ccff4c-2xmln\" (UID: \"6468f3c8-8f85-442f-9bcb-5f0c8885a200\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" Jun 11 21:18:56.187415 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.187286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6468f3c8-8f85-442f-9bcb-5f0c8885a200-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2xmln\" (UID: \"6468f3c8-8f85-442f-9bcb-5f0c8885a200\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" Jun 11 21:18:56.288374 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.288342 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6468f3c8-8f85-442f-9bcb-5f0c8885a200-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2xmln\" (UID: \"6468f3c8-8f85-442f-9bcb-5f0c8885a200\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" Jun 11 21:18:56.288505 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.288390 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xxw8\" (UniqueName: \"kubernetes.io/projected/6468f3c8-8f85-442f-9bcb-5f0c8885a200-kube-api-access-8xxw8\") pod \"openshift-lws-operator-fd8ccff4c-2xmln\" (UID: \"6468f3c8-8f85-442f-9bcb-5f0c8885a200\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" Jun 11 21:18:56.288737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.288718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6468f3c8-8f85-442f-9bcb-5f0c8885a200-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2xmln\" (UID: \"6468f3c8-8f85-442f-9bcb-5f0c8885a200\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" Jun 11 21:18:56.296494 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.296473 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xxw8\" (UniqueName: \"kubernetes.io/projected/6468f3c8-8f85-442f-9bcb-5f0c8885a200-kube-api-access-8xxw8\") pod \"openshift-lws-operator-fd8ccff4c-2xmln\" (UID: \"6468f3c8-8f85-442f-9bcb-5f0c8885a200\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" Jun 11 21:18:56.320577 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.320541 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" Jun 11 21:18:56.442660 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:56.442630 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln"] Jun 11 21:18:56.446082 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:18:56.446049 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6468f3c8_8f85_442f_9bcb_5f0c8885a200.slice/crio-3aa7f077aa36d1b148e00b8b13638d0c51c01043d776a439b40c1d489fca29ad WatchSource:0}: Error finding container 3aa7f077aa36d1b148e00b8b13638d0c51c01043d776a439b40c1d489fca29ad: Status 404 returned error can't find the container with id 3aa7f077aa36d1b148e00b8b13638d0c51c01043d776a439b40c1d489fca29ad Jun 11 21:18:57.159952 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:18:57.159910 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" event={"ID":"6468f3c8-8f85-442f-9bcb-5f0c8885a200","Type":"ContainerStarted","Data":"3aa7f077aa36d1b148e00b8b13638d0c51c01043d776a439b40c1d489fca29ad"} Jun 11 21:19:00.173796 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:00.173758 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" event={"ID":"6468f3c8-8f85-442f-9bcb-5f0c8885a200","Type":"ContainerStarted","Data":"fcbed66c7e0bf356560ae328694728a5a3ccb7c2b206bc0d65674bdafaaac616"} Jun 11 21:19:00.189180 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:00.189127 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2xmln" podStartSLOduration=2.051481982 podStartE2EDuration="5.189110918s" totalImagesPullingTime="3.137628936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:00.188082665 +0000 UTC m=+489.208683753" watchObservedRunningTime="2026-06-11 21:19:00.189110918 +0000 UTC m=+489.209712006" Jun 11 21:19:00.780533 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:00.780496 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:00.880535 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:00.880503 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:02.553354 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:02.553314 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:18.404298 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:18.404265 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:19.363021 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.362983 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv"] Jun 11 21:19:19.369169 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.369148 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.371769 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.371749 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 21:19:19.371999 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.371975 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 21:19:19.372123 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.372103 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 21:19:19.372216 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.372199 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9ssfh\"" Jun 11 21:19:19.372394 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.372379 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 21:19:19.381557 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.381536 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv"] Jun 11 21:19:19.444984 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.444951 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:19.454048 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.454024 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d99b357-63d3-4624-a11e-28ce7e990a44-tmp\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.454153 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.454055 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0d99b357-63d3-4624-a11e-28ce7e990a44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.454153 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.454074 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d99b357-63d3-4624-a11e-28ce7e990a44-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.454230 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.454158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0d99b357-63d3-4624-a11e-28ce7e990a44-manifests\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.454230 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.454187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkxmv\" (UniqueName: \"kubernetes.io/projected/0d99b357-63d3-4624-a11e-28ce7e990a44-kube-api-access-gkxmv\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.538957 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.538915 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:19.554970 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.554934 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d99b357-63d3-4624-a11e-28ce7e990a44-tmp\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.555131 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.554987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0d99b357-63d3-4624-a11e-28ce7e990a44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.555131 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.555020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d99b357-63d3-4624-a11e-28ce7e990a44-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.555131 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.555070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0d99b357-63d3-4624-a11e-28ce7e990a44-manifests\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.555131 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.555106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkxmv\" (UniqueName: \"kubernetes.io/projected/0d99b357-63d3-4624-a11e-28ce7e990a44-kube-api-access-gkxmv\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.555523 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.555495 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0d99b357-63d3-4624-a11e-28ce7e990a44-manifests\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.557206 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.557178 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d99b357-63d3-4624-a11e-28ce7e990a44-tmp\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.557591 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.557567 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d99b357-63d3-4624-a11e-28ce7e990a44-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.557667 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.557612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0d99b357-63d3-4624-a11e-28ce7e990a44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.564568 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.564546 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkxmv\" (UniqueName: \"kubernetes.io/projected/0d99b357-63d3-4624-a11e-28ce7e990a44-kube-api-access-gkxmv\") pod \"opendatahub-operator-controller-manager-66c5c8d746-65vjv\" (UID: \"0d99b357-63d3-4624-a11e-28ce7e990a44\") " pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.638893 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.638810 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:19.679198 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.679162 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:19.748201 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.748169 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:19.824336 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.824307 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv"] Jun 11 21:19:19.840949 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:19:19.840923 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d99b357_63d3_4624_a11e_28ce7e990a44.slice/crio-f93b11afa99c8c2f832ecf1084202ea0ea8ddb1d329e43c31840b035fa0cc760 WatchSource:0}: Error finding container f93b11afa99c8c2f832ecf1084202ea0ea8ddb1d329e43c31840b035fa0cc760: Status 404 returned error can't find the container with id f93b11afa99c8c2f832ecf1084202ea0ea8ddb1d329e43c31840b035fa0cc760 Jun 11 21:19:19.858172 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.858148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:19.962985 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:19.962898 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:20.059622 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:20.059567 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:20.249813 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:20.249724 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" event={"ID":"0d99b357-63d3-4624-a11e-28ce7e990a44","Type":"ContainerStarted","Data":"f93b11afa99c8c2f832ecf1084202ea0ea8ddb1d329e43c31840b035fa0cc760"} Jun 11 21:19:23.265329 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:23.265287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" event={"ID":"0d99b357-63d3-4624-a11e-28ce7e990a44","Type":"ContainerStarted","Data":"7539ce102d8d7654e96770eef8063fed1009aa371b3a193600dd6f4360e04cf2"} Jun 11 21:19:24.270958 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:24.270910 2567 generic.go:356] "Generic (PLEG): container finished" podID="0d99b357-63d3-4624-a11e-28ce7e990a44" containerID="7539ce102d8d7654e96770eef8063fed1009aa371b3a193600dd6f4360e04cf2" exitCode=0 Jun 11 21:19:24.271324 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:24.270978 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" event={"ID":"0d99b357-63d3-4624-a11e-28ce7e990a44","Type":"ContainerDied","Data":"7539ce102d8d7654e96770eef8063fed1009aa371b3a193600dd6f4360e04cf2"} Jun 11 21:19:25.277121 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:25.277081 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" event={"ID":"0d99b357-63d3-4624-a11e-28ce7e990a44","Type":"ContainerStarted","Data":"05791e466e9c62e275114b1f8ddaf70ee5cd965fe142b840d2cbd817aa01335a"} Jun 11 21:19:25.277528 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:25.277192 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:25.296559 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:25.296504 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" podStartSLOduration=2.270584889 podStartE2EDuration="6.296489491s" totalImagesPullingTime="3.027312704s" totalInitContainerRuntime="998.591898ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:25.295133197 +0000 UTC m=+514.315734284" watchObservedRunningTime="2026-06-11 21:19:25.296489491 +0000 UTC m=+514.317090577" Jun 11 21:19:28.710424 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:28.710366 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:28.762649 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:28.762608 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:36.283236 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:36.283204 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66c5c8d746-65vjv" Jun 11 21:19:38.328363 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:38.328329 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:38.425987 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:38.425940 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:38.902292 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:38.902255 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4mw4r"] Jun 11 21:19:38.905800 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:38.905760 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" Jun 11 21:19:38.907996 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:38.907971 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 21:19:38.908266 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:38.908252 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lmrw6\"" Jun 11 21:19:38.914747 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:38.914717 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4mw4r"] Jun 11 21:19:38.939604 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:38.939576 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:38.992363 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:38.992330 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm6r2\" (UniqueName: \"kubernetes.io/projected/1310efed-aba6-48ba-9cdb-97a5ef818dbb-kube-api-access-xm6r2\") pod \"odh-model-controller-6dc94f689f-4mw4r\" (UID: \"1310efed-aba6-48ba-9cdb-97a5ef818dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" Jun 11 21:19:38.992543 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:38.992391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1310efed-aba6-48ba-9cdb-97a5ef818dbb-cert\") pod \"odh-model-controller-6dc94f689f-4mw4r\" (UID: \"1310efed-aba6-48ba-9cdb-97a5ef818dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" Jun 11 21:19:39.032721 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.032690 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:39.092911 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.092883 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm6r2\" (UniqueName: \"kubernetes.io/projected/1310efed-aba6-48ba-9cdb-97a5ef818dbb-kube-api-access-xm6r2\") pod \"odh-model-controller-6dc94f689f-4mw4r\" (UID: \"1310efed-aba6-48ba-9cdb-97a5ef818dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" Jun 11 21:19:39.093080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.092925 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1310efed-aba6-48ba-9cdb-97a5ef818dbb-cert\") pod \"odh-model-controller-6dc94f689f-4mw4r\" (UID: \"1310efed-aba6-48ba-9cdb-97a5ef818dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" Jun 11 21:19:39.095403 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.095371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1310efed-aba6-48ba-9cdb-97a5ef818dbb-cert\") pod \"odh-model-controller-6dc94f689f-4mw4r\" (UID: \"1310efed-aba6-48ba-9cdb-97a5ef818dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" Jun 11 21:19:39.101383 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.101355 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm6r2\" (UniqueName: \"kubernetes.io/projected/1310efed-aba6-48ba-9cdb-97a5ef818dbb-kube-api-access-xm6r2\") pod \"odh-model-controller-6dc94f689f-4mw4r\" (UID: \"1310efed-aba6-48ba-9cdb-97a5ef818dbb\") " pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" Jun 11 21:19:39.137045 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.137015 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:39.216680 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.216599 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" Jun 11 21:19:39.356819 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.356784 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4mw4r"] Jun 11 21:19:39.359845 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:19:39.359817 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1310efed_aba6_48ba_9cdb_97a5ef818dbb.slice/crio-3a0b7dbea7bfdf20ac500c365aa91f75c638791b67761a517b5eb22f62fd80e2 WatchSource:0}: Error finding container 3a0b7dbea7bfdf20ac500c365aa91f75c638791b67761a517b5eb22f62fd80e2: Status 404 returned error can't find the container with id 3a0b7dbea7bfdf20ac500c365aa91f75c638791b67761a517b5eb22f62fd80e2 Jun 11 21:19:39.404910 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.404877 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-r2kvq"] Jun 11 21:19:39.409055 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.409033 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:39.410626 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.410582 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:39.411353 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.411334 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 21:19:39.418496 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.418470 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-r2kvq"] Jun 11 21:19:39.495525 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.495416 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhj54\" (UniqueName: \"kubernetes.io/projected/52ab61ca-d1cd-4547-996b-4ddbaa98a5d7-kube-api-access-lhj54\") pod \"model-serving-api-5dd488fc48-r2kvq\" (UID: \"52ab61ca-d1cd-4547-996b-4ddbaa98a5d7\") " pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:39.495525 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.495507 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52ab61ca-d1cd-4547-996b-4ddbaa98a5d7-tls-certs\") pod \"model-serving-api-5dd488fc48-r2kvq\" (UID: \"52ab61ca-d1cd-4547-996b-4ddbaa98a5d7\") " pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:39.596669 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.596630 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhj54\" (UniqueName: \"kubernetes.io/projected/52ab61ca-d1cd-4547-996b-4ddbaa98a5d7-kube-api-access-lhj54\") pod \"model-serving-api-5dd488fc48-r2kvq\" (UID: \"52ab61ca-d1cd-4547-996b-4ddbaa98a5d7\") " pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:39.596831 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.596699 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52ab61ca-d1cd-4547-996b-4ddbaa98a5d7-tls-certs\") pod \"model-serving-api-5dd488fc48-r2kvq\" (UID: \"52ab61ca-d1cd-4547-996b-4ddbaa98a5d7\") " pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:39.596869 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:19:39.596849 2567 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 21:19:39.596940 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:19:39.596928 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ab61ca-d1cd-4547-996b-4ddbaa98a5d7-tls-certs podName:52ab61ca-d1cd-4547-996b-4ddbaa98a5d7 nodeName:}" failed. No retries permitted until 2026-06-11 21:19:40.096911294 +0000 UTC m=+529.117512367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/52ab61ca-d1cd-4547-996b-4ddbaa98a5d7-tls-certs") pod "model-serving-api-5dd488fc48-r2kvq" (UID: "52ab61ca-d1cd-4547-996b-4ddbaa98a5d7") : secret "model-serving-api-tls" not found Jun 11 21:19:39.610258 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:39.610234 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhj54\" (UniqueName: \"kubernetes.io/projected/52ab61ca-d1cd-4547-996b-4ddbaa98a5d7-kube-api-access-lhj54\") pod \"model-serving-api-5dd488fc48-r2kvq\" (UID: \"52ab61ca-d1cd-4547-996b-4ddbaa98a5d7\") " pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:40.013663 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:40.013583 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:40.102198 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:40.102140 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52ab61ca-d1cd-4547-996b-4ddbaa98a5d7-tls-certs\") pod \"model-serving-api-5dd488fc48-r2kvq\" (UID: \"52ab61ca-d1cd-4547-996b-4ddbaa98a5d7\") " pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:40.105489 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:40.105413 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52ab61ca-d1cd-4547-996b-4ddbaa98a5d7-tls-certs\") pod \"model-serving-api-5dd488fc48-r2kvq\" (UID: \"52ab61ca-d1cd-4547-996b-4ddbaa98a5d7\") " pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:40.320712 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:40.320591 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:40.342393 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:40.342354 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" event={"ID":"1310efed-aba6-48ba-9cdb-97a5ef818dbb","Type":"ContainerStarted","Data":"3a0b7dbea7bfdf20ac500c365aa91f75c638791b67761a517b5eb22f62fd80e2"} Jun 11 21:19:40.473814 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:40.473761 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-r2kvq"] Jun 11 21:19:40.477239 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:19:40.477209 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ab61ca_d1cd_4547_996b_4ddbaa98a5d7.slice/crio-0541961af56e826490a5fe34f963fa0c513aa679d341037cc82492ca879be722 WatchSource:0}: Error finding container 0541961af56e826490a5fe34f963fa0c513aa679d341037cc82492ca879be722: Status 404 returned error can't find the container with id 0541961af56e826490a5fe34f963fa0c513aa679d341037cc82492ca879be722 Jun 11 21:19:41.350021 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:41.349944 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" event={"ID":"52ab61ca-d1cd-4547-996b-4ddbaa98a5d7","Type":"ContainerStarted","Data":"0541961af56e826490a5fe34f963fa0c513aa679d341037cc82492ca879be722"} Jun 11 21:19:44.000765 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.000681 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:44.102031 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.101997 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:44.131267 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.131230 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5"] Jun 11 21:19:44.135131 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.135106 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:44.143008 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.141880 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 21:19:44.143008 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.142944 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 21:19:44.143455 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.143409 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-64wjp\"" Jun 11 21:19:44.147600 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.143631 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 21:19:44.147846 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.143725 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 21:19:44.149094 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.148929 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5"] Jun 11 21:19:44.243960 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.243926 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tmp\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:44.244160 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.243983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4r2w\" (UniqueName: \"kubernetes.io/projected/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-kube-api-access-q4r2w\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:44.244160 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.244061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tls-certs\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:44.344661 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.344626 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tls-certs\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:44.344844 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.344694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tmp\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:44.344844 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.344733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4r2w\" (UniqueName: \"kubernetes.io/projected/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-kube-api-access-q4r2w\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:44.344844 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:19:44.344798 2567 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 21:19:44.345020 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:19:44.344892 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tls-certs podName:39ab0555-80f0-4072-8fe7-e9b35a9ac0fe nodeName:}" failed. No retries permitted until 2026-06-11 21:19:44.844870396 +0000 UTC m=+533.865471460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tls-certs") pod "kube-auth-proxy-6c9dfcd5c9-5k9z5" (UID: "39ab0555-80f0-4072-8fe7-e9b35a9ac0fe") : secret "kube-auth-proxy-tls" not found Jun 11 21:19:44.347166 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.347136 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tmp\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:44.354451 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.354411 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4r2w\" (UniqueName: \"kubernetes.io/projected/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-kube-api-access-q4r2w\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:44.365498 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.365470 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" event={"ID":"52ab61ca-d1cd-4547-996b-4ddbaa98a5d7","Type":"ContainerStarted","Data":"e8fe580372b1d1e1f8182965dfabdb4236e89b869f8dfb6f96d0dc43bfeb60c3"} Jun 11 21:19:44.365629 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.365535 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:44.367030 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.367007 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" event={"ID":"1310efed-aba6-48ba-9cdb-97a5ef818dbb","Type":"ContainerStarted","Data":"c925cb5699c1fa7a4751341ce91e7d80091273521fe2759b1916a4bbf9ec612f"} Jun 11 21:19:44.367129 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.367115 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" Jun 11 21:19:44.380700 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.380657 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" podStartSLOduration=2.102771346 podStartE2EDuration="5.380641999s" totalImagesPullingTime="3.277870653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:44.379940238 +0000 UTC m=+533.400541325" watchObservedRunningTime="2026-06-11 21:19:44.380641999 +0000 UTC m=+533.401243085" Jun 11 21:19:44.394159 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.394112 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" podStartSLOduration=2.039314787 podStartE2EDuration="6.394096383s" totalImagesPullingTime="4.354781596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:44.393278373 +0000 UTC m=+533.413879458" watchObservedRunningTime="2026-06-11 21:19:44.394096383 +0000 UTC m=+533.414697469" Jun 11 21:19:44.850760 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:44.850722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tls-certs\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:44.850931 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:19:44.850868 2567 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 21:19:44.850977 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:19:44.850939 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tls-certs podName:39ab0555-80f0-4072-8fe7-e9b35a9ac0fe nodeName:}" failed. No retries permitted until 2026-06-11 21:19:45.850923647 +0000 UTC m=+534.871524712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tls-certs") pod "kube-auth-proxy-6c9dfcd5c9-5k9z5" (UID: "39ab0555-80f0-4072-8fe7-e9b35a9ac0fe") : secret "kube-auth-proxy-tls" not found Jun 11 21:19:45.136775 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:45.136687 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:45.858189 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:45.858153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tls-certs\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:45.860574 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:45.860556 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39ab0555-80f0-4072-8fe7-e9b35a9ac0fe-tls-certs\") pod \"kube-auth-proxy-6c9dfcd5c9-5k9z5\" (UID: \"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe\") " pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:45.951402 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:45.951372 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" Jun 11 21:19:46.082036 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:46.081999 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5"] Jun 11 21:19:46.085003 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:19:46.084975 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ab0555_80f0_4072_8fe7_e9b35a9ac0fe.slice/crio-f78269025ee53412f35daa86c1fdb618df59d397796a23e2cacf295762d8a17e WatchSource:0}: Error finding container f78269025ee53412f35daa86c1fdb618df59d397796a23e2cacf295762d8a17e: Status 404 returned error can't find the container with id f78269025ee53412f35daa86c1fdb618df59d397796a23e2cacf295762d8a17e Jun 11 21:19:46.377277 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:46.377243 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" event={"ID":"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe","Type":"ContainerStarted","Data":"f78269025ee53412f35daa86c1fdb618df59d397796a23e2cacf295762d8a17e"} Jun 11 21:19:48.883565 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.883509 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:48.931223 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.931190 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-kw6sx"] Jun 11 21:19:48.935645 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.935620 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" Jun 11 21:19:48.938293 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.938269 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 21:19:48.938293 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.938269 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jqzfn\"" Jun 11 21:19:48.939265 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.939245 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58"] Jun 11 21:19:48.942606 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.942587 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" Jun 11 21:19:48.944967 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.944948 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 21:19:48.945062 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.944952 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fk894\"" Jun 11 21:19:48.945473 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.945450 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-kw6sx"] Jun 11 21:19:48.955675 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.955652 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58"] Jun 11 21:19:48.974749 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.974721 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:48.983019 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.982998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8tc6\" (UniqueName: \"kubernetes.io/projected/f384d18e-489c-491a-bb58-4940102bf98a-kube-api-access-t8tc6\") pod \"kserve-controller-manager-69fc866d76-kw6sx\" (UID: \"f384d18e-489c-491a-bb58-4940102bf98a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" Jun 11 21:19:48.983137 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:48.983060 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f384d18e-489c-491a-bb58-4940102bf98a-cert\") pod \"kserve-controller-manager-69fc866d76-kw6sx\" (UID: \"f384d18e-489c-491a-bb58-4940102bf98a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" Jun 11 21:19:49.083658 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.083622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85086d2c-035e-4410-b669-f74e32ac7027-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-tnb58\" (UID: \"85086d2c-035e-4410-b669-f74e32ac7027\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" Jun 11 21:19:49.083826 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.083667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f384d18e-489c-491a-bb58-4940102bf98a-cert\") pod \"kserve-controller-manager-69fc866d76-kw6sx\" (UID: \"f384d18e-489c-491a-bb58-4940102bf98a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" Jun 11 21:19:49.083826 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.083691 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2h7q\" (UniqueName: \"kubernetes.io/projected/85086d2c-035e-4410-b669-f74e32ac7027-kube-api-access-v2h7q\") pod \"llmisvc-controller-manager-864bfd7bc9-tnb58\" (UID: \"85086d2c-035e-4410-b669-f74e32ac7027\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" Jun 11 21:19:49.083826 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.083789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8tc6\" (UniqueName: \"kubernetes.io/projected/f384d18e-489c-491a-bb58-4940102bf98a-kube-api-access-t8tc6\") pod \"kserve-controller-manager-69fc866d76-kw6sx\" (UID: \"f384d18e-489c-491a-bb58-4940102bf98a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" Jun 11 21:19:49.086341 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.086310 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f384d18e-489c-491a-bb58-4940102bf98a-cert\") pod \"kserve-controller-manager-69fc866d76-kw6sx\" (UID: \"f384d18e-489c-491a-bb58-4940102bf98a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" Jun 11 21:19:49.094170 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.094142 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8tc6\" (UniqueName: \"kubernetes.io/projected/f384d18e-489c-491a-bb58-4940102bf98a-kube-api-access-t8tc6\") pod \"kserve-controller-manager-69fc866d76-kw6sx\" (UID: \"f384d18e-489c-491a-bb58-4940102bf98a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" Jun 11 21:19:49.124699 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.124658 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:49.184939 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.184854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85086d2c-035e-4410-b669-f74e32ac7027-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-tnb58\" (UID: \"85086d2c-035e-4410-b669-f74e32ac7027\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" Jun 11 21:19:49.184939 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.184903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2h7q\" (UniqueName: \"kubernetes.io/projected/85086d2c-035e-4410-b669-f74e32ac7027-kube-api-access-v2h7q\") pod \"llmisvc-controller-manager-864bfd7bc9-tnb58\" (UID: \"85086d2c-035e-4410-b669-f74e32ac7027\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" Jun 11 21:19:49.187465 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.187420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85086d2c-035e-4410-b669-f74e32ac7027-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-tnb58\" (UID: \"85086d2c-035e-4410-b669-f74e32ac7027\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" Jun 11 21:19:49.196930 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.196896 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2h7q\" (UniqueName: \"kubernetes.io/projected/85086d2c-035e-4410-b669-f74e32ac7027-kube-api-access-v2h7q\") pod \"llmisvc-controller-manager-864bfd7bc9-tnb58\" (UID: \"85086d2c-035e-4410-b669-f74e32ac7027\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" Jun 11 21:19:49.227923 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.227883 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:49.246763 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.246741 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" Jun 11 21:19:49.257108 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.256955 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" Jun 11 21:19:49.401855 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.401819 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-kw6sx"] Jun 11 21:19:49.405843 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:19:49.405809 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf384d18e_489c_491a_bb58_4940102bf98a.slice/crio-8f4941f074d71fd67cc532360e97065313af97f5988a17840bce745a7fdfdc63 WatchSource:0}: Error finding container 8f4941f074d71fd67cc532360e97065313af97f5988a17840bce745a7fdfdc63: Status 404 returned error can't find the container with id 8f4941f074d71fd67cc532360e97065313af97f5988a17840bce745a7fdfdc63 Jun 11 21:19:49.426530 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:49.426509 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58"] Jun 11 21:19:49.429040 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:19:49.429013 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod85086d2c_035e_4410_b669_f74e32ac7027.slice/crio-3b59ab91d625cccada7e47a370b95d87375742a4169e61d517d6805bdcbca79c WatchSource:0}: Error finding container 3b59ab91d625cccada7e47a370b95d87375742a4169e61d517d6805bdcbca79c: Status 404 returned error can't find the container with id 3b59ab91d625cccada7e47a370b95d87375742a4169e61d517d6805bdcbca79c Jun 11 21:19:50.133281 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:50.133185 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:50.231450 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:50.231296 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:50.285333 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:50.285276 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:50.398403 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:50.398266 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" event={"ID":"f384d18e-489c-491a-bb58-4940102bf98a","Type":"ContainerStarted","Data":"8f4941f074d71fd67cc532360e97065313af97f5988a17840bce745a7fdfdc63"} Jun 11 21:19:50.400134 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:50.400102 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" event={"ID":"85086d2c-035e-4410-b669-f74e32ac7027","Type":"ContainerStarted","Data":"3b59ab91d625cccada7e47a370b95d87375742a4169e61d517d6805bdcbca79c"} Jun 11 21:19:51.392102 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:51.392071 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:51.444216 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:51.444179 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:52.143803 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:52.143778 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 21:19:52.412313 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:52.412223 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" event={"ID":"39ab0555-80f0-4072-8fe7-e9b35a9ac0fe","Type":"ContainerStarted","Data":"4f41661189776f86cf58f1c055417ebd040a1261cdc79b0a179e7ddb0bfa184d"} Jun 11 21:19:52.414145 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:52.414061 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" event={"ID":"f384d18e-489c-491a-bb58-4940102bf98a","Type":"ContainerStarted","Data":"285357a2848994a060d734a1a362740b617aeb214d450352dc361710c4d2fe22"} Jun 11 21:19:52.414145 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:52.414122 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" Jun 11 21:19:52.429251 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:52.429202 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c9dfcd5c9-5k9z5" podStartSLOduration=2.37556015 podStartE2EDuration="8.429187027s" totalImagesPullingTime="6.053626877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:52.428334174 +0000 UTC m=+541.448935262" watchObservedRunningTime="2026-06-11 21:19:52.429187027 +0000 UTC m=+541.449788366" Jun 11 21:19:52.445036 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:52.444982 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" podStartSLOduration=1.709038392 podStartE2EDuration="4.44496762s" totalImagesPullingTime="2.735929228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:52.443593236 +0000 UTC m=+541.464194348" watchObservedRunningTime="2026-06-11 21:19:52.44496762 +0000 UTC m=+541.465568709" Jun 11 21:19:53.419068 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:53.419035 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" event={"ID":"85086d2c-035e-4410-b669-f74e32ac7027","Type":"ContainerStarted","Data":"fffc4d2ce95ceab95b85bd6205339456134c1304b0b0048fe03f35679455f1ec"} Jun 11 21:19:53.434890 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:53.434834 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" podStartSLOduration=1.977585658 podStartE2EDuration="5.434818968s" totalImagesPullingTime="3.45723331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:19:53.433013658 +0000 UTC m=+542.453614749" watchObservedRunningTime="2026-06-11 21:19:53.434818968 +0000 UTC m=+542.455420055" Jun 11 21:19:53.619649 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:53.619616 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:53.672260 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:53.672182 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:54.424697 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:54.424666 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" Jun 11 21:19:55.374827 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:55.374791 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-4mw4r" Jun 11 21:19:55.376808 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:55.376786 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-r2kvq" Jun 11 21:19:59.155175 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:59.155136 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:19:59.245584 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:19:59.245537 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:00.263056 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:00.263017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:00.371596 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:00.371561 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:01.027182 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:01.027146 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:01.127033 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:01.127002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:01.705244 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:01.705203 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:01.956987 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:01.956903 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv"] Jun 11 21:20:01.960038 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:01.960022 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" Jun 11 21:20:01.962641 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:01.962618 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-4tpqr\"" Jun 11 21:20:01.962781 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:01.962658 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 21:20:01.962781 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:01.962670 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 21:20:01.974646 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:01.974625 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv"] Jun 11 21:20:02.096766 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:02.096721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcw6r\" (UniqueName: \"kubernetes.io/projected/ba36c982-ae60-4c68-a054-05dc1b0d1821-kube-api-access-zcw6r\") pod \"servicemesh-operator3-57f65f65fb-tm2bv\" (UID: \"ba36c982-ae60-4c68-a054-05dc1b0d1821\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" Jun 11 21:20:02.096966 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:02.096854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ba36c982-ae60-4c68-a054-05dc1b0d1821-operator-config\") pod \"servicemesh-operator3-57f65f65fb-tm2bv\" (UID: \"ba36c982-ae60-4c68-a054-05dc1b0d1821\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" Jun 11 21:20:02.197610 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:02.197567 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ba36c982-ae60-4c68-a054-05dc1b0d1821-operator-config\") pod \"servicemesh-operator3-57f65f65fb-tm2bv\" (UID: \"ba36c982-ae60-4c68-a054-05dc1b0d1821\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" Jun 11 21:20:02.197789 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:02.197628 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcw6r\" (UniqueName: \"kubernetes.io/projected/ba36c982-ae60-4c68-a054-05dc1b0d1821-kube-api-access-zcw6r\") pod \"servicemesh-operator3-57f65f65fb-tm2bv\" (UID: \"ba36c982-ae60-4c68-a054-05dc1b0d1821\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" Jun 11 21:20:02.200134 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:02.200100 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ba36c982-ae60-4c68-a054-05dc1b0d1821-operator-config\") pod \"servicemesh-operator3-57f65f65fb-tm2bv\" (UID: \"ba36c982-ae60-4c68-a054-05dc1b0d1821\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" Jun 11 21:20:02.209291 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:02.209225 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcw6r\" (UniqueName: \"kubernetes.io/projected/ba36c982-ae60-4c68-a054-05dc1b0d1821-kube-api-access-zcw6r\") pod \"servicemesh-operator3-57f65f65fb-tm2bv\" (UID: \"ba36c982-ae60-4c68-a054-05dc1b0d1821\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" Jun 11 21:20:02.269306 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:02.269254 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" Jun 11 21:20:02.407725 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:02.407602 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv"] Jun 11 21:20:02.410408 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:20:02.410342 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba36c982_ae60_4c68_a054_05dc1b0d1821.slice/crio-08a97cbc4d4259267586d90ed52616575990c2b21160f4207e4d543ff52a5966 WatchSource:0}: Error finding container 08a97cbc4d4259267586d90ed52616575990c2b21160f4207e4d543ff52a5966: Status 404 returned error can't find the container with id 08a97cbc4d4259267586d90ed52616575990c2b21160f4207e4d543ff52a5966 Jun 11 21:20:02.458779 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:02.458744 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" event={"ID":"ba36c982-ae60-4c68-a054-05dc1b0d1821","Type":"ContainerStarted","Data":"08a97cbc4d4259267586d90ed52616575990c2b21160f4207e4d543ff52a5966"} Jun 11 21:20:06.480826 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:06.480787 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" event={"ID":"ba36c982-ae60-4c68-a054-05dc1b0d1821","Type":"ContainerStarted","Data":"d6441074e5697de2b25c5593b7345a3e256421de9f6d861f9e9c7bbf83b1521e"} Jun 11 21:20:06.481228 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:06.480909 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" Jun 11 21:20:06.503036 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:06.502971 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" podStartSLOduration=2.146593199 podStartE2EDuration="5.502951578s" totalImagesPullingTime="3.356358379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:06.500195976 +0000 UTC m=+555.520797086" watchObservedRunningTime="2026-06-11 21:20:06.502951578 +0000 UTC m=+555.523552666" Jun 11 21:20:11.861556 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:11.861519 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:11.962790 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:11.962759 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:12.919320 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.919281 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq"] Jun 11 21:20:12.924756 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.924735 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:12.927534 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.927509 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 21:20:12.927716 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.927696 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-s52rc\"" Jun 11 21:20:12.927862 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.927532 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 21:20:12.928078 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.928062 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 21:20:12.928197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.928099 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 21:20:12.935182 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.935150 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq"] Jun 11 21:20:12.936098 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.936066 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:12.989460 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.989412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:12.989595 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.989474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:12.989595 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.989503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:12.989595 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.989559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:12.989711 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.989590 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbs4w\" (UniqueName: \"kubernetes.io/projected/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-kube-api-access-sbs4w\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:12.989711 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.989616 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:12.989711 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:12.989657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.035677 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.035634 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:13.090804 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.090770 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.090968 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.090815 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbs4w\" (UniqueName: \"kubernetes.io/projected/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-kube-api-access-sbs4w\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.090968 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.090844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.090968 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.090880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.090968 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.090933 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.091139 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.090973 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.091139 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.091009 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.091788 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.091748 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.093238 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.093217 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.093591 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.093568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.093674 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.093617 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.093948 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.093924 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.098630 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.098605 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.099174 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.099156 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbs4w\" (UniqueName: \"kubernetes.io/projected/b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60-kube-api-access-sbs4w\") pod \"istiod-openshift-gateway-75c67f8887-mbvfq\" (UID: \"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.235375 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.235294 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:13.379734 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.379708 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq"] Jun 11 21:20:13.382231 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:20:13.382162 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cc0f6e_83b8_47aa_ace6_5a16c15d7b60.slice/crio-18dc256b8051436876062b0954d3f7018bf29b8b71d6a3ceeee74b00fe1ce27a WatchSource:0}: Error finding container 18dc256b8051436876062b0954d3f7018bf29b8b71d6a3ceeee74b00fe1ce27a: Status 404 returned error can't find the container with id 18dc256b8051436876062b0954d3f7018bf29b8b71d6a3ceeee74b00fe1ce27a Jun 11 21:20:13.509698 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.509612 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" event={"ID":"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60","Type":"ContainerStarted","Data":"18dc256b8051436876062b0954d3f7018bf29b8b71d6a3ceeee74b00fe1ce27a"} Jun 11 21:20:13.597016 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:13.596970 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:17.487168 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:17.487134 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-tm2bv" Jun 11 21:20:18.834879 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:18.834831 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 21:20:18.835156 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:18.834919 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 21:20:19.540754 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:19.540718 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" event={"ID":"b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60","Type":"ContainerStarted","Data":"985e8fa3f781ac21c750ee05eabdec0ffa10a51bd3ffd68dce6ebad38e18f4d0"} Jun 11 21:20:19.540930 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:19.540908 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:19.542596 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:19.542571 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-mbvfq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 21:20:19.542712 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:19.542616 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" podUID="b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:20:19.573076 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:19.573027 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" podStartSLOduration=2.122840653 podStartE2EDuration="7.573012016s" totalImagesPullingTime="5.450171363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:19.571286426 +0000 UTC m=+568.591887534" watchObservedRunningTime="2026-06-11 21:20:19.573012016 +0000 UTC m=+568.593613103" Jun 11 21:20:19.702807 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:19.702772 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:19.805502 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:19.805405 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:19.997514 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:19.997426 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:20.182399 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:20.182293 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:20.304671 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:20.304624 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:20.546568 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:20.546540 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mbvfq" Jun 11 21:20:23.424913 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:23.424887 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-kw6sx" Jun 11 21:20:23.685843 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:23.685729 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:24.439387 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.439355 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-fbbf95586-mc2hq"] Jun 11 21:20:24.445484 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.445460 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" Jun 11 21:20:24.447838 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.447792 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 21:20:24.448566 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.448545 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t9zwd\"" Jun 11 21:20:24.450633 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.450611 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-fbbf95586-mc2hq"] Jun 11 21:20:24.455988 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.455960 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:24.488761 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.488732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b1bd4a87-7e1b-4463-87c4-2ee0800485fb-redirect-config\") pod \"dashboard-redirect-fbbf95586-mc2hq\" (UID: \"b1bd4a87-7e1b-4463-87c4-2ee0800485fb\") " pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" Jun 11 21:20:24.488894 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.488783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw4bx\" (UniqueName: \"kubernetes.io/projected/b1bd4a87-7e1b-4463-87c4-2ee0800485fb-kube-api-access-cw4bx\") pod \"dashboard-redirect-fbbf95586-mc2hq\" (UID: \"b1bd4a87-7e1b-4463-87c4-2ee0800485fb\") " pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" Jun 11 21:20:24.589521 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.589487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b1bd4a87-7e1b-4463-87c4-2ee0800485fb-redirect-config\") pod \"dashboard-redirect-fbbf95586-mc2hq\" (UID: \"b1bd4a87-7e1b-4463-87c4-2ee0800485fb\") " pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" Jun 11 21:20:24.589670 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.589543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw4bx\" (UniqueName: \"kubernetes.io/projected/b1bd4a87-7e1b-4463-87c4-2ee0800485fb-kube-api-access-cw4bx\") pod \"dashboard-redirect-fbbf95586-mc2hq\" (UID: \"b1bd4a87-7e1b-4463-87c4-2ee0800485fb\") " pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" Jun 11 21:20:24.590191 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.590173 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b1bd4a87-7e1b-4463-87c4-2ee0800485fb-redirect-config\") pod \"dashboard-redirect-fbbf95586-mc2hq\" (UID: \"b1bd4a87-7e1b-4463-87c4-2ee0800485fb\") " pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" Jun 11 21:20:24.597271 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.597252 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw4bx\" (UniqueName: \"kubernetes.io/projected/b1bd4a87-7e1b-4463-87c4-2ee0800485fb-kube-api-access-cw4bx\") pod \"dashboard-redirect-fbbf95586-mc2hq\" (UID: \"b1bd4a87-7e1b-4463-87c4-2ee0800485fb\") " pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" Jun 11 21:20:24.758717 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.758621 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" Jun 11 21:20:24.884039 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:24.883950 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-fbbf95586-mc2hq"] Jun 11 21:20:24.886386 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:20:24.886354 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bd4a87_7e1b_4463_87c4_2ee0800485fb.slice/crio-ac06ef7c7ece2949b4141074258230fedb8ad0e009256747d2bcb204b829a043 WatchSource:0}: Error finding container ac06ef7c7ece2949b4141074258230fedb8ad0e009256747d2bcb204b829a043: Status 404 returned error can't find the container with id ac06ef7c7ece2949b4141074258230fedb8ad0e009256747d2bcb204b829a043 Jun 11 21:20:25.432464 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:25.432413 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-tnb58" Jun 11 21:20:25.567680 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:25.567639 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" event={"ID":"b1bd4a87-7e1b-4463-87c4-2ee0800485fb","Type":"ContainerStarted","Data":"ac06ef7c7ece2949b4141074258230fedb8ad0e009256747d2bcb204b829a043"} Jun 11 21:20:28.583622 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:28.583587 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" event={"ID":"b1bd4a87-7e1b-4463-87c4-2ee0800485fb","Type":"ContainerStarted","Data":"5c1ccd801373b2267a36a6666c1f41df242d3d5d57346e83b2c24a5e5dbc10b9"} Jun 11 21:20:28.602135 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:28.602084 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-fbbf95586-mc2hq" podStartSLOduration=1.678162086 podStartE2EDuration="4.602069305s" totalImagesPullingTime="2.923907219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:28.601170633 +0000 UTC m=+577.621771722" watchObservedRunningTime="2026-06-11 21:20:28.602069305 +0000 UTC m=+577.622670768" Jun 11 21:20:39.986900 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:39.986860 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:40.086106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:40.086064 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:40.185796 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:40.185757 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:40.923619 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:40.923589 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:41.123822 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:41.123788 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:51.385732 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:51.385697 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:20:51.386295 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:20:51.385769 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:21:09.354234 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:09.354156 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:09.455882 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:09.455840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:12.983269 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:12.983234 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:13.094150 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:13.094110 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:17.143734 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.143698 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq"] Jun 11 21:21:17.146878 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.146861 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:17.150913 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.150887 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qpls4\"" Jun 11 21:21:17.151036 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.150955 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 21:21:17.151389 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.151376 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 21:21:17.164159 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.164133 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq"] Jun 11 21:21:17.204123 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.204084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/113df406-e112-4323-b7d8-1d30ccdbafb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" (UID: \"113df406-e112-4323-b7d8-1d30ccdbafb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:17.204123 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.204128 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq4gw\" (UniqueName: \"kubernetes.io/projected/113df406-e112-4323-b7d8-1d30ccdbafb5-kube-api-access-jq4gw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" (UID: \"113df406-e112-4323-b7d8-1d30ccdbafb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:17.304603 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.304565 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/113df406-e112-4323-b7d8-1d30ccdbafb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" (UID: \"113df406-e112-4323-b7d8-1d30ccdbafb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:17.304823 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.304608 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq4gw\" (UniqueName: \"kubernetes.io/projected/113df406-e112-4323-b7d8-1d30ccdbafb5-kube-api-access-jq4gw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" (UID: \"113df406-e112-4323-b7d8-1d30ccdbafb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:17.304956 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.304933 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/113df406-e112-4323-b7d8-1d30ccdbafb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" (UID: \"113df406-e112-4323-b7d8-1d30ccdbafb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:17.315802 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.315770 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq4gw\" (UniqueName: \"kubernetes.io/projected/113df406-e112-4323-b7d8-1d30ccdbafb5-kube-api-access-jq4gw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" (UID: \"113df406-e112-4323-b7d8-1d30ccdbafb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:17.457095 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.456999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:17.553862 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.553769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:17.597709 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.597627 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq"] Jun 11 21:21:17.600820 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:21:17.600789 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113df406_e112_4323_b7d8_1d30ccdbafb5.slice/crio-2f34e87f57e29e2ef24cfdf424cf590f4677f031fc7b8f5b5b37e626c1121dbe WatchSource:0}: Error finding container 2f34e87f57e29e2ef24cfdf424cf590f4677f031fc7b8f5b5b37e626c1121dbe: Status 404 returned error can't find the container with id 2f34e87f57e29e2ef24cfdf424cf590f4677f031fc7b8f5b5b37e626c1121dbe Jun 11 21:21:17.802385 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.802351 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" event={"ID":"113df406-e112-4323-b7d8-1d30ccdbafb5","Type":"ContainerStarted","Data":"2f34e87f57e29e2ef24cfdf424cf590f4677f031fc7b8f5b5b37e626c1121dbe"} Jun 11 21:21:17.943185 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:17.943144 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:19.541956 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:19.541923 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:19.756095 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:19.756057 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:20.954196 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:20.954157 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:22.198267 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:22.198218 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:24.207918 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:24.207879 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:24.840950 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:24.840916 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" event={"ID":"113df406-e112-4323-b7d8-1d30ccdbafb5","Type":"ContainerStarted","Data":"5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769"} Jun 11 21:21:24.841123 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:24.841051 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:24.863879 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:24.863830 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" podStartSLOduration=1.0772124 podStartE2EDuration="7.86381522s" totalImagesPullingTime="6.78660282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:24.861265542 +0000 UTC m=+633.881866629" watchObservedRunningTime="2026-06-11 21:21:24.86381522 +0000 UTC m=+633.884416307" Jun 11 21:21:25.566680 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:25.566646 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:25.669964 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:25.669930 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:27.128813 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:27.128782 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:27.457665 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:27.457572 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:28.761389 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:28.761358 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:28.864608 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:28.864568 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:30.646100 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:30.646067 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:30.703707 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:30.703674 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:30.762044 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:30.762013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:35.847048 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:35.847015 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:37.504754 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.504716 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf"] Jun 11 21:21:37.507815 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.507799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:37.531558 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.531525 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf"] Jun 11 21:21:37.564943 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.564908 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxcnp\" (UniqueName: \"kubernetes.io/projected/38bc7339-90df-4b46-9b21-b35806b8c852-kube-api-access-kxcnp\") pod \"kuadrant-operator-controller-manager-55467d9f7-6hssf\" (UID: \"38bc7339-90df-4b46-9b21-b35806b8c852\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:37.565106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.564984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38bc7339-90df-4b46-9b21-b35806b8c852-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6hssf\" (UID: \"38bc7339-90df-4b46-9b21-b35806b8c852\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:37.611560 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.611523 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf"] Jun 11 21:21:37.611787 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.611768 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-kxcnp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" podUID="38bc7339-90df-4b46-9b21-b35806b8c852" Jun 11 21:21:37.622169 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.622131 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:37.622626 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.622605 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf"] Jun 11 21:21:37.637614 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.637588 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq"] Jun 11 21:21:37.637783 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.637760 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" containerName="manager" containerID="cri-o://5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769" gracePeriod=2 Jun 11 21:21:37.651422 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.651389 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq"] Jun 11 21:21:37.654666 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.654644 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz"] Jun 11 21:21:37.654933 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.654921 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" containerName="manager" Jun 11 21:21:37.654974 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.654936 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" containerName="manager" Jun 11 21:21:37.655007 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.655001 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" containerName="manager" Jun 11 21:21:37.657847 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.657827 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:21:37.660999 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.660961 2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"113df406-e112-4323-b7d8-1d30ccdbafb5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\": pods \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:37.663571 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.663537 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:37.665893 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.665872 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxcnp\" (UniqueName: \"kubernetes.io/projected/38bc7339-90df-4b46-9b21-b35806b8c852-kube-api-access-kxcnp\") pod \"kuadrant-operator-controller-manager-55467d9f7-6hssf\" (UID: \"38bc7339-90df-4b46-9b21-b35806b8c852\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:37.665984 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.665969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38bc7339-90df-4b46-9b21-b35806b8c852-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6hssf\" (UID: \"38bc7339-90df-4b46-9b21-b35806b8c852\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:37.666270 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.666252 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38bc7339-90df-4b46-9b21-b35806b8c852-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6hssf\" (UID: \"38bc7339-90df-4b46-9b21-b35806b8c852\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:37.670378 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.670361 2567 projected.go:196] Error preparing data for projected volume kube-api-access-kxcnp for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-6hssf" not found Jun 11 21:21:37.670475 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.670418 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38bc7339-90df-4b46-9b21-b35806b8c852-kube-api-access-kxcnp podName:38bc7339-90df-4b46-9b21-b35806b8c852 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:38.170402661 +0000 UTC m=+647.191003727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kxcnp" (UniqueName: "kubernetes.io/projected/38bc7339-90df-4b46-9b21-b35806b8c852-kube-api-access-kxcnp") pod "kuadrant-operator-controller-manager-55467d9f7-6hssf" (UID: "38bc7339-90df-4b46-9b21-b35806b8c852") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-6hssf" not found Jun 11 21:21:37.679091 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.679060 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz"] Jun 11 21:21:37.735885 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.735844 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:37.766754 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.766721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/551af44c-94ba-4f42-9626-55cc83dec3bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n2ggz\" (UID: \"551af44c-94ba-4f42-9626-55cc83dec3bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:21:37.766866 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.766791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75bmz\" (UniqueName: \"kubernetes.io/projected/551af44c-94ba-4f42-9626-55cc83dec3bc-kube-api-access-75bmz\") pod \"kuadrant-operator-controller-manager-86878c769f-n2ggz\" (UID: \"551af44c-94ba-4f42-9626-55cc83dec3bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:21:37.835413 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.835383 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:37.867247 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.867215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/551af44c-94ba-4f42-9626-55cc83dec3bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n2ggz\" (UID: \"551af44c-94ba-4f42-9626-55cc83dec3bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:21:37.867385 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.867330 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75bmz\" (UniqueName: \"kubernetes.io/projected/551af44c-94ba-4f42-9626-55cc83dec3bc-kube-api-access-75bmz\") pod \"kuadrant-operator-controller-manager-86878c769f-n2ggz\" (UID: \"551af44c-94ba-4f42-9626-55cc83dec3bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:21:37.867656 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.867636 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/551af44c-94ba-4f42-9626-55cc83dec3bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n2ggz\" (UID: \"551af44c-94ba-4f42-9626-55cc83dec3bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:21:37.875151 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.875127 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75bmz\" (UniqueName: \"kubernetes.io/projected/551af44c-94ba-4f42-9626-55cc83dec3bc-kube-api-access-75bmz\") pod \"kuadrant-operator-controller-manager-86878c769f-n2ggz\" (UID: \"551af44c-94ba-4f42-9626-55cc83dec3bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:21:37.887094 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.887075 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:37.889146 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.889125 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:37.898051 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.898024 2567 generic.go:356] "Generic (PLEG): container finished" podID="113df406-e112-4323-b7d8-1d30ccdbafb5" containerID="5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769" exitCode=0 Jun 11 21:21:37.898170 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.898070 2567 scope.go:117] "RemoveContainer" containerID="5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769" Jun 11 21:21:37.898170 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.898074 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:37.898265 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.898180 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:37.900182 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.900152 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:37.901879 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.901859 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:37.903637 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.903608 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6hssf\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="38bc7339-90df-4b46-9b21-b35806b8c852" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:37.905650 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.905632 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:37.907488 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.907471 2567 scope.go:117] "RemoveContainer" containerID="5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769" Jun 11 21:21:37.907720 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.907681 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:37.907997 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.907968 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769\": container with ID starting with 5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769 not found: ID does not exist" containerID="5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769" Jun 11 21:21:37.908072 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.908021 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769"} err="failed to get container status \"5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769\": rpc error: code = NotFound desc = could not find container \"5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769\": container with ID starting with 5ab30d2487ecea3ab47a229929c56529d7b9f99551f0b41e668f868d08544769 not found: ID does not exist" Jun 11 21:21:37.909448 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:37.909409 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6hssf\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="38bc7339-90df-4b46-9b21-b35806b8c852" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:37.967905 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.967868 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq4gw\" (UniqueName: \"kubernetes.io/projected/113df406-e112-4323-b7d8-1d30ccdbafb5-kube-api-access-jq4gw\") pod \"113df406-e112-4323-b7d8-1d30ccdbafb5\" (UID: \"113df406-e112-4323-b7d8-1d30ccdbafb5\") " Jun 11 21:21:37.968080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.967926 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/113df406-e112-4323-b7d8-1d30ccdbafb5-extensions-socket-volume\") pod \"113df406-e112-4323-b7d8-1d30ccdbafb5\" (UID: \"113df406-e112-4323-b7d8-1d30ccdbafb5\") " Jun 11 21:21:37.968080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.967959 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38bc7339-90df-4b46-9b21-b35806b8c852-extensions-socket-volume\") pod \"38bc7339-90df-4b46-9b21-b35806b8c852\" (UID: \"38bc7339-90df-4b46-9b21-b35806b8c852\") " Jun 11 21:21:37.968193 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.968178 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxcnp\" (UniqueName: \"kubernetes.io/projected/38bc7339-90df-4b46-9b21-b35806b8c852-kube-api-access-kxcnp\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:21:37.968293 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.968261 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38bc7339-90df-4b46-9b21-b35806b8c852-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "38bc7339-90df-4b46-9b21-b35806b8c852" (UID: "38bc7339-90df-4b46-9b21-b35806b8c852"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:21:37.968395 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.968378 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/113df406-e112-4323-b7d8-1d30ccdbafb5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "113df406-e112-4323-b7d8-1d30ccdbafb5" (UID: "113df406-e112-4323-b7d8-1d30ccdbafb5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:21:37.970074 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:37.970055 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/113df406-e112-4323-b7d8-1d30ccdbafb5-kube-api-access-jq4gw" (OuterVolumeSpecName: "kube-api-access-jq4gw") pod "113df406-e112-4323-b7d8-1d30ccdbafb5" (UID: "113df406-e112-4323-b7d8-1d30ccdbafb5"). InnerVolumeSpecName "kube-api-access-jq4gw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:21:38.028051 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:38.027974 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:21:38.068860 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:38.068829 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq4gw\" (UniqueName: \"kubernetes.io/projected/113df406-e112-4323-b7d8-1d30ccdbafb5-kube-api-access-jq4gw\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:21:38.068860 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:38.068861 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/113df406-e112-4323-b7d8-1d30ccdbafb5-extensions-socket-volume\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:21:38.069035 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:38.068876 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38bc7339-90df-4b46-9b21-b35806b8c852-extensions-socket-volume\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:21:38.168963 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:38.167881 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz"] Jun 11 21:21:38.170787 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:21:38.170706 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551af44c_94ba_4f42_9626_55cc83dec3bc.slice/crio-aa5c098791b66cbca51a41db68d837ce054e2ef0351e3f37e91f034392204c75 WatchSource:0}: Error finding container aa5c098791b66cbca51a41db68d837ce054e2ef0351e3f37e91f034392204c75: Status 404 returned error can't find the container with id aa5c098791b66cbca51a41db68d837ce054e2ef0351e3f37e91f034392204c75 Jun 11 21:21:38.212966 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:38.212933 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:38.214571 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:38.214544 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6hssf\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="38bc7339-90df-4b46-9b21-b35806b8c852" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:38.905244 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:38.905204 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" event={"ID":"551af44c-94ba-4f42-9626-55cc83dec3bc","Type":"ContainerStarted","Data":"aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a"} Jun 11 21:21:38.905633 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:38.905256 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:38.905633 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:38.905270 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" event={"ID":"551af44c-94ba-4f42-9626-55cc83dec3bc","Type":"ContainerStarted","Data":"aa5c098791b66cbca51a41db68d837ce054e2ef0351e3f37e91f034392204c75"} Jun 11 21:21:38.905633 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:38.905462 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:21:38.907226 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:38.907203 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:38.927011 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:38.926964 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" podStartSLOduration=1.9269498 podStartE2EDuration="1.9269498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:21:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:38.926342819 +0000 UTC m=+647.946943908" watchObservedRunningTime="2026-06-11 21:21:38.9269498 +0000 UTC m=+647.947550887" Jun 11 21:21:38.928216 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:38.928177 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6hssf\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="38bc7339-90df-4b46-9b21-b35806b8c852" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:38.929885 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:38.929857 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-h7ppq\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h7ppq" Jun 11 21:21:38.931487 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:21:38.931461 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6hssf\" is forbidden: User \"system:node:ip-10-0-135-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-86.ec2.internal' and this object" podUID="38bc7339-90df-4b46-9b21-b35806b8c852" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6hssf" Jun 11 21:21:39.416711 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:39.416681 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="113df406-e112-4323-b7d8-1d30ccdbafb5" path="/var/lib/kubelet/pods/113df406-e112-4323-b7d8-1d30ccdbafb5/volumes" Jun 11 21:21:39.416979 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:39.416967 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38bc7339-90df-4b46-9b21-b35806b8c852" path="/var/lib/kubelet/pods/38bc7339-90df-4b46-9b21-b35806b8c852/volumes" Jun 11 21:21:40.045080 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:40.045049 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:40.142744 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:40.142703 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:44.341982 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:44.341948 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:44.441836 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:44.441803 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:46.753133 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:46.753104 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:46.853613 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:46.853568 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:49.911354 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:49.911321 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:21:55.594877 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:55.594844 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:55.699106 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:55.699063 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:58.042751 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:58.042710 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:58.142228 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:21:58.142179 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:02.399886 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:02.399845 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:02.501411 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:02.501375 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:06.052092 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.052040 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:06.169635 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.169599 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:06.366605 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.366514 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl"] Jun 11 21:22:06.370180 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.370156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.373061 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.373035 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-d49bm\"" Jun 11 21:22:06.380332 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.380305 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl"] Jun 11 21:22:06.389795 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.389765 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:06.511477 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.511444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.511477 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.511481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.511703 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.511521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.511703 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.511593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.511703 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.511626 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.511703 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.511661 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.511703 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.511680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6960d18-79ac-472b-acb5-31e2f33f6562-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.511858 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.511716 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dqlb\" (UniqueName: \"kubernetes.io/projected/e6960d18-79ac-472b-acb5-31e2f33f6562-kube-api-access-2dqlb\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.511858 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.511749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.515280 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.515253 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:06.612963 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.612922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.612963 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.612965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613210 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.612985 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613210 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.613007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613210 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.613023 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6960d18-79ac-472b-acb5-31e2f33f6562-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613210 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.613148 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dqlb\" (UniqueName: \"kubernetes.io/projected/e6960d18-79ac-472b-acb5-31e2f33f6562-kube-api-access-2dqlb\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613210 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.613193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613456 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.613235 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613456 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.613265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613456 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.613389 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613614 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.613486 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613614 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.613534 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.613845 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.613827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.614089 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.614069 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6960d18-79ac-472b-acb5-31e2f33f6562-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.615553 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.615529 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.615687 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.615661 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.620769 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.620710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6960d18-79ac-472b-acb5-31e2f33f6562-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.620769 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.620745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dqlb\" (UniqueName: \"kubernetes.io/projected/e6960d18-79ac-472b-acb5-31e2f33f6562-kube-api-access-2dqlb\") pod \"maas-default-gateway-openshift-default-687ff6996-rfwsl\" (UID: \"e6960d18-79ac-472b-acb5-31e2f33f6562\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.682992 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.682960 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:06.824371 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:06.824261 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl"] Jun 11 21:22:06.827035 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:22:06.827009 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6960d18_79ac_472b_acb5_31e2f33f6562.slice/crio-9fc94f606fa7038f35abf371004c3515d55084c17a0175aa27a6fe18c9b57cd1 WatchSource:0}: Error finding container 9fc94f606fa7038f35abf371004c3515d55084c17a0175aa27a6fe18c9b57cd1: Status 404 returned error can't find the container with id 9fc94f606fa7038f35abf371004c3515d55084c17a0175aa27a6fe18c9b57cd1 Jun 11 21:22:07.035527 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:07.035492 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" event={"ID":"e6960d18-79ac-472b-acb5-31e2f33f6562","Type":"ContainerStarted","Data":"9fc94f606fa7038f35abf371004c3515d55084c17a0175aa27a6fe18c9b57cd1"} Jun 11 21:22:09.758215 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:09.758182 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 21:22:09.758495 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:09.758252 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 21:22:09.758495 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:09.758291 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 21:22:10.052375 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:10.052337 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" event={"ID":"e6960d18-79ac-472b-acb5-31e2f33f6562","Type":"ContainerStarted","Data":"bee46a4ac002090e5fad99e2148b77291f337bd369d68129a65ab4e0eb561b00"} Jun 11 21:22:10.072911 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:10.072863 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" podStartSLOduration=1.143895557 podStartE2EDuration="4.072848396s" totalImagesPullingTime="2.928952839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:22:10.070906238 +0000 UTC m=+679.091507324" watchObservedRunningTime="2026-06-11 21:22:10.072848396 +0000 UTC m=+679.093449484" Jun 11 21:22:10.684003 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:10.683967 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:10.689216 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:10.689191 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:11.057093 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.057067 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:11.058047 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.058025 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:22:11.084477 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.084425 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:11.203268 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.203236 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:11.295780 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.295731 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:11.505030 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.504949 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:22:11.508597 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.508573 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" Jun 11 21:22:11.511026 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.511004 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 21:22:11.511026 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.511009 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6zg5l\"" Jun 11 21:22:11.516350 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.516328 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:22:11.542859 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.542826 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:22:11.658642 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.658613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1c842f76-2348-412a-b6fe-c1343e2b9dad-config-file\") pod \"limitador-limitador-54d6d988d5-jm8ps\" (UID: \"1c842f76-2348-412a-b6fe-c1343e2b9dad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" Jun 11 21:22:11.658807 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.658672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw7jt\" (UniqueName: \"kubernetes.io/projected/1c842f76-2348-412a-b6fe-c1343e2b9dad-kube-api-access-mw7jt\") pod \"limitador-limitador-54d6d988d5-jm8ps\" (UID: \"1c842f76-2348-412a-b6fe-c1343e2b9dad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" Jun 11 21:22:11.759161 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.759081 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw7jt\" (UniqueName: \"kubernetes.io/projected/1c842f76-2348-412a-b6fe-c1343e2b9dad-kube-api-access-mw7jt\") pod \"limitador-limitador-54d6d988d5-jm8ps\" (UID: \"1c842f76-2348-412a-b6fe-c1343e2b9dad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" Jun 11 21:22:11.759161 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.759137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1c842f76-2348-412a-b6fe-c1343e2b9dad-config-file\") pod \"limitador-limitador-54d6d988d5-jm8ps\" (UID: \"1c842f76-2348-412a-b6fe-c1343e2b9dad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" Jun 11 21:22:11.759756 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.759735 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1c842f76-2348-412a-b6fe-c1343e2b9dad-config-file\") pod \"limitador-limitador-54d6d988d5-jm8ps\" (UID: \"1c842f76-2348-412a-b6fe-c1343e2b9dad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" Jun 11 21:22:11.766827 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.766801 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw7jt\" (UniqueName: \"kubernetes.io/projected/1c842f76-2348-412a-b6fe-c1343e2b9dad-kube-api-access-mw7jt\") pod \"limitador-limitador-54d6d988d5-jm8ps\" (UID: \"1c842f76-2348-412a-b6fe-c1343e2b9dad\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" Jun 11 21:22:11.818991 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.818958 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" Jun 11 21:22:11.923937 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.923902 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:11.949993 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.949908 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:22:11.952190 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:22:11.952162 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c842f76_2348_412a_b6fe_c1343e2b9dad.slice/crio-ddfb6194f32929c452fd30778506706ec9410dd72521209b395524c3e48766d2 WatchSource:0}: Error finding container ddfb6194f32929c452fd30778506706ec9410dd72521209b395524c3e48766d2: Status 404 returned error can't find the container with id ddfb6194f32929c452fd30778506706ec9410dd72521209b395524c3e48766d2 Jun 11 21:22:11.989880 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:11.989848 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:12.062792 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:12.062751 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" event={"ID":"1c842f76-2348-412a-b6fe-c1343e2b9dad","Type":"ContainerStarted","Data":"ddfb6194f32929c452fd30778506706ec9410dd72521209b395524c3e48766d2"} Jun 11 21:22:15.080958 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:15.080916 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" event={"ID":"1c842f76-2348-412a-b6fe-c1343e2b9dad","Type":"ContainerStarted","Data":"63d7ea4768f434fcd86523ae8e69e9017fc6f90fa862fae4d2fd5b595f71f2a3"} Jun 11 21:22:15.081316 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:15.081048 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" Jun 11 21:22:15.098914 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:15.098867 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" podStartSLOduration=1.5042098350000002 podStartE2EDuration="4.098850887s" totalImagesPullingTime="2.594641052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:22:15.097565529 +0000 UTC m=+684.118166617" watchObservedRunningTime="2026-06-11 21:22:15.098850887 +0000 UTC m=+684.119451974" Jun 11 21:22:16.212268 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:16.212236 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:16.312642 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:16.312608 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:18.661062 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:18.661011 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:18.714955 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:18.714918 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:26.086558 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:26.086529 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jm8ps" Jun 11 21:22:27.257861 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:27.257822 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:37.558137 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:37.558099 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:37.658017 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:37.657987 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:37.809416 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:22:37.809332 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:01.182094 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:01.182057 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:01.281726 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:01.281693 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:26.206149 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:26.206108 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:30.685706 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:30.685664 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:31.178475 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:31.178440 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:36.856546 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:36.856502 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:36.958040 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:36.958003 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:37.057779 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:37.057745 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:37.127505 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:37.127398 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:39.850190 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:39.850158 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:39.947581 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:39.947546 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:59.098492 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:23:59.098426 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:11.090380 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:11.090336 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:11.292129 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:11.292088 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:11.493793 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:11.493701 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:11.600296 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:11.600264 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:11.689922 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:11.689893 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:24:19.650171 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:19.650139 2567 generic.go:356] "Generic (PLEG): container finished" podID="e6960d18-79ac-472b-acb5-31e2f33f6562" containerID="bee46a4ac002090e5fad99e2148b77291f337bd369d68129a65ab4e0eb561b00" exitCode=0 Jun 11 21:24:19.650590 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:19.650209 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" event={"ID":"e6960d18-79ac-472b-acb5-31e2f33f6562","Type":"ContainerDied","Data":"bee46a4ac002090e5fad99e2148b77291f337bd369d68129a65ab4e0eb561b00"} Jun 11 21:24:19.650686 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:19.650668 2567 scope.go:117] "RemoveContainer" containerID="bee46a4ac002090e5fad99e2148b77291f337bd369d68129a65ab4e0eb561b00" Jun 11 21:24:19.651649 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:19.651623 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 21:24:19.651721 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:19.651696 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 21:24:19.651805 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:19.651728 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 21:24:20.656707 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:20.656673 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" event={"ID":"e6960d18-79ac-472b-acb5-31e2f33f6562","Type":"ContainerStarted","Data":"85f2d33b10da649b92c5aaaf38bfac19ac66d595d7da6a6f9aecc6983cb75fa1"} Jun 11 21:24:20.683218 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:20.683193 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:24:20.683386 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:20.683362 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-rfwsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 11 21:24:20.683487 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:20.683417 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" podUID="e6960d18-79ac-472b-acb5-31e2f33f6562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 11 21:24:21.683619 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:21.683587 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-rfwsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 11 21:24:21.683991 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:21.683638 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" podUID="e6960d18-79ac-472b-acb5-31e2f33f6562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 11 21:24:22.683665 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:22.683631 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-rfwsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 11 21:24:22.684042 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:22.683693 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" podUID="e6960d18-79ac-472b-acb5-31e2f33f6562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 11 21:24:23.683990 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:23.683946 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-rfwsl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 11 21:24:23.684517 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:23.684000 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" podUID="e6960d18-79ac-472b-acb5-31e2f33f6562" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 11 21:24:24.687335 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:24.687306 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:24:24.687708 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:24.687657 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:24:24.688364 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:24:24.688344 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-rfwsl" Jun 11 21:25:17.848619 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:25:17.848573 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:51.413699 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:25:51.413669 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:25:51.414760 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:25:51.414734 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:26:20.928962 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:26:20.928923 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:20.977627 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:26:20.977594 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:03.237190 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:03.237100 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:03.328830 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:03.328797 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:04.264139 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:04.264097 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:32.926918 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:32.926880 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:33.323741 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:33.323700 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:27:50.388752 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:50.388718 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:51.077186 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.077147 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr"] Jun 11 21:27:51.080609 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.080583 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.082945 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.082923 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 21:27:51.083803 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.083779 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 21:27:51.083940 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.083858 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 21:27:51.083940 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.083886 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cbzqn\"" Jun 11 21:27:51.090695 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.090664 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr"] Jun 11 21:27:51.104283 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.104253 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:51.162306 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.162272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.162306 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.162307 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.162598 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.162326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.162598 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.162415 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.162598 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.162496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.162598 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.162543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9twq\" (UniqueName: \"kubernetes.io/projected/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-kube-api-access-c9twq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.263408 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.263369 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.263408 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.263406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.263633 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.263452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.263633 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.263512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.263633 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.263554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.263633 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.263590 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9twq\" (UniqueName: \"kubernetes.io/projected/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-kube-api-access-c9twq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.263934 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.263901 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.264058 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.263946 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.264058 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.263988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.265774 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.265747 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.265930 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.265913 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.271708 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.271687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9twq\" (UniqueName: \"kubernetes.io/projected/c73b7c9f-ab50-4338-b4a5-c0d799aacc01-kube-api-access-c9twq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-54pkr\" (UID: \"c73b7c9f-ab50-4338-b4a5-c0d799aacc01\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.395077 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.394996 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cbzqn\"" Jun 11 21:27:51.403098 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.403064 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" Jun 11 21:27:51.537892 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.537866 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr"] Jun 11 21:27:51.540083 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:27:51.540059 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc73b7c9f_ab50_4338_b4a5_c0d799aacc01.slice/crio-8b050da00e2aeb14e7763193fb335a76f292bd902abd505f3be033efc6e9d04c WatchSource:0}: Error finding container 8b050da00e2aeb14e7763193fb335a76f292bd902abd505f3be033efc6e9d04c: Status 404 returned error can't find the container with id 8b050da00e2aeb14e7763193fb335a76f292bd902abd505f3be033efc6e9d04c Jun 11 21:27:51.542393 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.542371 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:27:51.603958 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.603919 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" event={"ID":"c73b7c9f-ab50-4338-b4a5-c0d799aacc01","Type":"ContainerStarted","Data":"8b050da00e2aeb14e7763193fb335a76f292bd902abd505f3be033efc6e9d04c"} Jun 11 21:27:51.675089 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:51.675010 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:27:55.627339 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:55.627300 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-54pkr" event={"ID":"c73b7c9f-ab50-4338-b4a5-c0d799aacc01","Type":"ContainerStarted","Data":"88178f5822344d7b9fdd6e6e53c733a73973385a6f1985ee42919724e7465ba3"} Jun 11 21:27:57.165403 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.165366 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9"] Jun 11 21:27:57.170385 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.170363 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.172656 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.172628 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 21:27:57.180959 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.180936 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9"] Jun 11 21:27:57.241017 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.240984 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:57.320078 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.320048 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzdgb\" (UniqueName: \"kubernetes.io/projected/6a658a38-8483-466b-9667-f2595e31eb54-kube-api-access-dzdgb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.320078 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.320081 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.320274 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.320108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.320274 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.320225 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.320274 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.320262 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.320370 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.320279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a658a38-8483-466b-9667-f2595e31eb54-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.421249 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.421155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.421249 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.421210 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.421249 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.421236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a658a38-8483-466b-9667-f2595e31eb54-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.421565 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.421277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzdgb\" (UniqueName: \"kubernetes.io/projected/6a658a38-8483-466b-9667-f2595e31eb54-kube-api-access-dzdgb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.421710 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.421347 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.421794 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.421689 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.421867 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.421830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.421935 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.421909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.422153 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.422133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.423628 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.423599 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a658a38-8483-466b-9667-f2595e31eb54-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.424292 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.424271 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a658a38-8483-466b-9667-f2595e31eb54-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.429216 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.429193 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzdgb\" (UniqueName: \"kubernetes.io/projected/6a658a38-8483-466b-9667-f2595e31eb54-kube-api-access-dzdgb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9\" (UID: \"6a658a38-8483-466b-9667-f2595e31eb54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.482247 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.482217 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:27:57.610885 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.610861 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9"] Jun 11 21:27:57.613113 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:27:57.613079 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a658a38_8483_466b_9667_f2595e31eb54.slice/crio-50d2a71c6d63a6212578a371bf3cf7b162bbab9120d5a69edb2a03586fe088fe WatchSource:0}: Error finding container 50d2a71c6d63a6212578a371bf3cf7b162bbab9120d5a69edb2a03586fe088fe: Status 404 returned error can't find the container with id 50d2a71c6d63a6212578a371bf3cf7b162bbab9120d5a69edb2a03586fe088fe Jun 11 21:27:57.637074 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.637042 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" event={"ID":"6a658a38-8483-466b-9667-f2595e31eb54","Type":"ContainerStarted","Data":"50d2a71c6d63a6212578a371bf3cf7b162bbab9120d5a69edb2a03586fe088fe"} Jun 11 21:27:57.880475 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:57.880417 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:27:58.643854 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:27:58.643814 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" event={"ID":"6a658a38-8483-466b-9667-f2595e31eb54","Type":"ContainerStarted","Data":"b4aa0ac8ddd0a411f027f989b12762fb77da9be58a45885bdab104c86cb60f97"} Jun 11 21:28:10.419652 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:10.419581 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:11.178734 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:11.178701 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:28:33.209758 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:33.209667 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:34.273327 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:34.273260 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:28:37.011536 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:37.011497 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:45.068463 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.068404 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc"] Jun 11 21:28:45.072341 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.072320 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.074701 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.074674 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 21:28:45.086075 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.086051 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc"] Jun 11 21:28:45.107273 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.107243 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:45.148796 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.148760 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkt9j\" (UniqueName: \"kubernetes.io/projected/38260309-6019-4183-9acd-6d7823cd8245-kube-api-access-gkt9j\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.148796 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.148799 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.148962 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.148817 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.148962 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.148883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.148962 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.148912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38260309-6019-4183-9acd-6d7823cd8245-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.148962 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.148932 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.249519 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.249481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkt9j\" (UniqueName: \"kubernetes.io/projected/38260309-6019-4183-9acd-6d7823cd8245-kube-api-access-gkt9j\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.249682 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.249539 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.249682 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.249565 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.249682 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.249608 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.249682 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.249656 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38260309-6019-4183-9acd-6d7823cd8245-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.249922 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.249702 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.249978 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.249922 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.250060 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.250039 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.250104 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.250072 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.251836 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.251814 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38260309-6019-4183-9acd-6d7823cd8245-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.252144 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.252127 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38260309-6019-4183-9acd-6d7823cd8245-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.257044 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.257020 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkt9j\" (UniqueName: \"kubernetes.io/projected/38260309-6019-4183-9acd-6d7823cd8245-kube-api-access-gkt9j\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-qp8xc\" (UID: \"38260309-6019-4183-9acd-6d7823cd8245\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.383660 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.383577 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:45.516975 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.516950 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc"] Jun 11 21:28:45.519897 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:28:45.519869 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38260309_6019_4183_9acd_6d7823cd8245.slice/crio-6be343abd15d8c5c2039da7f6949acc8620f8115cc04e470f5785f9275c55111 WatchSource:0}: Error finding container 6be343abd15d8c5c2039da7f6949acc8620f8115cc04e470f5785f9275c55111: Status 404 returned error can't find the container with id 6be343abd15d8c5c2039da7f6949acc8620f8115cc04e470f5785f9275c55111 Jun 11 21:28:45.865261 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.865219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" event={"ID":"38260309-6019-4183-9acd-6d7823cd8245","Type":"ContainerStarted","Data":"227de1196334e9c39cc036d03f875d1804f794afd3d7b88cafa38bb6d74ece8b"} Jun 11 21:28:45.865472 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:45.865267 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" event={"ID":"38260309-6019-4183-9acd-6d7823cd8245","Type":"ContainerStarted","Data":"6be343abd15d8c5c2039da7f6949acc8620f8115cc04e470f5785f9275c55111"} Jun 11 21:28:46.382536 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:46.382495 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:28:47.877585 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:47.877553 2567 generic.go:356] "Generic (PLEG): container finished" podID="38260309-6019-4183-9acd-6d7823cd8245" containerID="227de1196334e9c39cc036d03f875d1804f794afd3d7b88cafa38bb6d74ece8b" exitCode=0 Jun 11 21:28:47.877937 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:47.877625 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" event={"ID":"38260309-6019-4183-9acd-6d7823cd8245","Type":"ContainerDied","Data":"227de1196334e9c39cc036d03f875d1804f794afd3d7b88cafa38bb6d74ece8b"} Jun 11 21:28:49.893770 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:49.893735 2567 generic.go:356] "Generic (PLEG): container finished" podID="6a658a38-8483-466b-9667-f2595e31eb54" containerID="b4aa0ac8ddd0a411f027f989b12762fb77da9be58a45885bdab104c86cb60f97" exitCode=0 Jun 11 21:28:49.894176 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:49.893809 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" event={"ID":"6a658a38-8483-466b-9667-f2595e31eb54","Type":"ContainerDied","Data":"b4aa0ac8ddd0a411f027f989b12762fb77da9be58a45885bdab104c86cb60f97"} Jun 11 21:28:49.895682 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:49.895656 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" event={"ID":"38260309-6019-4183-9acd-6d7823cd8245","Type":"ContainerStarted","Data":"8402734820e3e14a29bca59a8f86fa40b2b8654fa10a6659e6f9e7bc0946abd4"} Jun 11 21:28:49.925901 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:49.925830 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" podStartSLOduration=2.551922202 podStartE2EDuration="4.925810133s" totalImagesPullingTime="1.030067486s" totalInitContainerRuntime="1.343820445s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:28:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:49.924825161 +0000 UTC m=+1078.945426242" watchObservedRunningTime="2026-06-11 21:28:49.925810133 +0000 UTC m=+1078.946411223" Jun 11 21:28:50.903356 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:50.903321 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" event={"ID":"6a658a38-8483-466b-9667-f2595e31eb54","Type":"ContainerStarted","Data":"06fcc1cda40a67d2ecd7bc02b463ca6d7d6ace559bb47c9828084a47f8899e7d"} Jun 11 21:28:50.921877 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:50.921820 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" podStartSLOduration=1.65751473 podStartE2EDuration="53.921799734s" totalImagesPullingTime="170.731547ms" totalInitContainerRuntime="52.093553457s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:50.921159109 +0000 UTC m=+1079.941760223" watchObservedRunningTime="2026-06-11 21:28:50.921799734 +0000 UTC m=+1079.942400822" Jun 11 21:28:55.384024 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:55.383985 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:55.384024 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:55.384031 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:55.396823 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:55.396793 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:55.938127 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:55.938099 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-qp8xc" Jun 11 21:28:57.482446 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:57.482410 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:28:57.482867 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:57.482492 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:28:57.494924 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:57.494900 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:28:57.947083 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:28:57.947051 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9" Jun 11 21:29:40.761831 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:29:40.761785 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:40.849000 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:29:40.848967 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:41.956526 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:29:41.956481 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:42.044876 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:29:42.044846 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:02.287544 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:02.287462 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:30:06.578779 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:06.578742 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:30:13.580896 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:13.580862 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:30:23.868646 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:23.868609 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:30:28.735186 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:28.735151 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:29.799589 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:29.799556 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:32.779217 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:32.779179 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:30:42.887867 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:42.887829 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:30:51.440760 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:51.440731 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:30:51.444113 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:51.444091 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:30:52.184938 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:30:52.184901 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:31:02.576970 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:31:02.576932 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:31:10.354751 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:31:10.354714 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:12.200756 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:31:12.200723 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:52.081523 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:31:52.081480 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:52.169550 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:31:52.169519 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:00.601159 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:32:00.601112 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:06.160993 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:32:06.160959 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:06.213202 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:32:06.213170 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:15.679254 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:32:15.679216 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:32:31.471852 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:32:31.471818 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:32:38.401361 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:32:38.401325 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:38.492315 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:32:38.492284 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:02.340466 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:02.340347 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:07.986382 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:07.986348 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:08.049207 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:08.049176 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:08.123910 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:08.123872 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:08.216580 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:08.216544 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:08.423294 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:08.423260 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:08.504409 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:08.504374 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:09.784679 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:09.784645 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:33:24.982591 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:24.982554 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:25.102318 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:25.102279 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:25.212280 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:25.212248 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:26.377089 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:26.377050 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:33:30.923985 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:30.923942 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:31.024023 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:31.023993 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:39.067420 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:39.067383 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:39.169284 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:39.169246 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:39.268132 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:39.268088 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:39.367398 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:39.367303 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:40.676101 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:40.676069 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:33:56.604218 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:56.604184 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:56.705857 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:56.705819 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:56.980028 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:33:56.979943 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:34:01.798737 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:01.798693 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:01.854207 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:01.854170 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:03.125757 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:03.125709 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:18.036072 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:18.036033 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:18.160915 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:18.160858 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:18.259225 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:18.259190 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:23.790785 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:23.790743 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:23.886494 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:23.886424 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:23.986097 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:23.986059 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:24.112357 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:24.112267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:29.853299 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:29.853207 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:29.968993 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:29.968955 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:56.377058 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:34:56.377019 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:35:05.273463 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:35:05.273415 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:35:21.875976 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:35:21.875940 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:35:30.474530 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:35:30.474492 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:35:47.772807 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:35:47.772771 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:35:51.473351 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:35:51.473318 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:35:51.477338 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:35:51.477316 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:35:56.280984 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:35:56.280950 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:36:05.512373 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:36:05.512279 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:36:28.676282 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:36:28.676243 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:36:36.826884 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:36:36.826842 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:36:37.682104 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:36:37.682069 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:36:46.476928 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:36:46.476891 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:36:48.029091 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:36:48.029047 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:36:53.969729 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:36:53.969684 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:37:02.378697 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:37:02.378652 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:37:10.986656 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:37:10.986614 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:37:12.090742 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:37:12.090677 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:12.187529 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:37:12.187497 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:15.016938 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:37:15.016905 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:37:27.885802 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:37:27.885767 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:37:39.475626 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:37:39.475533 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:37:44.158882 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:37:44.158840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:44.212124 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:37:44.212089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:38:07.679736 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:38:07.679702 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:38:10.375056 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:38:10.375018 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:38:27.180834 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:38:27.180801 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:38:34.968408 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:38:34.968372 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:38:53.978707 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:38:53.978674 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:38:58.870197 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:38:58.870162 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:39:02.882922 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:39:02.882826 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:39:11.386387 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:39:11.386348 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:39:20.074163 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:39:20.074126 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:39:29.171693 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:39:29.171654 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:39:37.981827 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:39:37.981791 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:39:46.574610 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:39:46.574568 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:39:55.078141 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:39:55.078103 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:40:03.472567 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:40:03.472528 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:40:11.675383 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:40:11.675340 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:40:51.499588 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:40:51.499561 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:40:51.504141 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:40:51.504120 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:41:13.505877 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:13.505845 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz"] Jun 11 21:41:13.506477 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:13.506066 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" podUID="551af44c-94ba-4f42-9626-55cc83dec3bc" containerName="manager" containerID="cri-o://aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a" gracePeriod=10 Jun 11 21:41:13.760800 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:13.760740 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:41:13.872533 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:13.872501 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/551af44c-94ba-4f42-9626-55cc83dec3bc-extensions-socket-volume\") pod \"551af44c-94ba-4f42-9626-55cc83dec3bc\" (UID: \"551af44c-94ba-4f42-9626-55cc83dec3bc\") " Jun 11 21:41:13.872706 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:13.872550 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75bmz\" (UniqueName: \"kubernetes.io/projected/551af44c-94ba-4f42-9626-55cc83dec3bc-kube-api-access-75bmz\") pod \"551af44c-94ba-4f42-9626-55cc83dec3bc\" (UID: \"551af44c-94ba-4f42-9626-55cc83dec3bc\") " Jun 11 21:41:13.872864 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:13.872838 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551af44c-94ba-4f42-9626-55cc83dec3bc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "551af44c-94ba-4f42-9626-55cc83dec3bc" (UID: "551af44c-94ba-4f42-9626-55cc83dec3bc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:41:13.874577 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:13.874552 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551af44c-94ba-4f42-9626-55cc83dec3bc-kube-api-access-75bmz" (OuterVolumeSpecName: "kube-api-access-75bmz") pod "551af44c-94ba-4f42-9626-55cc83dec3bc" (UID: "551af44c-94ba-4f42-9626-55cc83dec3bc"). InnerVolumeSpecName "kube-api-access-75bmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:41:13.973151 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:13.973116 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/551af44c-94ba-4f42-9626-55cc83dec3bc-extensions-socket-volume\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:41:13.973151 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:13.973145 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75bmz\" (UniqueName: \"kubernetes.io/projected/551af44c-94ba-4f42-9626-55cc83dec3bc-kube-api-access-75bmz\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:41:14.430222 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:14.430189 2567 generic.go:356] "Generic (PLEG): container finished" podID="551af44c-94ba-4f42-9626-55cc83dec3bc" containerID="aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a" exitCode=0 Jun 11 21:41:14.430222 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:14.430220 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" Jun 11 21:41:14.430534 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:14.430275 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" event={"ID":"551af44c-94ba-4f42-9626-55cc83dec3bc","Type":"ContainerDied","Data":"aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a"} Jun 11 21:41:14.430534 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:14.430339 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz" event={"ID":"551af44c-94ba-4f42-9626-55cc83dec3bc","Type":"ContainerDied","Data":"aa5c098791b66cbca51a41db68d837ce054e2ef0351e3f37e91f034392204c75"} Jun 11 21:41:14.430534 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:14.430369 2567 scope.go:117] "RemoveContainer" containerID="aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a" Jun 11 21:41:14.439850 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:14.439831 2567 scope.go:117] "RemoveContainer" containerID="aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a" Jun 11 21:41:14.440111 ip-10-0-135-86 kubenswrapper[2567]: E0611 21:41:14.440088 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a\": container with ID starting with aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a not found: ID does not exist" containerID="aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a" Jun 11 21:41:14.440204 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:14.440115 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a"} err="failed to get container status \"aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a\": rpc error: code = NotFound desc = could not find container \"aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a\": container with ID starting with aba08a9bda21238803c3a79ff05cdb1ebefc3c1671a9bc2a0b95ae02675ddb3a not found: ID does not exist" Jun 11 21:41:14.450227 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:14.450205 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz"] Jun 11 21:41:14.454239 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:14.454216 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n2ggz"] Jun 11 21:41:15.417533 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:41:15.417499 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="551af44c-94ba-4f42-9626-55cc83dec3bc" path="/var/lib/kubelet/pods/551af44c-94ba-4f42-9626-55cc83dec3bc/volumes" Jun 11 21:42:41.080279 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:42:41.080238 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:42:46.328728 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:42:46.328691 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:43:10.279214 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:43:10.279162 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:43:14.788224 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:43:14.788189 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:43:24.383828 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:43:24.383789 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:43:35.183126 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:43:35.183052 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:43:42.505614 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:43:42.505581 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:43.490331 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:43:43.490294 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:43:54.484150 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:43:54.484110 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:44:03.080022 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:44:03.079983 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:44:13.876766 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:44:13.876725 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:44:22.278121 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:44:22.278087 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:44:32.086317 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:44:32.086266 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:44:41.784271 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:44:41.784232 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:44:46.682364 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:44:46.682322 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:45:00.137957 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.137864 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686905-zr7cj"] Jun 11 21:45:00.138698 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.138261 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551af44c-94ba-4f42-9626-55cc83dec3bc" containerName="manager" Jun 11 21:45:00.138698 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.138274 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="551af44c-94ba-4f42-9626-55cc83dec3bc" containerName="manager" Jun 11 21:45:00.138698 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.138349 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="551af44c-94ba-4f42-9626-55cc83dec3bc" containerName="manager" Jun 11 21:45:00.141411 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.141395 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686905-zr7cj" Jun 11 21:45:00.143801 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.143778 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-n9dm8\"" Jun 11 21:45:00.156198 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.156172 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686905-zr7cj"] Jun 11 21:45:00.239534 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.239494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqbsj\" (UniqueName: \"kubernetes.io/projected/4308d24e-44ca-4c9a-935f-0f5a920b3f3a-kube-api-access-mqbsj\") pod \"maas-api-key-cleanup-29686905-zr7cj\" (UID: \"4308d24e-44ca-4c9a-935f-0f5a920b3f3a\") " pod="opendatahub/maas-api-key-cleanup-29686905-zr7cj" Jun 11 21:45:00.340823 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.340784 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqbsj\" (UniqueName: \"kubernetes.io/projected/4308d24e-44ca-4c9a-935f-0f5a920b3f3a-kube-api-access-mqbsj\") pod \"maas-api-key-cleanup-29686905-zr7cj\" (UID: \"4308d24e-44ca-4c9a-935f-0f5a920b3f3a\") " pod="opendatahub/maas-api-key-cleanup-29686905-zr7cj" Jun 11 21:45:00.348373 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.348348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqbsj\" (UniqueName: \"kubernetes.io/projected/4308d24e-44ca-4c9a-935f-0f5a920b3f3a-kube-api-access-mqbsj\") pod \"maas-api-key-cleanup-29686905-zr7cj\" (UID: \"4308d24e-44ca-4c9a-935f-0f5a920b3f3a\") " pod="opendatahub/maas-api-key-cleanup-29686905-zr7cj" Jun 11 21:45:00.451938 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.451847 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686905-zr7cj" Jun 11 21:45:00.583905 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.583882 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686905-zr7cj"] Jun 11 21:45:00.586031 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:45:00.586006 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4308d24e_44ca_4c9a_935f_0f5a920b3f3a.slice/crio-8cd5d9082f28f3b45c15f2de425f3832c5e0560e69fa5b3a8184b9a1ed1d98ab WatchSource:0}: Error finding container 8cd5d9082f28f3b45c15f2de425f3832c5e0560e69fa5b3a8184b9a1ed1d98ab: Status 404 returned error can't find the container with id 8cd5d9082f28f3b45c15f2de425f3832c5e0560e69fa5b3a8184b9a1ed1d98ab Jun 11 21:45:00.588117 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:00.588093 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:45:01.460015 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:01.459979 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686905-zr7cj" event={"ID":"4308d24e-44ca-4c9a-935f-0f5a920b3f3a","Type":"ContainerStarted","Data":"8cd5d9082f28f3b45c15f2de425f3832c5e0560e69fa5b3a8184b9a1ed1d98ab"} Jun 11 21:45:04.475304 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:04.475204 2567 generic.go:356] "Generic (PLEG): container finished" podID="4308d24e-44ca-4c9a-935f-0f5a920b3f3a" containerID="ac36c60866bee3490950a5ec96dd47eda1abf82afc3dd2f626d4013ee6fd06be" exitCode=0 Jun 11 21:45:04.475304 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:04.475261 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686905-zr7cj" event={"ID":"4308d24e-44ca-4c9a-935f-0f5a920b3f3a","Type":"ContainerDied","Data":"ac36c60866bee3490950a5ec96dd47eda1abf82afc3dd2f626d4013ee6fd06be"} Jun 11 21:45:05.609143 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:05.609118 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686905-zr7cj" Jun 11 21:45:05.688368 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:05.688331 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqbsj\" (UniqueName: \"kubernetes.io/projected/4308d24e-44ca-4c9a-935f-0f5a920b3f3a-kube-api-access-mqbsj\") pod \"4308d24e-44ca-4c9a-935f-0f5a920b3f3a\" (UID: \"4308d24e-44ca-4c9a-935f-0f5a920b3f3a\") " Jun 11 21:45:05.690583 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:05.690550 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4308d24e-44ca-4c9a-935f-0f5a920b3f3a-kube-api-access-mqbsj" (OuterVolumeSpecName: "kube-api-access-mqbsj") pod "4308d24e-44ca-4c9a-935f-0f5a920b3f3a" (UID: "4308d24e-44ca-4c9a-935f-0f5a920b3f3a"). InnerVolumeSpecName "kube-api-access-mqbsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:45:05.789141 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:05.789111 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqbsj\" (UniqueName: \"kubernetes.io/projected/4308d24e-44ca-4c9a-935f-0f5a920b3f3a-kube-api-access-mqbsj\") on node \"ip-10-0-135-86.ec2.internal\" DevicePath \"\"" Jun 11 21:45:06.485144 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:06.485114 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686905-zr7cj" Jun 11 21:45:06.485316 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:06.485118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686905-zr7cj" event={"ID":"4308d24e-44ca-4c9a-935f-0f5a920b3f3a","Type":"ContainerDied","Data":"8cd5d9082f28f3b45c15f2de425f3832c5e0560e69fa5b3a8184b9a1ed1d98ab"} Jun 11 21:45:06.485316 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:06.485236 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cd5d9082f28f3b45c15f2de425f3832c5e0560e69fa5b3a8184b9a1ed1d98ab" Jun 11 21:45:28.334568 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:28.334532 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:45:51.526924 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:51.526892 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:45:51.531419 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:45:51.531398 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:46:06.511156 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:46:06.511122 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:15.421781 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:46:15.421745 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:15.522892 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:46:15.522857 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:15.775323 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:46:15.775229 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:46:58.775283 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:46:58.775203 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:47:07.486391 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:47:07.486352 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:47:16.179305 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:47:16.179269 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:47:24.686679 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:47:24.686639 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:47:33.128521 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:47:33.128486 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:47:43.774052 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:47:43.774015 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:47:52.782841 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:47:52.782805 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:47:57.986537 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:47:57.986502 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:48:05.075726 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:48:05.075638 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:48:13.283591 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:48:13.283552 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:48:21.575894 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:48:21.575861 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:48:31.979974 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:48:31.979941 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:48:49.878950 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:48:49.878907 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:48:58.679639 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:48:58.679606 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:49:07.083215 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:49:07.083177 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:49:15.579498 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:49:15.579459 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:49:32.683007 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:49:32.682912 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:49:41.677558 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:49:41.677519 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:49:49.879508 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:49:49.879468 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:49:58.087269 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:49:58.087226 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:50:07.185959 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:50:07.185923 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:50:15.478377 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:50:15.478337 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:50:24.689312 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:50:24.689277 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:50:37.578995 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:50:37.578954 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:50:46.981454 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:50:46.981396 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:50:51.553519 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:50:51.553489 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:50:51.558990 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:50:51.558968 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kw9d9_affa242d-8f4e-4084-a666-61e4890730cb/ovn-acl-logging/0.log" Jun 11 21:50:57.780246 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:50:57.780214 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:51:07.080384 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:07.080295 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:51:12.678463 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:12.678416 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:51:19.485581 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:19.485548 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:51:24.780936 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:24.780900 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jm8ps"] Jun 11 21:51:35.312373 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:35.312341 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-fbbf95586-mc2hq_b1bd4a87-7e1b-4463-87c4-2ee0800485fb/nginx/0.log" Jun 11 21:51:35.533991 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:35.533964 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-kw6sx_f384d18e-489c-491a-bb58-4940102bf98a/manager/0.log" Jun 11 21:51:35.654812 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:35.654727 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-tnb58_85086d2c-035e-4410-b669-f74e32ac7027/manager/0.log" Jun 11 21:51:35.997256 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:35.997175 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686905-zr7cj_4308d24e-44ca-4c9a-935f-0f5a920b3f3a/cleanup/0.log" Jun 11 21:51:36.234938 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:36.234900 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-r2kvq_52ab61ca-d1cd-4547-996b-4ddbaa98a5d7/server/0.log" Jun 11 21:51:36.354449 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:36.354401 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4mw4r_1310efed-aba6-48ba-9cdb-97a5ef818dbb/manager/0.log" Jun 11 21:51:36.464228 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:36.464203 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c5c8d746-65vjv_0d99b357-63d3-4624-a11e-28ce7e990a44/copy-manifests/0.log" Jun 11 21:51:36.482093 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:36.482062 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c5c8d746-65vjv_0d99b357-63d3-4624-a11e-28ce7e990a44/manager/0.log" Jun 11 21:51:38.639059 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:38.639029 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:38.829179 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:38.829149 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jm8ps_1c842f76-2348-412a-b6fe-c1343e2b9dad/limitador/0.log" Jun 11 21:51:39.425491 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:39.425464 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mbvfq_b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60/discovery/0.log" Jun 11 21:51:39.541980 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:39.541946 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9dfcd5c9-5k9z5_39ab0555-80f0-4072-8fe7-e9b35a9ac0fe/kube-auth-proxy/0.log" Jun 11 21:51:39.709406 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:39.709320 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:39.778901 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:39.778861 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-rfwsl_e6960d18-79ac-472b-acb5-31e2f33f6562/istio-proxy/1.log" Jun 11 21:51:40.626389 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:40.626359 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-54pkr_c73b7c9f-ab50-4338-b4a5-c0d799aacc01/storage-initializer/0.log" Jun 11 21:51:40.743694 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:40.743661 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9_6a658a38-8483-466b-9667-f2595e31eb54/storage-initializer/0.log" Jun 11 21:51:40.750588 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:40.750561 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-pkzd9_6a658a38-8483-466b-9667-f2595e31eb54/main/0.log" Jun 11 21:51:41.108313 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:41.108281 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-qp8xc_38260309-6019-4183-9acd-6d7823cd8245/storage-initializer/0.log" Jun 11 21:51:41.115719 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:41.115689 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-qp8xc_38260309-6019-4183-9acd-6d7823cd8245/main/0.log" Jun 11 21:51:45.569003 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.568970 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jg56s/must-gather-5bzws"] Jun 11 21:51:45.569510 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.569415 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:45.569510 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.569465 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4308d24e-44ca-4c9a-935f-0f5a920b3f3a" containerName="cleanup" Jun 11 21:51:45.569510 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.569483 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4308d24e-44ca-4c9a-935f-0f5a920b3f3a" containerName="cleanup" Jun 11 21:51:45.569684 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.569609 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4308d24e-44ca-4c9a-935f-0f5a920b3f3a" containerName="cleanup" Jun 11 21:51:45.572764 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.572742 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jg56s/must-gather-5bzws" Jun 11 21:51:45.574917 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.574896 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jg56s\"/\"openshift-service-ca.crt\"" Jun 11 21:51:45.575039 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.575021 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jg56s\"/\"default-dockercfg-ms2kw\"" Jun 11 21:51:45.575867 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.575848 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jg56s\"/\"kube-root-ca.crt\"" Jun 11 21:51:45.588454 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.588415 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jg56s/must-gather-5bzws"] Jun 11 21:51:45.625581 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.625551 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:45.746362 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.746324 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swf7z\" (UniqueName: \"kubernetes.io/projected/0f07c73b-d947-4af4-ba77-a1a72014753f-kube-api-access-swf7z\") pod \"must-gather-5bzws\" (UID: \"0f07c73b-d947-4af4-ba77-a1a72014753f\") " pod="openshift-must-gather-jg56s/must-gather-5bzws" Jun 11 21:51:45.746362 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.746363 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0f07c73b-d947-4af4-ba77-a1a72014753f-must-gather-output\") pod \"must-gather-5bzws\" (UID: \"0f07c73b-d947-4af4-ba77-a1a72014753f\") " pod="openshift-must-gather-jg56s/must-gather-5bzws" Jun 11 21:51:45.847259 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.847171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swf7z\" (UniqueName: \"kubernetes.io/projected/0f07c73b-d947-4af4-ba77-a1a72014753f-kube-api-access-swf7z\") pod \"must-gather-5bzws\" (UID: \"0f07c73b-d947-4af4-ba77-a1a72014753f\") " pod="openshift-must-gather-jg56s/must-gather-5bzws" Jun 11 21:51:45.847259 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.847211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0f07c73b-d947-4af4-ba77-a1a72014753f-must-gather-output\") pod \"must-gather-5bzws\" (UID: \"0f07c73b-d947-4af4-ba77-a1a72014753f\") " pod="openshift-must-gather-jg56s/must-gather-5bzws" Jun 11 21:51:45.847573 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.847552 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0f07c73b-d947-4af4-ba77-a1a72014753f-must-gather-output\") pod \"must-gather-5bzws\" (UID: \"0f07c73b-d947-4af4-ba77-a1a72014753f\") " pod="openshift-must-gather-jg56s/must-gather-5bzws" Jun 11 21:51:45.854453 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.854417 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swf7z\" (UniqueName: \"kubernetes.io/projected/0f07c73b-d947-4af4-ba77-a1a72014753f-kube-api-access-swf7z\") pod \"must-gather-5bzws\" (UID: \"0f07c73b-d947-4af4-ba77-a1a72014753f\") " pod="openshift-must-gather-jg56s/must-gather-5bzws" Jun 11 21:51:45.882315 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:45.882291 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jg56s/must-gather-5bzws" Jun 11 21:51:46.011390 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:46.011363 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jg56s/must-gather-5bzws"] Jun 11 21:51:46.013449 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:51:46.013406 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f07c73b_d947_4af4_ba77_a1a72014753f.slice/crio-bae730ba725eb825dffede8502beb5389f86bb3eac23547e8d329ffd873dc59b WatchSource:0}: Error finding container bae730ba725eb825dffede8502beb5389f86bb3eac23547e8d329ffd873dc59b: Status 404 returned error can't find the container with id bae730ba725eb825dffede8502beb5389f86bb3eac23547e8d329ffd873dc59b Jun 11 21:51:46.015381 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:46.015363 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:51:46.341630 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:46.341594 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jg56s/must-gather-5bzws" event={"ID":"0f07c73b-d947-4af4-ba77-a1a72014753f","Type":"ContainerStarted","Data":"bae730ba725eb825dffede8502beb5389f86bb3eac23547e8d329ffd873dc59b"} Jun 11 21:51:47.351798 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:47.351760 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jg56s/must-gather-5bzws" event={"ID":"0f07c73b-d947-4af4-ba77-a1a72014753f","Type":"ContainerStarted","Data":"ff5d6dba46dae75c8ecacb3468134e43c143783812dda6feb95cb56216f0661d"} Jun 11 21:51:47.352270 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:47.351822 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jg56s/must-gather-5bzws" event={"ID":"0f07c73b-d947-4af4-ba77-a1a72014753f","Type":"ContainerStarted","Data":"4a04a65a9a81de5c8fa0bb082e656e3f7f8ab994dd975ca57284be281ec5b579"} Jun 11 21:51:47.368144 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:47.368080 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jg56s/must-gather-5bzws" podStartSLOduration=1.688959546 podStartE2EDuration="2.368060297s" totalImagesPullingTime="679.100751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:51:47.366022847 +0000 UTC m=+2456.386623929" watchObservedRunningTime="2026-06-11 21:51:47.368060297 +0000 UTC m=+2456.388661385" Jun 11 21:51:48.410744 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:48.410714 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4qt2x_8f8fd8dd-f772-4263-9715-6b654738adaf/global-pull-secret-syncer/0.log" Jun 11 21:51:48.531307 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:48.531265 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" Jun 11 21:51:48.637402 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:48.637378 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-86.ec2.internal_363076e54f25c3bd7b4f7bc4d102f35d/haproxy/0.log" Jun 11 21:51:49.046511 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:49.046468 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7fwxv_8f126d62-50e6-415c-bc14-d8f51a6c0adb/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:52.539595 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:52.539562 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-tm2bv_ba36c982-ae60-4c68-a054-05dc1b0d1821/sail-operator/0.log" Jun 11 21:51:53.826374 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:53.826341 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jm8ps_1c842f76-2348-412a-b6fe-c1343e2b9dad/limitador/0.log" Jun 11 21:51:55.939636 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:55.939551 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvvgq_074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e/node-exporter/0.log" Jun 11 21:51:55.963573 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:55.963544 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvvgq_074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e/kube-rbac-proxy/0.log" Jun 11 21:51:55.986622 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:55.986590 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvvgq_074852ba-ffe5-4f1f-a4ed-7f5adf1a3f3e/init-textfile/0.log" Jun 11 21:51:56.096020 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:56.095989 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pqt9z_01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9/kube-rbac-proxy-main/0.log" Jun 11 21:51:56.121927 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:56.121859 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pqt9z_01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9/kube-rbac-proxy-self/0.log" Jun 11 21:51:56.148006 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:56.147834 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pqt9z_01a1d8a1-b0e0-4c0a-8db0-bbf72af7d8e9/openshift-state-metrics/0.log" Jun 11 21:51:59.278687 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:51:59.278650 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-szvfg_ac58a2f2-b700-421d-8144-40de2ee4395c/download-server/0.log" Jun 11 21:52:00.010945 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.010903 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq"] Jun 11 21:52:00.019330 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.019299 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.024637 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.024608 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq"] Jun 11 21:52:00.104863 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.104814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-lib-modules\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.105216 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.105181 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-sys\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.105325 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.105222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49zbs\" (UniqueName: \"kubernetes.io/projected/cc90e10f-b35c-4863-b072-0423e91ef95e-kube-api-access-49zbs\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.105325 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.105308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-podres\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.105456 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.105371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-proc\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.206033 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.205997 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-lib-modules\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.206225 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.206069 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-sys\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.206225 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.206095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49zbs\" (UniqueName: \"kubernetes.io/projected/cc90e10f-b35c-4863-b072-0423e91ef95e-kube-api-access-49zbs\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.206225 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.206125 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-podres\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.206225 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.206164 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-proc\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.206225 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.206183 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-sys\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.206225 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.206182 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-lib-modules\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.206498 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.206259 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-proc\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.206498 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.206289 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc90e10f-b35c-4863-b072-0423e91ef95e-podres\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.214947 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.214907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49zbs\" (UniqueName: \"kubernetes.io/projected/cc90e10f-b35c-4863-b072-0423e91ef95e-kube-api-access-49zbs\") pod \"perf-node-gather-daemonset-lzsvq\" (UID: \"cc90e10f-b35c-4863-b072-0423e91ef95e\") " pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.333050 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.333011 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:00.541173 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:00.540297 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq"] Jun 11 21:52:00.548916 ip-10-0-135-86 kubenswrapper[2567]: W0611 21:52:00.545645 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc90e10f_b35c_4863_b072_0423e91ef95e.slice/crio-14aded3894a7bc7733f6f023b9f96d69c3f39e2d42e34524dc79e5562b06dd75 WatchSource:0}: Error finding container 14aded3894a7bc7733f6f023b9f96d69c3f39e2d42e34524dc79e5562b06dd75: Status 404 returned error can't find the container with id 14aded3894a7bc7733f6f023b9f96d69c3f39e2d42e34524dc79e5562b06dd75 Jun 11 21:52:01.170749 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:01.170715 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5hdj2_51a7e4df-67f9-4904-9c16-6d0cbf47db7d/dns/0.log" Jun 11 21:52:01.193414 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:01.193377 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5hdj2_51a7e4df-67f9-4904-9c16-6d0cbf47db7d/kube-rbac-proxy/0.log" Jun 11 21:52:01.331484 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:01.331452 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j255d_7c147e51-b93b-410b-a81a-f5d7c57087e9/dns-node-resolver/0.log" Jun 11 21:52:01.469445 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:01.469337 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" event={"ID":"cc90e10f-b35c-4863-b072-0423e91ef95e","Type":"ContainerStarted","Data":"0af2472b3dae768c487faf239b8de3cb64fbc11b74c673370855fe33619dd165"} Jun 11 21:52:01.469859 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:01.469457 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" event={"ID":"cc90e10f-b35c-4863-b072-0423e91ef95e","Type":"ContainerStarted","Data":"14aded3894a7bc7733f6f023b9f96d69c3f39e2d42e34524dc79e5562b06dd75"} Jun 11 21:52:01.469859 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:01.469651 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:01.484843 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:01.484797 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" podStartSLOduration=2.484780465 podStartE2EDuration="2.484780465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:51:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:52:01.483701715 +0000 UTC m=+2470.504302804" watchObservedRunningTime="2026-06-11 21:52:01.484780465 +0000 UTC m=+2470.505381552" Jun 11 21:52:01.930657 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:01.930623 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hx7mp_344ad448-ef00-4d68-ace8-a0375e86d7bb/node-ca/0.log" Jun 11 21:52:02.982843 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:02.982799 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mbvfq_b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60/discovery/0.log" Jun 11 21:52:03.002528 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:03.002488 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9dfcd5c9-5k9z5_39ab0555-80f0-4072-8fe7-e9b35a9ac0fe/kube-auth-proxy/0.log" Jun 11 21:52:03.057148 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:03.057118 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-rfwsl_e6960d18-79ac-472b-acb5-31e2f33f6562/istio-proxy/0.log" Jun 11 21:52:03.116962 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:03.116924 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-rfwsl_e6960d18-79ac-472b-acb5-31e2f33f6562/istio-proxy/1.log" Jun 11 21:52:03.957697 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:03.957666 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zsdqt_c844507d-8ab2-40f2-8570-0c08231b4556/serve-healthcheck-canary/0.log" Jun 11 21:52:04.483693 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:04.483657 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bf64n_ee14ce04-4b48-48ed-8caa-f471a5c34963/kube-rbac-proxy/0.log" Jun 11 21:52:04.505188 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:04.505109 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bf64n_ee14ce04-4b48-48ed-8caa-f471a5c34963/exporter/0.log" Jun 11 21:52:04.527681 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:04.527652 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bf64n_ee14ce04-4b48-48ed-8caa-f471a5c34963/extractor/0.log" Jun 11 21:52:06.845015 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:06.844985 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-fbbf95586-mc2hq_b1bd4a87-7e1b-4463-87c4-2ee0800485fb/nginx/0.log" Jun 11 21:52:06.896583 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:06.896556 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-kw6sx_f384d18e-489c-491a-bb58-4940102bf98a/manager/0.log" Jun 11 21:52:07.011982 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:07.011947 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-tnb58_85086d2c-035e-4410-b669-f74e32ac7027/manager/0.log" Jun 11 21:52:07.107060 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:07.106987 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686905-zr7cj_4308d24e-44ca-4c9a-935f-0f5a920b3f3a/cleanup/0.log" Jun 11 21:52:07.233174 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:07.233144 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-r2kvq_52ab61ca-d1cd-4547-996b-4ddbaa98a5d7/server/0.log" Jun 11 21:52:07.303343 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:07.303303 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4mw4r_1310efed-aba6-48ba-9cdb-97a5ef818dbb/manager/0.log" Jun 11 21:52:07.461066 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:07.460981 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c5c8d746-65vjv_0d99b357-63d3-4624-a11e-28ce7e990a44/manager/0.log" Jun 11 21:52:07.477092 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:07.477063 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c5c8d746-65vjv_0d99b357-63d3-4624-a11e-28ce7e990a44/copy-manifests/0.log" Jun 11 21:52:07.488912 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:07.488883 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jg56s/perf-node-gather-daemonset-lzsvq" Jun 11 21:52:09.289862 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:09.289830 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2xmln_6468f3c8-8f85-442f-9bcb-5f0c8885a200/openshift-lws-operator/0.log" Jun 11 21:52:13.463068 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:13.463033 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mbvfq_b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60/discovery/0.log" Jun 11 21:52:13.481520 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:13.481496 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9dfcd5c9-5k9z5_39ab0555-80f0-4072-8fe7-e9b35a9ac0fe/kube-auth-proxy/0.log" Jun 11 21:52:13.548218 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:13.548191 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-rfwsl_e6960d18-79ac-472b-acb5-31e2f33f6562/istio-proxy/0.log" Jun 11 21:52:13.602298 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:13.602258 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-rfwsl_e6960d18-79ac-472b-acb5-31e2f33f6562/istio-proxy/1.log" Jun 11 21:52:14.985548 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:14.985520 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mbvfq_b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60/discovery/0.log" Jun 11 21:52:14.996612 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:14.996585 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9dfcd5c9-5k9z5_39ab0555-80f0-4072-8fe7-e9b35a9ac0fe/kube-auth-proxy/0.log" Jun 11 21:52:15.031902 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:15.031862 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-rfwsl_e6960d18-79ac-472b-acb5-31e2f33f6562/istio-proxy/0.log" Jun 11 21:52:15.084425 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:15.084387 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-rfwsl_e6960d18-79ac-472b-acb5-31e2f33f6562/istio-proxy/1.log" Jun 11 21:52:16.542999 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.542973 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spg87_ddd45043-2295-4655-acd6-21b2a603d6f5/kube-multus-additional-cni-plugins/0.log" Jun 11 21:52:16.562218 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.562188 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spg87_ddd45043-2295-4655-acd6-21b2a603d6f5/egress-router-binary-copy/0.log" Jun 11 21:52:16.580939 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.580915 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spg87_ddd45043-2295-4655-acd6-21b2a603d6f5/cni-plugins/0.log" Jun 11 21:52:16.600297 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.600265 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spg87_ddd45043-2295-4655-acd6-21b2a603d6f5/bond-cni-plugin/0.log" Jun 11 21:52:16.617786 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.617754 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spg87_ddd45043-2295-4655-acd6-21b2a603d6f5/routeoverride-cni/0.log" Jun 11 21:52:16.636019 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.635992 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spg87_ddd45043-2295-4655-acd6-21b2a603d6f5/whereabouts-cni-bincopy/0.log" Jun 11 21:52:16.654136 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.654109 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-spg87_ddd45043-2295-4655-acd6-21b2a603d6f5/whereabouts-cni/0.log" Jun 11 21:52:16.686263 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.686230 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v86bl_518203f3-50cb-4827-b9bf-be3e6dc2541b/kube-multus/0.log" Jun 11 21:52:16.798815 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.798743 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mbvfq_b3cc0f6e-83b8-47aa-ace6-5a16c15d7b60/discovery/0.log" Jun 11 21:52:16.807754 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.807699 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9dfcd5c9-5k9z5_39ab0555-80f0-4072-8fe7-e9b35a9ac0fe/kube-auth-proxy/0.log" Jun 11 21:52:16.845083 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.845047 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-rfwsl_e6960d18-79ac-472b-acb5-31e2f33f6562/istio-proxy/0.log" Jun 11 21:52:16.860199 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.860173 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zcvn9_7c16c48d-30ea-4a15-9a07-2e6659bb2474/network-metrics-daemon/0.log" Jun 11 21:52:16.882461 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.882416 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zcvn9_7c16c48d-30ea-4a15-9a07-2e6659bb2474/kube-rbac-proxy/0.log" Jun 11 21:52:16.911910 ip-10-0-135-86 kubenswrapper[2567]: I0611 21:52:16.911756 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-rfwsl_e6960d18-79ac-472b-acb5-31e2f33f6562/istio-proxy/1.log"