Jun 11 15:17:44.667406 ip-10-0-131-203 systemd[1]: Starting Kubernetes Kubelet... Jun 11 15:17:45.062229 ip-10-0-131-203 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:17:45.062229 ip-10-0-131-203 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 15:17:45.062229 ip-10-0-131-203 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:17:45.062229 ip-10-0-131-203 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 15:17:45.062229 ip-10-0-131-203 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:17:45.063142 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.063042 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 15:17:45.068417 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068395 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:45.068417 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068413 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:45.068417 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068419 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:45.068417 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068423 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068428 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068432 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068436 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068440 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068445 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068449 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068453 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068456 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068460 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068464 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068468 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068472 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068475 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068479 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068482 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068486 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068490 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068496 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068500 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:45.068659 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068505 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068509 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068513 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068517 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068521 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068525 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068530 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068534 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068537 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068541 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068545 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068549 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068553 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068558 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068563 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068568 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068572 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068576 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068580 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:45.069468 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068584 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068593 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068599 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068603 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068608 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068613 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068617 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068621 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068625 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068630 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068634 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068639 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068707 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068758 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068767 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068775 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068780 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068785 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068790 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:45.070120 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068794 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068799 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068803 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068809 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068813 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068819 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068829 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068834 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068932 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068938 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068943 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068947 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068953 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068958 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068962 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068967 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068971 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.068980 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069007 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069013 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:45.070606 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069018 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069022 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069026 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069031 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069035 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069039 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069054 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069059 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069064 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069071 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069077 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069088 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069093 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069098 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069103 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069108 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069113 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:45.071177 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.069118 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:45.071800 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071785 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:45.071800 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071801 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071805 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071808 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071812 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071815 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071818 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071821 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071824 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071826 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071829 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071832 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071834 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071837 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071839 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071842 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071845 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071847 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071850 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071852 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071855 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071858 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:45.071856 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071860 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071863 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071866 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071869 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071872 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071874 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071877 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071879 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071882 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071884 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071887 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071889 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071892 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071894 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071897 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071899 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071902 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071904 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071906 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:45.072442 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071909 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071911 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071914 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071916 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071919 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071921 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071925 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071928 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071931 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071934 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071937 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071940 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071942 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071945 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071948 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071951 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071954 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071957 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071961 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071963 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:45.072913 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071966 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071968 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071971 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071973 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071976 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071979 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071981 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071984 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.071986 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072003 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072007 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072011 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072014 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072017 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072021 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072024 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072026 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072029 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072031 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:45.073425 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072034 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072036 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072040 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072043 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072046 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072049 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072052 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072055 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072058 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072061 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072064 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072067 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072069 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072072 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072074 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072076 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072079 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072081 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072084 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:45.073882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072475 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072480 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072483 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072485 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072489 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072492 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072494 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072497 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072500 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072502 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072505 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072507 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072510 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072512 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072514 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072517 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072520 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072522 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072524 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072527 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:45.074368 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072530 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072533 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072535 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072538 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072540 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072543 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072545 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072548 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072550 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072553 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072555 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072558 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072560 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072563 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072566 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072568 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072571 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072573 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072576 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072578 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:45.074854 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072580 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072583 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072585 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072588 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072590 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072593 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072595 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072597 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072600 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072602 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072605 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072607 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072612 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072616 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072619 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072622 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072625 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072627 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072630 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:45.075365 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072633 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072636 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072638 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072641 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072643 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072646 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072649 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072651 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072654 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072656 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072658 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072661 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072664 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072667 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072669 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072673 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072675 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072677 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072680 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:45.075825 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072683 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072685 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072687 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072690 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072692 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072694 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072702 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072705 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072707 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072710 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072712 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072714 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072717 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072719 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072722 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072724 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072726 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072729 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072732 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072736 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:45.076308 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.072739 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072824 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072840 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072850 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072857 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072864 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072867 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072872 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072877 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072880 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072883 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072887 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072891 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072894 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072896 2560 flags.go:64] FLAG: --cgroup-root="" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072899 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072902 2560 flags.go:64] FLAG: --client-ca-file="" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072905 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072909 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072913 2560 flags.go:64] FLAG: --cluster-domain="" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072916 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072919 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072922 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072926 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 15:17:45.076784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072934 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072937 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072940 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072943 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072946 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072949 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072951 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072954 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072957 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072961 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072964 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072967 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072969 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072973 2560 flags.go:64] FLAG: --enable-server="true" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072976 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072982 2560 flags.go:64] FLAG: --event-burst="100" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072985 2560 flags.go:64] FLAG: --event-qps="50" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.072987 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073004 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073007 2560 flags.go:64] FLAG: --eviction-hard="" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073011 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073013 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073016 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073019 2560 flags.go:64] FLAG: --eviction-soft="" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073022 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 15:17:45.077381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073025 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073028 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073031 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073034 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073037 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073039 2560 flags.go:64] FLAG: --feature-gates="" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073043 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073046 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073049 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073052 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073055 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073058 2560 flags.go:64] FLAG: --help="false" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073061 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073063 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073066 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073069 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073072 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073075 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073078 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073081 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073086 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073089 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073098 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073101 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 15:17:45.078004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073104 2560 flags.go:64] FLAG: --kube-reserved="" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073107 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073109 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073112 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073115 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073117 2560 flags.go:64] FLAG: --lock-file="" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073120 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073123 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073126 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073135 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073138 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073141 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073144 2560 flags.go:64] FLAG: --logging-format="text" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073147 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073150 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073153 2560 flags.go:64] FLAG: --manifest-url="" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073156 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073160 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073163 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073167 2560 flags.go:64] FLAG: --max-pods="110" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073170 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073173 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073175 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073178 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073181 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 15:17:45.078619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073184 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073187 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073195 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073199 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073202 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073205 2560 flags.go:64] FLAG: --pod-cidr="" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073212 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073218 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073221 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073224 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073227 2560 flags.go:64] FLAG: --port="10250" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073229 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073232 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0945306212dee01ee" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073235 2560 flags.go:64] FLAG: --qos-reserved="" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073238 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073241 2560 flags.go:64] FLAG: --register-node="true" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073244 2560 flags.go:64] FLAG: --register-with-taints="" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073249 2560 flags.go:64] FLAG: --registry-burst="10" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073252 2560 flags.go:64] FLAG: --registry-qps="5" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073255 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073257 2560 flags.go:64] FLAG: --reserved-memory="" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073261 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073264 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073267 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073269 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 15:17:45.079247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073272 2560 flags.go:64] FLAG: --runonce="false" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073275 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073278 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073281 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073284 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073287 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073289 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073292 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073295 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073297 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073301 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073305 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073307 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073310 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073313 2560 flags.go:64] FLAG: --system-cgroups="" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073316 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073321 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073324 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073326 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073330 2560 flags.go:64] FLAG: --tls-min-version="" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073333 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073335 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073338 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073341 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073343 2560 flags.go:64] FLAG: --v="2" Jun 11 15:17:45.080190 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073348 2560 flags.go:64] FLAG: --version="false" Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073352 2560 flags.go:64] FLAG: --vmodule="" Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073355 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.073358 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073478 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073482 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073484 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073487 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073490 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073493 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073496 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073499 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073501 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073504 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073506 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073508 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073511 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073515 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073518 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073521 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:45.081253 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073523 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073525 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073528 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073531 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073533 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073536 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073539 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073542 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073545 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073547 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073550 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073554 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073557 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073559 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073562 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073565 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073567 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073570 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073572 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073575 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:45.082303 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073577 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073580 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073582 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073585 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073587 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073590 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073592 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073596 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073599 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073603 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073605 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073608 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073610 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073613 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073615 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073618 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073621 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073623 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073625 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:45.083237 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073628 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073632 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073635 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073638 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073642 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073645 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073647 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073650 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073652 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073655 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073657 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073659 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073662 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073664 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073667 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073669 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073672 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073674 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073677 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:45.083803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073680 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073683 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073686 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073693 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073696 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073698 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073701 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073703 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073705 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073708 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073711 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073714 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073716 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073718 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073721 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073723 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073725 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073729 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073731 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:45.084600 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073734 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073736 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073739 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073742 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073744 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.073747 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.074352 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.081861 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.081882 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.081910 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.081919 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082023 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082030 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082035 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:45.085399 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082040 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082044 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082048 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082052 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082055 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082059 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082063 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082067 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082071 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082075 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082079 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082082 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082086 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082090 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082093 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082097 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082100 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082104 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082108 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082111 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:45.085763 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082115 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082119 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082122 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082126 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082130 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082134 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082139 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082143 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082147 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082152 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082155 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082159 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082162 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082166 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082170 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082174 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082178 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082183 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082187 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082191 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:45.086443 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082195 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082201 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082207 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082211 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082216 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082221 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082225 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082230 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082234 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082239 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082243 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082247 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082253 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082259 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082265 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082269 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082273 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082278 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082282 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:45.086944 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082289 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082294 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082298 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082302 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082306 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082309 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082315 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082320 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082325 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082330 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082334 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082339 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082343 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082347 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082352 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082356 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082360 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082364 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082369 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:45.087475 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082373 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082377 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082381 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082385 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082390 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082394 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082399 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082403 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082407 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082411 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082415 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082420 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082424 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082429 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082434 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082438 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082442 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:45.087947 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082446 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.082454 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082675 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082687 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082695 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082700 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082705 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082710 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082716 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082722 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082727 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082731 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082736 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082740 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:45.088387 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082744 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082748 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082752 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082757 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082761 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082765 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082770 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082774 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082778 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082782 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082786 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082790 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082794 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082800 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082804 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082808 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082813 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082817 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082822 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:45.088776 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082828 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082833 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082838 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082842 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082847 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082852 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082856 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082860 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082864 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082868 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082872 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082876 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082880 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082885 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082889 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082894 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082898 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082902 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082906 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082911 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:45.089286 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082915 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082919 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082923 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082927 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082931 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082936 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082940 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082945 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082949 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082953 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082957 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082962 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082965 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082969 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082974 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082978 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082982 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.082986 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083010 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083014 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:45.089893 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083018 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083022 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083026 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083030 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083034 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083038 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083043 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083047 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083051 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083055 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083059 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083070 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083075 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083078 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083083 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083087 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083091 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083095 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083105 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083109 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:45.090454 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083113 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083117 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083122 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083127 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083131 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083136 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083140 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:45.083145 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.083153 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.083315 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.085943 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.087423 2560 server.go:1019] "Starting client certificate rotation" Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.087528 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:17:45.090953 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.087564 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:17:45.091660 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.091643 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:17:45.096655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.096631 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:17:45.106117 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.106095 2560 log.go:25] "Validated CRI v1 runtime API" Jun 11 15:17:45.109141 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.109123 2560 log.go:25] "Validated CRI v1 image API" Jun 11 15:17:45.112666 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.112639 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 15:17:45.116412 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.116392 2560 fs.go:135] Filesystem UUIDs: map[3ee2f50d-433d-4eb6-a8b1-0ac589e30fa5:/dev/nvme0n1p4 596b6384-cf44-43e0-84b5-f65e8c64841e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 11 15:17:45.116483 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.116411 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 15:17:45.120629 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.120612 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:17:45.122015 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.121894 2560 manager.go:216] Machine: {Timestamp:2026-06-11 15:17:45.120431392 +0000 UTC m=+0.331621185 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099024 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ae795bbdcdb197ae14459c7c5207a SystemUUID:ec2ae795-bbdc-db19-7ae1-4459c7c5207a BootID:6ceb13ed-540a-449e-b718-ad1b36408e45 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:2a:7b:fe:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:2a:7b:fe:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:29:cc:ac:df:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 15:17:45.122015 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.122014 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 15:17:45.122110 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.122099 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 15:17:45.125857 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.125827 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 15:17:45.126027 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.125859 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-203.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 15:17:45.126568 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.126558 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 15:17:45.126606 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.126571 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 15:17:45.126606 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.126578 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:17:45.127157 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.127146 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:17:45.127874 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.127865 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 15:17:45.130448 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.130436 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:17:45.130552 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.130543 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 15:17:45.130582 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.130573 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 11 15:17:45.130612 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.130584 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 15:17:45.130612 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.130594 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 15:17:45.130612 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.130604 2560 kubelet.go:398] "Adding apiserver pod source" Jun 11 15:17:45.130718 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.130626 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 15:17:45.131012 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.130978 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:17:45.139351 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.131029 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:17:45.141765 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.141746 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 15:17:45.143455 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.143441 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 15:17:45.143510 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.143481 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 15:17:45.143550 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.143510 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 15:17:45.143612 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.143594 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 15:17:45.144455 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144444 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 15:17:45.144495 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144462 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 15:17:45.144495 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144470 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 15:17:45.144495 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144478 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 15:17:45.144495 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144491 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 15:17:45.144495 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144497 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 15:17:45.144624 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144506 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 15:17:45.144624 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144511 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 15:17:45.144624 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144518 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 15:17:45.144624 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144523 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 15:17:45.144624 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144531 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 15:17:45.144624 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.144536 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 15:17:45.145854 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.145843 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 15:17:45.145891 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.145854 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 15:17:45.148962 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.148951 2560 server.go:1268] "Started kubelet" Jun 11 15:17:45.149093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.149065 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 15:17:45.149166 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.149115 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 15:17:45.149282 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.149064 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 15:17:45.149876 ip-10-0-131-203 systemd[1]: Started Kubernetes Kubelet. Jun 11 15:17:45.152949 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.152921 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vlkt8" Jun 11 15:17:45.153698 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.153675 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 15:17:45.154333 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.154316 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 11 15:17:45.155321 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.155294 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 15:17:45.158406 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.158389 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vlkt8" Jun 11 15:17:45.159166 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.159148 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-203.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 15:17:45.159410 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.159393 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 15:17:45.159499 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.159460 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 15:17:45.159499 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.159472 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:45.159876 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.159855 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 15:17:45.159876 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.159877 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 15:17:45.160156 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.159908 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 15:17:45.160156 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.160042 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 11 15:17:45.160156 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.160051 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 11 15:17:45.160156 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.159175 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-203.ec2.internal.18b80fd62b4d1dc9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-203.ec2.internal,UID:ip-10-0-131-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-203.ec2.internal,},FirstTimestamp:2026-06-11 15:17:45.148923337 +0000 UTC m=+0.360113177,LastTimestamp:2026-06-11 15:17:45.148923337 +0000 UTC m=+0.360113177,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-203.ec2.internal,}" Jun 11 15:17:45.160425 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.160356 2560 factory.go:55] Registering systemd factory Jun 11 15:17:45.160526 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.160488 2560 factory.go:223] Registration of the systemd container factory successfully Jun 11 15:17:45.160796 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.160783 2560 factory.go:153] Registering CRI-O factory Jun 11 15:17:45.160863 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.160800 2560 factory.go:223] Registration of the crio container factory successfully Jun 11 15:17:45.160863 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.160851 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 15:17:45.160960 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.160876 2560 factory.go:103] Registering Raw factory Jun 11 15:17:45.160960 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.160891 2560 manager.go:1196] Started watching for new ooms in manager Jun 11 15:17:45.161321 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.161306 2560 manager.go:349] Starting recovery of all containers Jun 11 15:17:45.170230 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.170212 2560 manager.go:354] Recovery completed Jun 11 15:17:45.173600 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.173577 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:45.175822 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.175806 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:45.177598 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.177582 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:45.177676 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.177615 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:45.177676 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.177630 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:45.178024 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.177986 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-203.ec2.internal\" not found" node="ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.178217 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.178202 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 15:17:45.178217 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.178210 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:45.178217 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.178214 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 15:17:45.178367 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.178230 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:17:45.178884 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.178866 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:45.178950 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.178890 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:45.178950 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.178900 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:45.179243 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.179232 2560 policy_none.go:49] "None policy: Start" Jun 11 15:17:45.179276 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.179249 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 15:17:45.179276 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.179259 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 15:17:45.180294 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.180283 2560 policy_none.go:47] "Start" Jun 11 15:17:45.218714 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.218543 2560 manager.go:337] "Starting Device Plugin manager" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.218763 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.218778 2560 server.go:87] "Starting device plugin registration server" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.219018 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.219028 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.219245 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.219368 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.219379 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.219781 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.219831 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.227726 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.229065 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.229104 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.229146 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 15:17:45.230093 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.229234 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 15:17:45.232074 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.232058 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:45.319361 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.319289 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:45.320345 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.320328 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:45.320415 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.320361 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:45.320415 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.320372 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:45.320415 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.320398 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.327854 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.327838 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.327909 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.327863 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-203.ec2.internal\": node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:45.330081 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.330068 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal"] Jun 11 15:17:45.330127 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.330120 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:45.331405 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.331388 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:45.331487 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.331414 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:45.331487 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.331423 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:45.332642 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.332629 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:45.332788 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.332773 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.332834 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.332805 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:45.333313 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.333299 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:45.333313 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.333309 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:45.333420 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.333324 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:45.333420 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.333330 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:45.333420 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.333339 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:45.333420 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.333340 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:45.334614 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.334602 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.334656 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.334626 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:45.335245 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.335232 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:45.335312 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.335254 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:45.335312 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.335263 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:45.341979 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.341960 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:45.359628 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.359609 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-203.ec2.internal\" not found" node="ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.363928 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.363914 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-203.ec2.internal\" not found" node="ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.443096 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.443054 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:45.460342 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.460316 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcbedfb6ff371c65b8369e3364d37993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal\" (UID: \"bcbedfb6ff371c65b8369e3364d37993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.460442 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.460344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcbedfb6ff371c65b8369e3364d37993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal\" (UID: \"bcbedfb6ff371c65b8369e3364d37993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.460442 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.460382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6bb98369c1cbcd0b4b0ea517d85aa9e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-203.ec2.internal\" (UID: \"c6bb98369c1cbcd0b4b0ea517d85aa9e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.543898 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.543865 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:45.561401 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.561357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcbedfb6ff371c65b8369e3364d37993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal\" (UID: \"bcbedfb6ff371c65b8369e3364d37993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.561401 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.561407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcbedfb6ff371c65b8369e3364d37993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal\" (UID: \"bcbedfb6ff371c65b8369e3364d37993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.561549 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.561425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6bb98369c1cbcd0b4b0ea517d85aa9e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-203.ec2.internal\" (UID: \"c6bb98369c1cbcd0b4b0ea517d85aa9e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.561549 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.561467 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6bb98369c1cbcd0b4b0ea517d85aa9e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-203.ec2.internal\" (UID: \"c6bb98369c1cbcd0b4b0ea517d85aa9e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.561549 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.561471 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcbedfb6ff371c65b8369e3364d37993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal\" (UID: \"bcbedfb6ff371c65b8369e3364d37993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.561549 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.561468 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcbedfb6ff371c65b8369e3364d37993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal\" (UID: \"bcbedfb6ff371c65b8369e3364d37993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.644821 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.644793 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:45.663207 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.663178 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.667961 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:45.667941 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal" Jun 11 15:17:45.745628 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.745590 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:45.846088 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.846059 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:45.946646 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:45.946559 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:46.047134 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:46.047108 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:46.086580 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.086552 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 15:17:46.087174 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.086717 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:17:46.087174 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.086749 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:17:46.134346 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:46.134307 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcbedfb6ff371c65b8369e3364d37993.slice/crio-dfef44f079922d636822407e33d2dcf5a6e88f322c964726d0ac8494fc397ada WatchSource:0}: Error finding container dfef44f079922d636822407e33d2dcf5a6e88f322c964726d0ac8494fc397ada: Status 404 returned error can't find the container with id dfef44f079922d636822407e33d2dcf5a6e88f322c964726d0ac8494fc397ada Jun 11 15:17:46.134824 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:46.134804 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bb98369c1cbcd0b4b0ea517d85aa9e.slice/crio-29ba780e2d39ab3482b874bef2d9a1916c125e2c114d63309db22c98a6c8ab35 WatchSource:0}: Error finding container 29ba780e2d39ab3482b874bef2d9a1916c125e2c114d63309db22c98a6c8ab35: Status 404 returned error can't find the container with id 29ba780e2d39ab3482b874bef2d9a1916c125e2c114d63309db22c98a6c8ab35 Jun 11 15:17:46.139968 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.139954 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:17:46.147204 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:46.147183 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-203.ec2.internal\" not found" Jun 11 15:17:46.161062 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.161032 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 15:12:45 +0000 UTC" deadline="2028-03-25 06:03:11.8303448 +0000 UTC" Jun 11 15:17:46.161062 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.161057 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15662h45m25.669290915s" Jun 11 15:17:46.227858 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.227777 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:46.232004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.231954 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" event={"ID":"bcbedfb6ff371c65b8369e3364d37993","Type":"ContainerStarted","Data":"dfef44f079922d636822407e33d2dcf5a6e88f322c964726d0ac8494fc397ada"} Jun 11 15:17:46.232937 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.232903 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal" event={"ID":"c6bb98369c1cbcd0b4b0ea517d85aa9e","Type":"ContainerStarted","Data":"29ba780e2d39ab3482b874bef2d9a1916c125e2c114d63309db22c98a6c8ab35"} Jun 11 15:17:46.259899 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.259877 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" Jun 11 15:17:46.272020 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.271984 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:17:46.273627 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.273614 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal" Jun 11 15:17:46.281662 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.281647 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:17:46.704584 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:46.704553 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:47.110192 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.110106 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:47.113178 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.113155 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:47.132322 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.132294 2560 apiserver.go:52] "Watching apiserver" Jun 11 15:17:47.141471 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.139804 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 15:17:47.142267 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.142233 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cw7jd","kube-system/konnectivity-agent-r96qj","kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal","openshift-multus/multus-additional-cni-plugins-tqt5g","openshift-network-diagnostics/network-check-target-p25nh","openshift-network-operator/iptables-alerter-j4vwk","openshift-cluster-node-tuning-operator/tuned-nxpwb","openshift-dns/node-resolver-tw7qk","openshift-image-registry/node-ca-shj99","openshift-multus/multus-kbghf","openshift-multus/network-metrics-daemon-xvlkl","openshift-ovn-kubernetes/ovnkube-node-wvsr5"] Jun 11 15:17:47.143795 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.143777 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:47.143876 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.143855 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:17:47.145260 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.145243 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.146605 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.146587 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.150327 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.150303 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hn42x\"" Jun 11 15:17:47.150420 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.150385 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 15:17:47.150562 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.150542 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 15:17:47.150662 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.150606 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 15:17:47.150838 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.150817 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 15:17:47.150917 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.150854 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 15:17:47.150984 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.150547 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 15:17:47.151075 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.151060 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 15:17:47.151166 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.151141 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 15:17:47.151268 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.151253 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.151381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.151366 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-52zkt\"" Jun 11 15:17:47.151647 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.151618 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.151718 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.151647 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 15:17:47.152004 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.151969 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.153057 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.153039 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.154584 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.154568 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:47.154704 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.154662 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:17:47.155840 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.155820 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:17:47.156372 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.156351 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:17:47.156465 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.156431 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 15:17:47.156664 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.156615 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:17:47.156744 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.156693 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 15:17:47.156792 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.156750 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vj792\"" Jun 11 15:17:47.157206 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.157038 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 15:17:47.157206 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.157146 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 15:17:47.157344 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.157284 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 15:17:47.157511 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.157495 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.157703 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.157676 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gkl8n\"" Jun 11 15:17:47.159183 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.159167 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:47.159270 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.159232 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:17:47.160410 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.160140 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 15:17:47.160410 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.160314 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 15:17:47.162151 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.160634 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 15:17:47.162151 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.160719 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bzbzj\"" Jun 11 15:17:47.162151 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.160944 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 15:17:47.162151 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.160957 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 15:17:47.162151 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.161151 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 15:17:47.162151 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.161254 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 15:17:47.162151 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.161570 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 15:17:47.162151 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.161910 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 15:17:47.162151 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.162039 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 15:17:47.162597 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.162180 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 15:17:47.162597 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.162242 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lwck2\"" Jun 11 15:17:47.162597 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.162314 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8ztsq\"" Jun 11 15:17:47.162963 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.162936 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qzprj\"" Jun 11 15:17:47.163308 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.163285 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.169352 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.169330 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 15:17:47.169735 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.169716 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c2c5t\"" Jun 11 15:17:47.171049 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171011 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59c700d7-40aa-4758-8642-50c7f6efee9a-agent-certs\") pod \"konnectivity-agent-r96qj\" (UID: \"59c700d7-40aa-4758-8642-50c7f6efee9a\") " pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:17:47.171141 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171067 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvxcz\" (UniqueName: \"kubernetes.io/projected/ec312546-eabd-4bf5-b4fa-107a6791ec0a-kube-api-access-kvxcz\") pod \"node-ca-shj99\" (UID: \"ec312546-eabd-4bf5-b4fa-107a6791ec0a\") " pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.171203 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-systemd-units\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.171259 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171199 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-node-log\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.171259 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171224 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-system-cni-dir\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.171360 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171255 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bk6k\" (UniqueName: \"kubernetes.io/projected/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-kube-api-access-5bk6k\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.171360 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-modprobe-d\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.171360 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171313 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjghw\" (UniqueName: \"kubernetes.io/projected/509bb5c1-530c-4de7-b81c-7b22af82c173-kube-api-access-tjghw\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.171360 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171340 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3198fde8-993b-4cb9-82f3-142f563d542f-ovnkube-config\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.171554 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7lsx\" (UniqueName: \"kubernetes.io/projected/3198fde8-993b-4cb9-82f3-142f563d542f-kube-api-access-h7lsx\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.171554 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171415 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-os-release\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.171554 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171448 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:47.171691 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.171743 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171694 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-registration-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.171799 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171747 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-hostroot\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.171956 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-etc-kubernetes\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.171956 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171835 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-log-socket\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.171956 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171867 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-cni-netd\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.171956 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd12749a-f6b9-493e-b292-794160091523-multus-daemon-config\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.171956 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3198fde8-993b-4cb9-82f3-142f563d542f-env-overrides\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.172231 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.171974 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-device-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.172231 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172031 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-sysctl-d\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.172231 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-multus-conf-dir\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.172231 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-kubelet\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.172231 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172175 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-socket-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.172231 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.172496 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-lib-modules\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.172496 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172312 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-var-lib-kubelet\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.172496 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172363 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59c700d7-40aa-4758-8642-50c7f6efee9a-konnectivity-ca\") pod \"konnectivity-agent-r96qj\" (UID: \"59c700d7-40aa-4758-8642-50c7f6efee9a\") " pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:17:47.172496 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-multus-cni-dir\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.172496 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-var-lib-cni-bin\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.172496 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-run-systemd\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.172496 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172483 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.172877 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172513 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-sysconfig\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.172877 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqcmn\" (UniqueName: \"kubernetes.io/projected/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-kube-api-access-xqcmn\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:47.172877 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172616 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-system-cni-dir\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.172877 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-var-lib-kubelet\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.172877 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-sys-fs\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.172877 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-sys\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.172877 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172812 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-cnibin\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.172877 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172844 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.172877 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-etc-selinux\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-systemd\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vs7\" (UniqueName: \"kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7\") pod \"network-check-target-p25nh\" (UID: \"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d\") " pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172952 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-os-release\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.172980 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-var-lib-openvswitch\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-run-openvswitch\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173059 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bf6c2b6-01c8-4995-9f22-350ed453fd06-kubelet-config\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173084 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/546a5e49-90ce-450d-98ab-e223385e4e39-tmp-dir\") pod \"node-resolver-tw7qk\" (UID: \"546a5e49-90ce-450d-98ab-e223385e4e39\") " pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-var-lib-cni-multus\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173139 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/509bb5c1-530c-4de7-b81c-7b22af82c173-tmp\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173171 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeeba33f-8886-4670-a133-8f1fcc11d4cb-iptables-alerter-script\") pod \"iptables-alerter-j4vwk\" (UID: \"eeeba33f-8886-4670-a133-8f1fcc11d4cb\") " pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173195 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3198fde8-993b-4cb9-82f3-142f563d542f-ovn-node-metrics-cert\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngbmp\" (UniqueName: \"kubernetes.io/projected/8b9ed52b-de91-4067-aa1c-18c0d04ee423-kube-api-access-ngbmp\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.173279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173260 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-run-netns\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-etc-openvswitch\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-run-ovn\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-host\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173372 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173400 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-multus-socket-dir-parent\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-run-netns\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173454 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec312546-eabd-4bf5-b4fa-107a6791ec0a-host\") pod \"node-ca-shj99\" (UID: \"ec312546-eabd-4bf5-b4fa-107a6791ec0a\") " pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173490 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-tuned\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173515 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmngs\" (UniqueName: \"kubernetes.io/projected/eeeba33f-8886-4670-a133-8f1fcc11d4cb-kube-api-access-jmngs\") pod \"iptables-alerter-j4vwk\" (UID: \"eeeba33f-8886-4670-a133-8f1fcc11d4cb\") " pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/546a5e49-90ce-450d-98ab-e223385e4e39-hosts-file\") pod \"node-resolver-tw7qk\" (UID: \"546a5e49-90ce-450d-98ab-e223385e4e39\") " pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27rmh\" (UniqueName: \"kubernetes.io/projected/cd12749a-f6b9-493e-b292-794160091523-kube-api-access-27rmh\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec312546-eabd-4bf5-b4fa-107a6791ec0a-serviceca\") pod \"node-ca-shj99\" (UID: \"ec312546-eabd-4bf5-b4fa-107a6791ec0a\") " pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173676 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173700 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeeba33f-8886-4670-a133-8f1fcc11d4cb-host-slash\") pod \"iptables-alerter-j4vwk\" (UID: \"eeeba33f-8886-4670-a133-8f1fcc11d4cb\") " pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.173825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173777 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh5nb\" (UniqueName: \"kubernetes.io/projected/546a5e49-90ce-450d-98ab-e223385e4e39-kube-api-access-wh5nb\") pod \"node-resolver-tw7qk\" (UID: \"546a5e49-90ce-450d-98ab-e223385e4e39\") " pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173835 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3198fde8-993b-4cb9-82f3-142f563d542f-ovnkube-script-lib\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173894 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-cnibin\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.173950 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.174006 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-sysctl-conf\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.174035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd12749a-f6b9-493e-b292-794160091523-cni-binary-copy\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.174070 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-run-multus-certs\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.174204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-cni-bin\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.174233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-run\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.174312 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-run-k8s-cni-cncf-io\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.174345 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-slash\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.174366 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-kubernetes\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.174615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.174394 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bf6c2b6-01c8-4995-9f22-350ed453fd06-dbus\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:47.183515 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.183466 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:17:47.200710 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.200684 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xrqlb" Jun 11 15:17:47.212076 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.212055 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xrqlb" Jun 11 15:17:47.261570 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.261540 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 15:17:47.275631 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.275597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/546a5e49-90ce-450d-98ab-e223385e4e39-tmp-dir\") pod \"node-resolver-tw7qk\" (UID: \"546a5e49-90ce-450d-98ab-e223385e4e39\") " pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.275799 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.275644 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-var-lib-cni-multus\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.275799 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.275678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/509bb5c1-530c-4de7-b81c-7b22af82c173-tmp\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.275799 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.275743 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-var-lib-cni-multus\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.275930 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.275844 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeeba33f-8886-4670-a133-8f1fcc11d4cb-iptables-alerter-script\") pod \"iptables-alerter-j4vwk\" (UID: \"eeeba33f-8886-4670-a133-8f1fcc11d4cb\") " pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.275930 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.275885 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3198fde8-993b-4cb9-82f3-142f563d542f-ovn-node-metrics-cert\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.275930 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.275915 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngbmp\" (UniqueName: \"kubernetes.io/projected/8b9ed52b-de91-4067-aa1c-18c0d04ee423-kube-api-access-ngbmp\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.276083 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.275940 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-run-netns\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.276083 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.275964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-etc-openvswitch\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.276083 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276005 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-run-ovn\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.276083 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-host\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.276083 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276051 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/546a5e49-90ce-450d-98ab-e223385e4e39-tmp-dir\") pod \"node-resolver-tw7qk\" (UID: \"546a5e49-90ce-450d-98ab-e223385e4e39\") " pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276103 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-run-netns\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276153 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-etc-openvswitch\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.276156 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276190 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276204 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-host\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.276217 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs podName:5f92ba05-ee12-41ed-9793-f8afe2fa6e6a nodeName:}" failed. No retries permitted until 2026-06-11 15:17:47.77619037 +0000 UTC m=+2.987380146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs") pod "network-metrics-daemon-xvlkl" (UID: "5f92ba05-ee12-41ed-9793-f8afe2fa6e6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-run-ovn\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276051 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-multus-socket-dir-parent\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-run-netns\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276353 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec312546-eabd-4bf5-b4fa-107a6791ec0a-host\") pod \"node-ca-shj99\" (UID: \"ec312546-eabd-4bf5-b4fa-107a6791ec0a\") " pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276394 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec312546-eabd-4bf5-b4fa-107a6791ec0a-host\") pod \"node-ca-shj99\" (UID: \"ec312546-eabd-4bf5-b4fa-107a6791ec0a\") " pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276394 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-run-netns\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276405 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-multus-socket-dir-parent\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-tuned\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmngs\" (UniqueName: \"kubernetes.io/projected/eeeba33f-8886-4670-a133-8f1fcc11d4cb-kube-api-access-jmngs\") pod \"iptables-alerter-j4vwk\" (UID: \"eeeba33f-8886-4670-a133-8f1fcc11d4cb\") " pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/546a5e49-90ce-450d-98ab-e223385e4e39-hosts-file\") pod \"node-resolver-tw7qk\" (UID: \"546a5e49-90ce-450d-98ab-e223385e4e39\") " pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.276681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27rmh\" (UniqueName: \"kubernetes.io/projected/cd12749a-f6b9-493e-b292-794160091523-kube-api-access-27rmh\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276511 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec312546-eabd-4bf5-b4fa-107a6791ec0a-serviceca\") pod \"node-ca-shj99\" (UID: \"ec312546-eabd-4bf5-b4fa-107a6791ec0a\") " pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276491 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeeba33f-8886-4670-a133-8f1fcc11d4cb-iptables-alerter-script\") pod \"iptables-alerter-j4vwk\" (UID: \"eeeba33f-8886-4670-a133-8f1fcc11d4cb\") " pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/546a5e49-90ce-450d-98ab-e223385e4e39-hosts-file\") pod \"node-resolver-tw7qk\" (UID: \"546a5e49-90ce-450d-98ab-e223385e4e39\") " pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276709 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeeba33f-8886-4670-a133-8f1fcc11d4cb-host-slash\") pod \"iptables-alerter-j4vwk\" (UID: \"eeeba33f-8886-4670-a133-8f1fcc11d4cb\") " pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh5nb\" (UniqueName: \"kubernetes.io/projected/546a5e49-90ce-450d-98ab-e223385e4e39-kube-api-access-wh5nb\") pod \"node-resolver-tw7qk\" (UID: \"546a5e49-90ce-450d-98ab-e223385e4e39\") " pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276818 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3198fde8-993b-4cb9-82f3-142f563d542f-ovnkube-script-lib\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276862 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-cnibin\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276868 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeeba33f-8886-4670-a133-8f1fcc11d4cb-host-slash\") pod \"iptables-alerter-j4vwk\" (UID: \"eeeba33f-8886-4670-a133-8f1fcc11d4cb\") " pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276906 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-sysctl-conf\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276928 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd12749a-f6b9-493e-b292-794160091523-cni-binary-copy\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-run-multus-certs\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276974 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-cni-bin\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.277655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276979 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec312546-eabd-4bf5-b4fa-107a6791ec0a-serviceca\") pod \"node-ca-shj99\" (UID: \"ec312546-eabd-4bf5-b4fa-107a6791ec0a\") " pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277019 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-run\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-run-k8s-cni-cncf-io\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-slash\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277081 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277099 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-kubernetes\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277128 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bf6c2b6-01c8-4995-9f22-350ed453fd06-dbus\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59c700d7-40aa-4758-8642-50c7f6efee9a-agent-certs\") pod \"konnectivity-agent-r96qj\" (UID: \"59c700d7-40aa-4758-8642-50c7f6efee9a\") " pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.276975 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-cnibin\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277178 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvxcz\" (UniqueName: \"kubernetes.io/projected/ec312546-eabd-4bf5-b4fa-107a6791ec0a-kube-api-access-kvxcz\") pod \"node-ca-shj99\" (UID: \"ec312546-eabd-4bf5-b4fa-107a6791ec0a\") " pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-systemd-units\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-node-log\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-system-cni-dir\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277287 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bk6k\" (UniqueName: \"kubernetes.io/projected/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-kube-api-access-5bk6k\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277313 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-modprobe-d\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjghw\" (UniqueName: \"kubernetes.io/projected/509bb5c1-530c-4de7-b81c-7b22af82c173-kube-api-access-tjghw\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3198fde8-993b-4cb9-82f3-142f563d542f-ovnkube-config\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.278477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277385 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7lsx\" (UniqueName: \"kubernetes.io/projected/3198fde8-993b-4cb9-82f3-142f563d542f-kube-api-access-h7lsx\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277411 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-os-release\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277517 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-registration-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-hostroot\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277587 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-etc-kubernetes\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277611 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-log-socket\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277834 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3198fde8-993b-4cb9-82f3-142f563d542f-ovnkube-script-lib\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277904 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.277638 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-cni-netd\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278142 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd12749a-f6b9-493e-b292-794160091523-multus-daemon-config\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278155 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-run\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278168 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3198fde8-993b-4cb9-82f3-142f563d542f-env-overrides\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-device-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278202 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-run-k8s-cni-cncf-io\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278218 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-sysctl-d\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.279301 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278238 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-slash\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-multus-conf-dir\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278269 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-kubelet\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-socket-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278316 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278317 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-kubernetes\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278344 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-lib-modules\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278385 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bf6c2b6-01c8-4995-9f22-350ed453fd06-dbus\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278387 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-var-lib-kubelet\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59c700d7-40aa-4758-8642-50c7f6efee9a-konnectivity-ca\") pod \"konnectivity-agent-r96qj\" (UID: \"59c700d7-40aa-4758-8642-50c7f6efee9a\") " pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278434 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-var-lib-kubelet\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278457 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-multus-cni-dir\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278465 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-sysctl-conf\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-var-lib-cni-bin\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278506 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-modprobe-d\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-run-systemd\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.279986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278561 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-cni-netd\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278587 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd12749a-f6b9-493e-b292-794160091523-cni-binary-copy\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278618 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-sysconfig\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278645 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-cni-bin\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqcmn\" (UniqueName: \"kubernetes.io/projected/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-kube-api-access-xqcmn\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278683 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-system-cni-dir\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278710 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-multus-cni-dir\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-var-lib-kubelet\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-sys-fs\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278792 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-sys\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278816 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-cnibin\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278888 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-etc-selinux\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278912 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-systemd\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vs7\" (UniqueName: \"kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7\") pod \"network-check-target-p25nh\" (UID: \"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d\") " pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-os-release\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279048 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-var-lib-openvswitch\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.280529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279073 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-run-openvswitch\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279108 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3198fde8-993b-4cb9-82f3-142f563d542f-ovnkube-config\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279128 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bf6c2b6-01c8-4995-9f22-350ed453fd06-kubelet-config\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.278519 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-run-multus-certs\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279257 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd12749a-f6b9-493e-b292-794160091523-multus-daemon-config\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279275 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-sys\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279347 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-cnibin\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279386 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279436 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-etc-selinux\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279480 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-systemd\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279631 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3198fde8-993b-4cb9-82f3-142f563d542f-env-overrides\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279685 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-device-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279726 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-os-release\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279815 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-systemd-units\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279842 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-system-cni-dir\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279853 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-registration-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279867 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-node-log\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279887 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-hostroot\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.281145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279907 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-system-cni-dir\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279928 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-etc-kubernetes\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279939 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-var-lib-kubelet\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.279961 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-log-socket\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280018 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280034 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-lib-modules\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280064 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-var-lib-openvswitch\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280076 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-sys-fs\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280094 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-run-openvswitch\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280109 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-host-var-lib-cni-bin\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280145 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-run-systemd\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bf6c2b6-01c8-4995-9f22-350ed453fd06-kubelet-config\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.280220 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280230 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-sysctl-d\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.280289 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret podName:5bf6c2b6-01c8-4995-9f22-350ed453fd06 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:47.780268402 +0000 UTC m=+2.991458197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret") pod "global-pull-secret-syncer-cw7jd" (UID: "5bf6c2b6-01c8-4995-9f22-350ed453fd06") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280287 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd12749a-f6b9-493e-b292-794160091523-multus-conf-dir\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280330 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3198fde8-993b-4cb9-82f3-142f563d542f-host-kubelet\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.281866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280391 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59c700d7-40aa-4758-8642-50c7f6efee9a-konnectivity-ca\") pod \"konnectivity-agent-r96qj\" (UID: \"59c700d7-40aa-4758-8642-50c7f6efee9a\") " pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:17:47.282625 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280488 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-sysconfig\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.282625 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b9ed52b-de91-4067-aa1c-18c0d04ee423-socket-dir\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.282625 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280565 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-os-release\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.282625 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280629 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3198fde8-993b-4cb9-82f3-142f563d542f-ovn-node-metrics-cert\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.282625 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280758 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/509bb5c1-530c-4de7-b81c-7b22af82c173-etc-tuned\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.282625 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280823 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/509bb5c1-530c-4de7-b81c-7b22af82c173-tmp\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.282625 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.280894 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.282625 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.282617 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59c700d7-40aa-4758-8642-50c7f6efee9a-agent-certs\") pod \"konnectivity-agent-r96qj\" (UID: \"59c700d7-40aa-4758-8642-50c7f6efee9a\") " pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:17:47.284140 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.284116 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.289266 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.289245 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:47.289266 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.289269 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:47.289671 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.289282 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m8vs7 for pod openshift-network-diagnostics/network-check-target-p25nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:47.289671 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.289355 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7 podName:6a9c378a-8d6f-4ecb-88df-7797eaba5a0d nodeName:}" failed. No retries permitted until 2026-06-11 15:17:47.789335145 +0000 UTC m=+3.000524921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m8vs7" (UniqueName: "kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7") pod "network-check-target-p25nh" (UID: "6a9c378a-8d6f-4ecb-88df-7797eaba5a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:47.291184 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.291158 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngbmp\" (UniqueName: \"kubernetes.io/projected/8b9ed52b-de91-4067-aa1c-18c0d04ee423-kube-api-access-ngbmp\") pod \"aws-ebs-csi-driver-node-pk982\" (UID: \"8b9ed52b-de91-4067-aa1c-18c0d04ee423\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.291720 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.291314 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh5nb\" (UniqueName: \"kubernetes.io/projected/546a5e49-90ce-450d-98ab-e223385e4e39-kube-api-access-wh5nb\") pod \"node-resolver-tw7qk\" (UID: \"546a5e49-90ce-450d-98ab-e223385e4e39\") " pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.291720 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.291664 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27rmh\" (UniqueName: \"kubernetes.io/projected/cd12749a-f6b9-493e-b292-794160091523-kube-api-access-27rmh\") pod \"multus-kbghf\" (UID: \"cd12749a-f6b9-493e-b292-794160091523\") " pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.292798 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.292773 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqcmn\" (UniqueName: \"kubernetes.io/projected/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-kube-api-access-xqcmn\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:47.293314 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.293294 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvxcz\" (UniqueName: \"kubernetes.io/projected/ec312546-eabd-4bf5-b4fa-107a6791ec0a-kube-api-access-kvxcz\") pod \"node-ca-shj99\" (UID: \"ec312546-eabd-4bf5-b4fa-107a6791ec0a\") " pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.293392 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.293358 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmngs\" (UniqueName: \"kubernetes.io/projected/eeeba33f-8886-4670-a133-8f1fcc11d4cb-kube-api-access-jmngs\") pod \"iptables-alerter-j4vwk\" (UID: \"eeeba33f-8886-4670-a133-8f1fcc11d4cb\") " pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.293447 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.293400 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bk6k\" (UniqueName: \"kubernetes.io/projected/4f6d0be2-601b-46ad-a350-fa4b5f461f0c-kube-api-access-5bk6k\") pod \"multus-additional-cni-plugins-tqt5g\" (UID: \"4f6d0be2-601b-46ad-a350-fa4b5f461f0c\") " pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.293735 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.293718 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjghw\" (UniqueName: \"kubernetes.io/projected/509bb5c1-530c-4de7-b81c-7b22af82c173-kube-api-access-tjghw\") pod \"tuned-nxpwb\" (UID: \"509bb5c1-530c-4de7-b81c-7b22af82c173\") " pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.294695 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.294675 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7lsx\" (UniqueName: \"kubernetes.io/projected/3198fde8-993b-4cb9-82f3-142f563d542f-kube-api-access-h7lsx\") pod \"ovnkube-node-wvsr5\" (UID: \"3198fde8-993b-4cb9-82f3-142f563d542f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.459110 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.459071 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-shj99" Jun 11 15:17:47.466489 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.466467 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:17:47.477474 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.477447 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" Jun 11 15:17:47.483757 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.483734 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j4vwk" Jun 11 15:17:47.490284 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.490259 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" Jun 11 15:17:47.497809 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.497791 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" Jun 11 15:17:47.505333 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.505313 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:17:47.511853 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.511832 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tw7qk" Jun 11 15:17:47.517515 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.517497 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kbghf" Jun 11 15:17:47.782380 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.782303 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:47.782380 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.782355 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:47.782548 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.782457 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:47.782548 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.782509 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs podName:5f92ba05-ee12-41ed-9793-f8afe2fa6e6a nodeName:}" failed. No retries permitted until 2026-06-11 15:17:48.782495365 +0000 UTC m=+3.993685140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs") pod "network-metrics-daemon-xvlkl" (UID: "5f92ba05-ee12-41ed-9793-f8afe2fa6e6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:47.782548 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.782457 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:47.782727 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.782571 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret podName:5bf6c2b6-01c8-4995-9f22-350ed453fd06 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:48.782560284 +0000 UTC m=+3.993750058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret") pod "global-pull-secret-syncer-cw7jd" (UID: "5bf6c2b6-01c8-4995-9f22-350ed453fd06") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:47.883485 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:47.883444 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vs7\" (UniqueName: \"kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7\") pod \"network-check-target-p25nh\" (UID: \"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d\") " pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:47.883635 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.883613 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:47.883690 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.883637 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:47.883690 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.883649 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m8vs7 for pod openshift-network-diagnostics/network-check-target-p25nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:47.883769 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:47.883705 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7 podName:6a9c378a-8d6f-4ecb-88df-7797eaba5a0d nodeName:}" failed. No retries permitted until 2026-06-11 15:17:48.883685063 +0000 UTC m=+4.094874843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m8vs7" (UniqueName: "kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7") pod "network-check-target-p25nh" (UID: "6a9c378a-8d6f-4ecb-88df-7797eaba5a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:48.077546 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:48.077506 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c700d7_40aa_4758_8642_50c7f6efee9a.slice/crio-371c0e218e44282ef8d663a971a371757133ee7da5d21d6ac612698111d3954d WatchSource:0}: Error finding container 371c0e218e44282ef8d663a971a371757133ee7da5d21d6ac612698111d3954d: Status 404 returned error can't find the container with id 371c0e218e44282ef8d663a971a371757133ee7da5d21d6ac612698111d3954d Jun 11 15:17:48.078436 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:48.078390 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9ed52b_de91_4067_aa1c_18c0d04ee423.slice/crio-42961652b9ae0a83a4fd9ba8856c2883146eb0673733b967db32bf5c27b159d4 WatchSource:0}: Error finding container 42961652b9ae0a83a4fd9ba8856c2883146eb0673733b967db32bf5c27b159d4: Status 404 returned error can't find the container with id 42961652b9ae0a83a4fd9ba8856c2883146eb0673733b967db32bf5c27b159d4 Jun 11 15:17:48.081358 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:48.081339 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546a5e49_90ce_450d_98ab_e223385e4e39.slice/crio-3a3639db964e2d28ac99e60194a2112ab1b0b9ad797955b27818d9ab03859755 WatchSource:0}: Error finding container 3a3639db964e2d28ac99e60194a2112ab1b0b9ad797955b27818d9ab03859755: Status 404 returned error can't find the container with id 3a3639db964e2d28ac99e60194a2112ab1b0b9ad797955b27818d9ab03859755 Jun 11 15:17:48.083657 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:48.083632 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec312546_eabd_4bf5_b4fa_107a6791ec0a.slice/crio-b87673ab058383cfc1b442606a57cc6dfd26c5b06884663ea41c885a325b8b83 WatchSource:0}: Error finding container b87673ab058383cfc1b442606a57cc6dfd26c5b06884663ea41c885a325b8b83: Status 404 returned error can't find the container with id b87673ab058383cfc1b442606a57cc6dfd26c5b06884663ea41c885a325b8b83 Jun 11 15:17:48.084431 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:48.084408 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeeba33f_8886_4670_a133_8f1fcc11d4cb.slice/crio-4db59464a69105e0fe9cc8297b88694bcb3546f8d174da0206f44bb2dce65f5d WatchSource:0}: Error finding container 4db59464a69105e0fe9cc8297b88694bcb3546f8d174da0206f44bb2dce65f5d: Status 404 returned error can't find the container with id 4db59464a69105e0fe9cc8297b88694bcb3546f8d174da0206f44bb2dce65f5d Jun 11 15:17:48.090494 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:17:48.090235 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3198fde8_993b_4cb9_82f3_142f563d542f.slice/crio-9734475df7ab39faf29afe104519c4aca6d79359fb8e9c769cc04f73c49e4b41 WatchSource:0}: Error finding container 9734475df7ab39faf29afe104519c4aca6d79359fb8e9c769cc04f73c49e4b41: Status 404 returned error can't find the container with id 9734475df7ab39faf29afe104519c4aca6d79359fb8e9c769cc04f73c49e4b41 Jun 11 15:17:48.214424 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.214238 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 15:12:47 +0000 UTC" deadline="2028-02-16 04:45:33.533338604 +0000 UTC" Jun 11 15:17:48.214424 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.214420 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14749h27m45.318922602s" Jun 11 15:17:48.237936 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.237900 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" event={"ID":"3198fde8-993b-4cb9-82f3-142f563d542f","Type":"ContainerStarted","Data":"9734475df7ab39faf29afe104519c4aca6d79359fb8e9c769cc04f73c49e4b41"} Jun 11 15:17:48.239061 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.239032 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" event={"ID":"509bb5c1-530c-4de7-b81c-7b22af82c173","Type":"ContainerStarted","Data":"d249e580415453b2bea52d129587370d5098fa996edc133a59968ef0afba4220"} Jun 11 15:17:48.241739 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.241704 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kbghf" event={"ID":"cd12749a-f6b9-493e-b292-794160091523","Type":"ContainerStarted","Data":"cfc6e0b28fcc62fb053129f827bc363b10e889dffd2916c62bdd1362e810673f"} Jun 11 15:17:48.242768 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.242748 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" event={"ID":"4f6d0be2-601b-46ad-a350-fa4b5f461f0c","Type":"ContainerStarted","Data":"50e6e7896660d6c500feda96fbd5f16b21d83d1fe8812f751a4a429c3095ff4b"} Jun 11 15:17:48.243766 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.243745 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j4vwk" event={"ID":"eeeba33f-8886-4670-a133-8f1fcc11d4cb","Type":"ContainerStarted","Data":"4db59464a69105e0fe9cc8297b88694bcb3546f8d174da0206f44bb2dce65f5d"} Jun 11 15:17:48.244806 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.244785 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tw7qk" event={"ID":"546a5e49-90ce-450d-98ab-e223385e4e39","Type":"ContainerStarted","Data":"3a3639db964e2d28ac99e60194a2112ab1b0b9ad797955b27818d9ab03859755"} Jun 11 15:17:48.245811 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.245792 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r96qj" event={"ID":"59c700d7-40aa-4758-8642-50c7f6efee9a","Type":"ContainerStarted","Data":"371c0e218e44282ef8d663a971a371757133ee7da5d21d6ac612698111d3954d"} Jun 11 15:17:48.247645 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.247624 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal" event={"ID":"c6bb98369c1cbcd0b4b0ea517d85aa9e","Type":"ContainerStarted","Data":"47b72fa64df027de9b44b848e1776cd11ba68db0287489623777335ac0d2ac80"} Jun 11 15:17:48.252346 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.249544 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-shj99" event={"ID":"ec312546-eabd-4bf5-b4fa-107a6791ec0a","Type":"ContainerStarted","Data":"b87673ab058383cfc1b442606a57cc6dfd26c5b06884663ea41c885a325b8b83"} Jun 11 15:17:48.253916 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.253894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" event={"ID":"8b9ed52b-de91-4067-aa1c-18c0d04ee423","Type":"ContainerStarted","Data":"42961652b9ae0a83a4fd9ba8856c2883146eb0673733b967db32bf5c27b159d4"} Jun 11 15:17:48.267378 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.267334 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-203.ec2.internal" podStartSLOduration=2.267321955 podStartE2EDuration="2.267321955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:48.267007512 +0000 UTC m=+3.478197299" watchObservedRunningTime="2026-06-11 15:17:48.267321955 +0000 UTC m=+3.478511751" Jun 11 15:17:48.790335 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.790266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:48.790532 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.790357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:48.790532 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:48.790506 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:48.790649 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:48.790573 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret podName:5bf6c2b6-01c8-4995-9f22-350ed453fd06 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:50.790552623 +0000 UTC m=+6.001742401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret") pod "global-pull-secret-syncer-cw7jd" (UID: "5bf6c2b6-01c8-4995-9f22-350ed453fd06") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:48.791047 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:48.791027 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:48.791130 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:48.791082 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs podName:5f92ba05-ee12-41ed-9793-f8afe2fa6e6a nodeName:}" failed. No retries permitted until 2026-06-11 15:17:50.791065994 +0000 UTC m=+6.002255776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs") pod "network-metrics-daemon-xvlkl" (UID: "5f92ba05-ee12-41ed-9793-f8afe2fa6e6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:48.891296 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:48.891253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vs7\" (UniqueName: \"kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7\") pod \"network-check-target-p25nh\" (UID: \"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d\") " pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:48.891488 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:48.891470 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:48.891552 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:48.891497 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:48.891552 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:48.891513 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m8vs7 for pod openshift-network-diagnostics/network-check-target-p25nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:48.891662 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:48.891598 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7 podName:6a9c378a-8d6f-4ecb-88df-7797eaba5a0d nodeName:}" failed. No retries permitted until 2026-06-11 15:17:50.89155266 +0000 UTC m=+6.102742454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m8vs7" (UniqueName: "kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7") pod "network-check-target-p25nh" (UID: "6a9c378a-8d6f-4ecb-88df-7797eaba5a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:49.215363 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:49.215296 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 15:12:47 +0000 UTC" deadline="2028-01-08 11:34:32.612705582 +0000 UTC" Jun 11 15:17:49.215363 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:49.215359 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13820h16m43.397350332s" Jun 11 15:17:49.233108 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:49.233080 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:49.233278 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:49.233202 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:17:49.233339 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:49.233284 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:49.233397 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:49.233367 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:17:49.233457 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:49.233420 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:49.233502 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:49.233484 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:17:49.266893 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:49.266857 2560 generic.go:356] "Generic (PLEG): container finished" podID="bcbedfb6ff371c65b8369e3364d37993" containerID="8ca206023a617be950dc0186490616a59fffcad09115b6ee0892537135c4bb1c" exitCode=0 Jun 11 15:17:49.267080 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:49.266908 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" event={"ID":"bcbedfb6ff371c65b8369e3364d37993","Type":"ContainerDied","Data":"8ca206023a617be950dc0186490616a59fffcad09115b6ee0892537135c4bb1c"} Jun 11 15:17:50.276044 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:50.275433 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" event={"ID":"bcbedfb6ff371c65b8369e3364d37993","Type":"ContainerStarted","Data":"807c6cd627839483551761268eec6587a705f08404d528988204406ea26eb549"} Jun 11 15:17:50.806883 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:50.806837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:50.807125 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:50.806914 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:50.807125 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:50.806965 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:50.807125 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:50.807029 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:50.807125 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:50.807050 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs podName:5f92ba05-ee12-41ed-9793-f8afe2fa6e6a nodeName:}" failed. No retries permitted until 2026-06-11 15:17:54.807031756 +0000 UTC m=+10.018221533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs") pod "network-metrics-daemon-xvlkl" (UID: "5f92ba05-ee12-41ed-9793-f8afe2fa6e6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:50.807125 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:50.807068 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret podName:5bf6c2b6-01c8-4995-9f22-350ed453fd06 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:54.807056798 +0000 UTC m=+10.018246591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret") pod "global-pull-secret-syncer-cw7jd" (UID: "5bf6c2b6-01c8-4995-9f22-350ed453fd06") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:50.907831 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:50.907770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vs7\" (UniqueName: \"kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7\") pod \"network-check-target-p25nh\" (UID: \"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d\") " pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:50.908018 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:50.907965 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:50.908018 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:50.908004 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:50.908018 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:50.908018 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m8vs7 for pod openshift-network-diagnostics/network-check-target-p25nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:50.908195 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:50.908079 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7 podName:6a9c378a-8d6f-4ecb-88df-7797eaba5a0d nodeName:}" failed. No retries permitted until 2026-06-11 15:17:54.90805952 +0000 UTC m=+10.119249299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m8vs7" (UniqueName: "kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7") pod "network-check-target-p25nh" (UID: "6a9c378a-8d6f-4ecb-88df-7797eaba5a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:51.232033 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:51.231982 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:51.232246 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:51.232157 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:17:51.232246 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:51.232226 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:51.232363 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:51.232311 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:17:51.232363 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:51.232353 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:51.232451 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:51.232417 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:17:53.229931 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:53.229892 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:53.230571 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:53.230049 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:17:53.230571 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:53.230482 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:53.230571 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:53.230567 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:17:53.230770 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:53.230653 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:53.230770 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:53.230732 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:17:54.843388 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:54.842859 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:54.843388 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:54.842951 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:54.843388 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:54.843147 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:54.843388 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:54.843206 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs podName:5f92ba05-ee12-41ed-9793-f8afe2fa6e6a nodeName:}" failed. No retries permitted until 2026-06-11 15:18:02.843191345 +0000 UTC m=+18.054381121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs") pod "network-metrics-daemon-xvlkl" (UID: "5f92ba05-ee12-41ed-9793-f8afe2fa6e6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:54.843388 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:54.843327 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:54.843388 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:54.843365 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret podName:5bf6c2b6-01c8-4995-9f22-350ed453fd06 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:02.843354573 +0000 UTC m=+18.054544348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret") pod "global-pull-secret-syncer-cw7jd" (UID: "5bf6c2b6-01c8-4995-9f22-350ed453fd06") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:54.944813 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:54.944200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vs7\" (UniqueName: \"kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7\") pod \"network-check-target-p25nh\" (UID: \"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d\") " pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:54.944813 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:54.944388 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:54.944813 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:54.944410 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:54.944813 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:54.944424 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m8vs7 for pod openshift-network-diagnostics/network-check-target-p25nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:54.944813 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:54.944479 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7 podName:6a9c378a-8d6f-4ecb-88df-7797eaba5a0d nodeName:}" failed. No retries permitted until 2026-06-11 15:18:02.944460632 +0000 UTC m=+18.155650429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m8vs7" (UniqueName: "kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7") pod "network-check-target-p25nh" (UID: "6a9c378a-8d6f-4ecb-88df-7797eaba5a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:55.234250 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:55.233451 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:55.234250 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:55.233584 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:17:55.234250 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:55.233917 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:55.234250 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:55.234124 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:55.234250 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:55.234215 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:17:55.235024 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:55.234966 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:17:57.230126 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:57.230084 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:57.230689 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:57.230135 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:57.230689 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:57.230084 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:57.230689 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:57.230219 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:17:57.230689 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:57.230325 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:17:57.230689 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:57.230430 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:17:59.230121 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:59.229352 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:17:59.230121 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:59.229395 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:17:59.230121 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:17:59.229352 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:17:59.230121 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:59.229489 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:17:59.230121 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:59.229553 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:17:59.230121 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:17:59.229671 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:01.231289 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:01.231250 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:01.231732 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:01.231440 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:18:01.231732 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:01.231534 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:01.231732 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:01.231663 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:01.231858 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:01.231828 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:01.232035 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:01.231982 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:02.901670 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:02.901629 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:02.902195 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:02.901683 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:02.902195 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:02.901785 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:18:02.902195 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:02.901843 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs podName:5f92ba05-ee12-41ed-9793-f8afe2fa6e6a nodeName:}" failed. No retries permitted until 2026-06-11 15:18:18.901827451 +0000 UTC m=+34.113017226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs") pod "network-metrics-daemon-xvlkl" (UID: "5f92ba05-ee12-41ed-9793-f8afe2fa6e6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:18:02.902195 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:02.901788 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:18:02.902195 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:02.901927 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret podName:5bf6c2b6-01c8-4995-9f22-350ed453fd06 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:18.901910226 +0000 UTC m=+34.113100002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret") pod "global-pull-secret-syncer-cw7jd" (UID: "5bf6c2b6-01c8-4995-9f22-350ed453fd06") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:18:03.002604 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:03.002568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vs7\" (UniqueName: \"kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7\") pod \"network-check-target-p25nh\" (UID: \"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d\") " pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:03.002748 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:03.002705 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:18:03.002748 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:03.002718 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:18:03.002748 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:03.002728 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m8vs7 for pod openshift-network-diagnostics/network-check-target-p25nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:18:03.002855 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:03.002778 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7 podName:6a9c378a-8d6f-4ecb-88df-7797eaba5a0d nodeName:}" failed. No retries permitted until 2026-06-11 15:18:19.002764694 +0000 UTC m=+34.213954470 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m8vs7" (UniqueName: "kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7") pod "network-check-target-p25nh" (UID: "6a9c378a-8d6f-4ecb-88df-7797eaba5a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:18:03.230157 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:03.230118 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:03.230318 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:03.230118 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:03.230318 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:03.230240 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:03.230318 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:03.230120 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:03.230318 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:03.230294 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:03.230535 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:03.230366 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:18:05.230453 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:05.230425 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:05.230986 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:05.230510 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:05.230986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:05.230603 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:05.230986 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:05.230710 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:05.230986 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:05.230737 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:05.230986 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:05.230775 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:18:07.230104 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:07.230073 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:07.230104 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:07.230089 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:07.230104 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:07.230106 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:07.230526 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:07.230178 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:07.230526 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:07.230233 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:07.230526 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:07.230320 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:18:08.314234 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.314012 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-shj99" event={"ID":"ec312546-eabd-4bf5-b4fa-107a6791ec0a","Type":"ContainerStarted","Data":"0ddc741732eb939c850ab4b1b4be1efeec13829e7e92062d4da479333f3ec271"} Jun 11 15:18:08.315759 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.315733 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" event={"ID":"8b9ed52b-de91-4067-aa1c-18c0d04ee423","Type":"ContainerStarted","Data":"9ff8b79ea432947f6831795fcf5d458237718a2af62ae35279f5053409eada9e"} Jun 11 15:18:08.321750 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.321728 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:18:08.322215 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.322193 2560 generic.go:356] "Generic (PLEG): container finished" podID="3198fde8-993b-4cb9-82f3-142f563d542f" containerID="6d13f3de1b98c90f7fa1b8b29de79e7c2e86f03b7decfc6c5aa4ff81871a60b3" exitCode=1 Jun 11 15:18:08.322320 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.322267 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" event={"ID":"3198fde8-993b-4cb9-82f3-142f563d542f","Type":"ContainerStarted","Data":"6a1b1d079b37142a869425749a948013d7c3f2927b5a3792c672673463e058b6"} Jun 11 15:18:08.322382 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.322336 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" event={"ID":"3198fde8-993b-4cb9-82f3-142f563d542f","Type":"ContainerStarted","Data":"bfd10ebe5b0a4e02a3fb724676a0901191e6418c212212f2b24686272832e2de"} Jun 11 15:18:08.322422 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.322375 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" event={"ID":"3198fde8-993b-4cb9-82f3-142f563d542f","Type":"ContainerStarted","Data":"c830618876e4b2a24bb4f5a8df85b3462d548b864303b97db6af7982a1226b10"} Jun 11 15:18:08.322457 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.322445 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" event={"ID":"3198fde8-993b-4cb9-82f3-142f563d542f","Type":"ContainerDied","Data":"6d13f3de1b98c90f7fa1b8b29de79e7c2e86f03b7decfc6c5aa4ff81871a60b3"} Jun 11 15:18:08.322514 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.322495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" event={"ID":"3198fde8-993b-4cb9-82f3-142f563d542f","Type":"ContainerStarted","Data":"9c5029b46c60535828c50f0ad7938e33b235f99f20d109031f377f2dd6de3bcc"} Jun 11 15:18:08.323832 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.323782 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" event={"ID":"509bb5c1-530c-4de7-b81c-7b22af82c173","Type":"ContainerStarted","Data":"8bed02bcc373ec1a57a1aee51a6c54bc2e839dcd186e49dd90b3ac0fd86c965c"} Jun 11 15:18:08.325528 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.325497 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kbghf" event={"ID":"cd12749a-f6b9-493e-b292-794160091523","Type":"ContainerStarted","Data":"9a6809d70570ddb6802dc6335d28abbea450d1d83c5a95102113ca8879501593"} Jun 11 15:18:08.327262 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.327235 2560 generic.go:356] "Generic (PLEG): container finished" podID="4f6d0be2-601b-46ad-a350-fa4b5f461f0c" containerID="950c00f7d8460b58d01e835bcff26d66a1c75d1d9c9eb866ca6c9f9013b44a87" exitCode=0 Jun 11 15:18:08.327349 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.327284 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" event={"ID":"4f6d0be2-601b-46ad-a350-fa4b5f461f0c","Type":"ContainerDied","Data":"950c00f7d8460b58d01e835bcff26d66a1c75d1d9c9eb866ca6c9f9013b44a87"} Jun 11 15:18:08.329457 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.329433 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tw7qk" event={"ID":"546a5e49-90ce-450d-98ab-e223385e4e39","Type":"ContainerStarted","Data":"4503cb802478b8b43a72d6fc1657cab0658d948342240625a3fe86b7284c931c"} Jun 11 15:18:08.331891 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.331630 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r96qj" event={"ID":"59c700d7-40aa-4758-8642-50c7f6efee9a","Type":"ContainerStarted","Data":"ef47cca7d83dd7c0d75a06b11c555b48375cd16cdb9ea30d6b734791654b57ab"} Jun 11 15:18:08.333947 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.333907 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-203.ec2.internal" podStartSLOduration=22.333892359 podStartE2EDuration="22.333892359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:50.296431104 +0000 UTC m=+5.507620902" watchObservedRunningTime="2026-06-11 15:18:08.333892359 +0000 UTC m=+23.545082155" Jun 11 15:18:08.334267 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.334240 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-shj99" podStartSLOduration=4.188597401 podStartE2EDuration="23.334234311s" totalImagesPullingTime="19.14563691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:08.333476861 +0000 UTC m=+23.544666658" watchObservedRunningTime="2026-06-11 15:18:08.334234311 +0000 UTC m=+23.545424107" Jun 11 15:18:08.399455 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.399403 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r96qj" podStartSLOduration=4.247691005 podStartE2EDuration="23.39938612s" totalImagesPullingTime="19.151695115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:08.379029366 +0000 UTC m=+23.590219163" watchObservedRunningTime="2026-06-11 15:18:08.39938612 +0000 UTC m=+23.610575916" Jun 11 15:18:08.399761 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.399735 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nxpwb" podStartSLOduration=4.172493998 podStartE2EDuration="23.399727413s" totalImagesPullingTime="19.227233415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:08.399259272 +0000 UTC m=+23.610449066" watchObservedRunningTime="2026-06-11 15:18:08.399727413 +0000 UTC m=+23.610917209" Jun 11 15:18:08.416676 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.416622 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tw7qk" podStartSLOduration=4.177075673 podStartE2EDuration="23.416601526s" totalImagesPullingTime="19.239525853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:08.416543483 +0000 UTC m=+23.627733293" watchObservedRunningTime="2026-06-11 15:18:08.416601526 +0000 UTC m=+23.627791324" Jun 11 15:18:08.922831 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:08.922800 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 15:18:09.230214 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.230183 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:09.230214 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.230202 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:09.230433 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.230183 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:09.230433 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:09.230312 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:18:09.230433 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:09.230377 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:09.230536 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:09.230435 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:09.232192 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.232116 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T15:18:08.922825063Z","UUID":"c817e0ed-211f-457f-a270-2480027cca16","Handler":null,"Name":"","Endpoint":""} Jun 11 15:18:09.233748 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.233728 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 15:18:09.233838 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.233770 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 15:18:09.338572 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.338540 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:18:09.339244 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.339138 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" event={"ID":"3198fde8-993b-4cb9-82f3-142f563d542f","Type":"ContainerStarted","Data":"62e1cf22110eae0161e3162aa3c716259d924473a3041740e913b7ec5170e41a"} Jun 11 15:18:09.341096 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.341063 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j4vwk" event={"ID":"eeeba33f-8886-4670-a133-8f1fcc11d4cb","Type":"ContainerStarted","Data":"736733782fadba7dda11270d0138a8fc730819502c66c690d71ea2399517683e"} Jun 11 15:18:09.343753 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.343727 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" event={"ID":"8b9ed52b-de91-4067-aa1c-18c0d04ee423","Type":"ContainerStarted","Data":"3bc8539df9d6ff3594703ff385fd6042e5b351c0464f3c5dacebdcd71ded5f65"} Jun 11 15:18:09.360434 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.360379 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kbghf" podStartSLOduration=4.796094964 podStartE2EDuration="24.360360759s" totalImagesPullingTime="19.564265795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:08.437929837 +0000 UTC m=+23.649119634" watchObservedRunningTime="2026-06-11 15:18:09.360360759 +0000 UTC m=+24.571550558" Jun 11 15:18:09.361294 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:09.361253 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j4vwk" podStartSLOduration=5.133370047 podStartE2EDuration="24.361238388s" totalImagesPullingTime="19.227868341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:09.360227019 +0000 UTC m=+24.571416818" watchObservedRunningTime="2026-06-11 15:18:09.361238388 +0000 UTC m=+24.572428188" Jun 11 15:18:10.348227 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:10.348187 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" event={"ID":"8b9ed52b-de91-4067-aa1c-18c0d04ee423","Type":"ContainerStarted","Data":"e8baef4322f1513fe5467fdaf5e0aa331a518a9295158ecb0310e8897a61e4be"} Jun 11 15:18:10.370797 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:10.370739 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pk982" podStartSLOduration=4.072003054 podStartE2EDuration="25.370720285s" totalImagesPullingTime="21.298717231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:10.369744309 +0000 UTC m=+25.580934102" watchObservedRunningTime="2026-06-11 15:18:10.370720285 +0000 UTC m=+25.581910081" Jun 11 15:18:11.230262 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:11.230229 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:11.230438 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:11.230233 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:11.230438 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:11.230376 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:11.230438 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:11.230228 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:11.230590 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:11.230455 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:18:11.230590 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:11.230469 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:11.354434 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:11.354407 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:18:11.354925 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:11.354865 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" event={"ID":"3198fde8-993b-4cb9-82f3-142f563d542f","Type":"ContainerStarted","Data":"ef1a8a66e54d06d70e8446ae38a0fa04b23770f8bb2b74d7bfcb7a0ec6702783"} Jun 11 15:18:13.164648 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.164466 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:18:13.165178 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.165160 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:18:13.229962 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.229931 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:13.230143 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.229933 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:13.230143 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:13.230057 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:13.230143 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.229931 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:13.230143 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:13.230113 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:13.230282 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:13.230196 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:18:13.362890 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.362864 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:18:13.363272 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.363247 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" event={"ID":"3198fde8-993b-4cb9-82f3-142f563d542f","Type":"ContainerStarted","Data":"7101f1c4f4c4b34e8d4231156e3e0dfdff4feca073bd48f0ba1091250f9a038b"} Jun 11 15:18:13.363512 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.363493 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:18:13.363678 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.363664 2560 scope.go:117] "RemoveContainer" containerID="6d13f3de1b98c90f7fa1b8b29de79e7c2e86f03b7decfc6c5aa4ff81871a60b3" Jun 11 15:18:13.365208 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.365186 2560 generic.go:356] "Generic (PLEG): container finished" podID="4f6d0be2-601b-46ad-a350-fa4b5f461f0c" containerID="6930f1ee0766ee97e1bbc9f46ba8d387af8bd7163ca43053e7153137cf3170bf" exitCode=0 Jun 11 15:18:13.365309 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.365211 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" event={"ID":"4f6d0be2-601b-46ad-a350-fa4b5f461f0c","Type":"ContainerDied","Data":"6930f1ee0766ee97e1bbc9f46ba8d387af8bd7163ca43053e7153137cf3170bf"} Jun 11 15:18:13.365536 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.365513 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:18:13.366157 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.366139 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r96qj" Jun 11 15:18:13.383234 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:13.383183 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:18:14.370358 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.370169 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:18:14.370817 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.370748 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" event={"ID":"3198fde8-993b-4cb9-82f3-142f563d542f","Type":"ContainerStarted","Data":"a2eb40c0adb0bbc53548caa5ed5f1fa88b8532efdbcf8c32c716b9b87b4636a9"} Jun 11 15:18:14.371045 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.371029 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:18:14.371142 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.371095 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:18:14.386350 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.386324 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:18:14.405858 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.405816 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" podStartSLOduration=10.158432053 podStartE2EDuration="29.405802155s" totalImagesPullingTime="19.247370102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:14.403828933 +0000 UTC m=+29.615018730" watchObservedRunningTime="2026-06-11 15:18:14.405802155 +0000 UTC m=+29.616991952" Jun 11 15:18:14.961511 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.961476 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cw7jd"] Jun 11 15:18:14.961690 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.961623 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:14.961737 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:14.961703 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:14.961944 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.961925 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p25nh"] Jun 11 15:18:14.962049 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.962037 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:14.962121 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:14.962105 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:18:14.977700 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.977672 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xvlkl"] Jun 11 15:18:14.977813 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:14.977773 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:14.977865 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:14.977848 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:15.374685 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:15.374651 2560 generic.go:356] "Generic (PLEG): container finished" podID="4f6d0be2-601b-46ad-a350-fa4b5f461f0c" containerID="8d7ef6f060742dd0fbc314c5b2ccc8d9bf1bce4a65354474d174940aa866ba5f" exitCode=0 Jun 11 15:18:15.375407 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:15.374729 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" event={"ID":"4f6d0be2-601b-46ad-a350-fa4b5f461f0c","Type":"ContainerDied","Data":"8d7ef6f060742dd0fbc314c5b2ccc8d9bf1bce4a65354474d174940aa866ba5f"} Jun 11 15:18:16.230223 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:16.230184 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:16.230416 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:16.230297 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:17.233520 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:17.233342 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:17.233902 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:17.233399 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:17.233902 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:17.233586 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:17.233902 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:17.233657 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:18:17.381262 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:17.381232 2560 generic.go:356] "Generic (PLEG): container finished" podID="4f6d0be2-601b-46ad-a350-fa4b5f461f0c" containerID="d772f6d27ba8e1ba5365265c894feeb31a83eb26378d9e1488282f4814f53c01" exitCode=0 Jun 11 15:18:17.381460 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:17.381271 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" event={"ID":"4f6d0be2-601b-46ad-a350-fa4b5f461f0c","Type":"ContainerDied","Data":"d772f6d27ba8e1ba5365265c894feeb31a83eb26378d9e1488282f4814f53c01"} Jun 11 15:18:18.229782 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:18.229749 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:18.229946 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:18.229882 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:18.909764 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:18.909726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:18.910238 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:18.909781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:18.910238 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:18.909886 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:18:18.910238 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:18.909893 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:18:18.910238 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:18.909955 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret podName:5bf6c2b6-01c8-4995-9f22-350ed453fd06 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:50.909935916 +0000 UTC m=+66.121125690 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret") pod "global-pull-secret-syncer-cw7jd" (UID: "5bf6c2b6-01c8-4995-9f22-350ed453fd06") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:18:18.910238 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:18.909972 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs podName:5f92ba05-ee12-41ed-9793-f8afe2fa6e6a nodeName:}" failed. No retries permitted until 2026-06-11 15:18:50.909963284 +0000 UTC m=+66.121153062 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs") pod "network-metrics-daemon-xvlkl" (UID: "5f92ba05-ee12-41ed-9793-f8afe2fa6e6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:18:19.010322 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:19.010286 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vs7\" (UniqueName: \"kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7\") pod \"network-check-target-p25nh\" (UID: \"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d\") " pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:19.010497 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:19.010461 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:18:19.010497 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:19.010486 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:18:19.010591 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:19.010499 2560 projected.go:196] Error preparing data for projected volume kube-api-access-m8vs7 for pod openshift-network-diagnostics/network-check-target-p25nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:18:19.010591 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:19.010556 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7 podName:6a9c378a-8d6f-4ecb-88df-7797eaba5a0d nodeName:}" failed. No retries permitted until 2026-06-11 15:18:51.010537478 +0000 UTC m=+66.221727252 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m8vs7" (UniqueName: "kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7") pod "network-check-target-p25nh" (UID: "6a9c378a-8d6f-4ecb-88df-7797eaba5a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:18:19.229637 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:19.229600 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:19.229811 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:19.229606 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:19.229811 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:19.229718 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p25nh" podUID="6a9c378a-8d6f-4ecb-88df-7797eaba5a0d" Jun 11 15:18:19.229908 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:19.229816 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:18:20.230033 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:20.230005 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:20.230450 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:20.230107 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cw7jd" podUID="5bf6c2b6-01c8-4995-9f22-350ed453fd06" Jun 11 15:18:21.132591 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.132563 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-203.ec2.internal" event="NodeReady" Jun 11 15:18:21.132757 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.132715 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 15:18:21.204483 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.204445 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4795t"] Jun 11 15:18:21.206682 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.206654 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.207396 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.207372 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rbrzr"] Jun 11 15:18:21.208818 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.208795 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rbrzr" Jun 11 15:18:21.212329 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.212306 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 15:18:21.212329 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.212320 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jps6d\"" Jun 11 15:18:21.212475 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.212331 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 15:18:21.218448 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.218427 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 15:18:21.218541 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.218480 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 15:18:21.218705 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.218690 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 15:18:21.218755 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.218704 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g6rph\"" Jun 11 15:18:21.229098 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.229076 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4795t"] Jun 11 15:18:21.229345 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.229327 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:21.229691 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.229674 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:21.235117 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.235089 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cmv6\"" Jun 11 15:18:21.235546 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.235319 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:18:21.235798 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.235773 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92qml\"" Jun 11 15:18:21.236019 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.235972 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:18:21.237154 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.237132 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:18:21.238879 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.238859 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rbrzr"] Jun 11 15:18:21.324624 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.324533 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.324624 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.324573 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ad166b7-8da6-4903-8756-21e2d6f7826d-tmp-dir\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.324838 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.324655 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ad166b7-8da6-4903-8756-21e2d6f7826d-config-volume\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.324838 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.324703 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbrpj\" (UniqueName: \"kubernetes.io/projected/bb67107c-8286-416d-9c14-cddc1cab5eee-kube-api-access-tbrpj\") pod \"ingress-canary-rbrzr\" (UID: \"bb67107c-8286-416d-9c14-cddc1cab5eee\") " pod="openshift-ingress-canary/ingress-canary-rbrzr" Jun 11 15:18:21.324838 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.324737 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb67107c-8286-416d-9c14-cddc1cab5eee-cert\") pod \"ingress-canary-rbrzr\" (UID: \"bb67107c-8286-416d-9c14-cddc1cab5eee\") " pod="openshift-ingress-canary/ingress-canary-rbrzr" Jun 11 15:18:21.324838 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.324822 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbxml\" (UniqueName: \"kubernetes.io/projected/9ad166b7-8da6-4903-8756-21e2d6f7826d-kube-api-access-jbxml\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.425935 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.425913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ad166b7-8da6-4903-8756-21e2d6f7826d-config-volume\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.426050 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.425952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbrpj\" (UniqueName: \"kubernetes.io/projected/bb67107c-8286-416d-9c14-cddc1cab5eee-kube-api-access-tbrpj\") pod \"ingress-canary-rbrzr\" (UID: \"bb67107c-8286-416d-9c14-cddc1cab5eee\") " pod="openshift-ingress-canary/ingress-canary-rbrzr" Jun 11 15:18:21.426050 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.425975 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb67107c-8286-416d-9c14-cddc1cab5eee-cert\") pod \"ingress-canary-rbrzr\" (UID: \"bb67107c-8286-416d-9c14-cddc1cab5eee\") " pod="openshift-ingress-canary/ingress-canary-rbrzr" Jun 11 15:18:21.426132 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.426032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbxml\" (UniqueName: \"kubernetes.io/projected/9ad166b7-8da6-4903-8756-21e2d6f7826d-kube-api-access-jbxml\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.426132 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.426109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.426203 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:21.426186 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:21.426265 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:21.426242 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls podName:9ad166b7-8da6-4903-8756-21e2d6f7826d nodeName:}" failed. No retries permitted until 2026-06-11 15:18:21.926221955 +0000 UTC m=+37.137411745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls") pod "dns-default-4795t" (UID: "9ad166b7-8da6-4903-8756-21e2d6f7826d") : secret "dns-default-metrics-tls" not found Jun 11 15:18:21.426342 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.426280 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ad166b7-8da6-4903-8756-21e2d6f7826d-tmp-dir\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.426577 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.426552 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ad166b7-8da6-4903-8756-21e2d6f7826d-config-volume\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.426706 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.426584 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ad166b7-8da6-4903-8756-21e2d6f7826d-tmp-dir\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.430571 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.430537 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb67107c-8286-416d-9c14-cddc1cab5eee-cert\") pod \"ingress-canary-rbrzr\" (UID: \"bb67107c-8286-416d-9c14-cddc1cab5eee\") " pod="openshift-ingress-canary/ingress-canary-rbrzr" Jun 11 15:18:21.440211 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.440181 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbxml\" (UniqueName: \"kubernetes.io/projected/9ad166b7-8da6-4903-8756-21e2d6f7826d-kube-api-access-jbxml\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.440211 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.440204 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbrpj\" (UniqueName: \"kubernetes.io/projected/bb67107c-8286-416d-9c14-cddc1cab5eee-kube-api-access-tbrpj\") pod \"ingress-canary-rbrzr\" (UID: \"bb67107c-8286-416d-9c14-cddc1cab5eee\") " pod="openshift-ingress-canary/ingress-canary-rbrzr" Jun 11 15:18:21.525247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.525214 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rbrzr" Jun 11 15:18:21.663262 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.663228 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rbrzr"] Jun 11 15:18:21.668145 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:18:21.668115 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb67107c_8286_416d_9c14_cddc1cab5eee.slice/crio-f9161e7200fa300609989419def82438b3ad9030a81bc14ea5ae0d7c9b618822 WatchSource:0}: Error finding container f9161e7200fa300609989419def82438b3ad9030a81bc14ea5ae0d7c9b618822: Status 404 returned error can't find the container with id f9161e7200fa300609989419def82438b3ad9030a81bc14ea5ae0d7c9b618822 Jun 11 15:18:21.930356 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:21.930319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:21.930523 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:21.930440 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:21.930523 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:21.930489 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls podName:9ad166b7-8da6-4903-8756-21e2d6f7826d nodeName:}" failed. No retries permitted until 2026-06-11 15:18:22.930476083 +0000 UTC m=+38.141665858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls") pod "dns-default-4795t" (UID: "9ad166b7-8da6-4903-8756-21e2d6f7826d") : secret "dns-default-metrics-tls" not found Jun 11 15:18:22.229564 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:22.229335 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:22.233050 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:22.232818 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:18:22.395158 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:22.395117 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rbrzr" event={"ID":"bb67107c-8286-416d-9c14-cddc1cab5eee","Type":"ContainerStarted","Data":"f9161e7200fa300609989419def82438b3ad9030a81bc14ea5ae0d7c9b618822"} Jun 11 15:18:22.398517 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:22.398489 2560 generic.go:356] "Generic (PLEG): container finished" podID="4f6d0be2-601b-46ad-a350-fa4b5f461f0c" containerID="e0afa2355f9ab163eb90d743665cbe74faab3aa2e58e6f295250fa8a1d4f9161" exitCode=0 Jun 11 15:18:22.398654 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:22.398532 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" event={"ID":"4f6d0be2-601b-46ad-a350-fa4b5f461f0c","Type":"ContainerDied","Data":"e0afa2355f9ab163eb90d743665cbe74faab3aa2e58e6f295250fa8a1d4f9161"} Jun 11 15:18:22.937763 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:22.937726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:22.937941 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:22.937894 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:22.938012 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:22.937957 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls podName:9ad166b7-8da6-4903-8756-21e2d6f7826d nodeName:}" failed. No retries permitted until 2026-06-11 15:18:24.937941159 +0000 UTC m=+40.149130933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls") pod "dns-default-4795t" (UID: "9ad166b7-8da6-4903-8756-21e2d6f7826d") : secret "dns-default-metrics-tls" not found Jun 11 15:18:23.403319 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:23.403285 2560 generic.go:356] "Generic (PLEG): container finished" podID="4f6d0be2-601b-46ad-a350-fa4b5f461f0c" containerID="7a3e854820d39c2399b4337339ac95c5f04fbf93346f04c5aa9b6496d1d6e5c9" exitCode=0 Jun 11 15:18:23.404076 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:23.403325 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" event={"ID":"4f6d0be2-601b-46ad-a350-fa4b5f461f0c","Type":"ContainerDied","Data":"7a3e854820d39c2399b4337339ac95c5f04fbf93346f04c5aa9b6496d1d6e5c9"} Jun 11 15:18:24.407058 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:24.407020 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rbrzr" event={"ID":"bb67107c-8286-416d-9c14-cddc1cab5eee","Type":"ContainerStarted","Data":"3c3baa3cbb3f5709f76ce26059ae13f632d2f7caf197d63d3bcc18278d00c9ed"} Jun 11 15:18:24.410095 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:24.410070 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" event={"ID":"4f6d0be2-601b-46ad-a350-fa4b5f461f0c","Type":"ContainerStarted","Data":"9ed639fd3b53b45c9d0b8f84b7cf057111b84eebb8f244d91e7e8be156afaee7"} Jun 11 15:18:24.471427 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:24.471367 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tqt5g" podStartSLOduration=9.984378575000001 podStartE2EDuration="39.471346177s" totalImagesPullingTime="29.486967602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:24.471119094 +0000 UTC m=+39.682308891" watchObservedRunningTime="2026-06-11 15:18:24.471346177 +0000 UTC m=+39.682535975" Jun 11 15:18:24.471622 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:24.471533 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rbrzr" podStartSLOduration=1.7160578530000001 podStartE2EDuration="3.471523461s" totalImagesPullingTime="1.755465608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:24.432619259 +0000 UTC m=+39.643809055" watchObservedRunningTime="2026-06-11 15:18:24.471523461 +0000 UTC m=+39.682713261" Jun 11 15:18:24.952804 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:24.952769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:24.952945 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:24.952924 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:24.953033 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:24.953020 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls podName:9ad166b7-8da6-4903-8756-21e2d6f7826d nodeName:}" failed. No retries permitted until 2026-06-11 15:18:28.9529854 +0000 UTC m=+44.164175175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls") pod "dns-default-4795t" (UID: "9ad166b7-8da6-4903-8756-21e2d6f7826d") : secret "dns-default-metrics-tls" not found Jun 11 15:18:28.982042 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:28.981983 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:28.982427 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:28.982137 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:28.982427 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:28.982202 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls podName:9ad166b7-8da6-4903-8756-21e2d6f7826d nodeName:}" failed. No retries permitted until 2026-06-11 15:18:36.982185254 +0000 UTC m=+52.193375028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls") pod "dns-default-4795t" (UID: "9ad166b7-8da6-4903-8756-21e2d6f7826d") : secret "dns-default-metrics-tls" not found Jun 11 15:18:37.041279 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:37.041232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:37.041729 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:37.041386 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:37.041729 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:37.041460 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls podName:9ad166b7-8da6-4903-8756-21e2d6f7826d nodeName:}" failed. No retries permitted until 2026-06-11 15:18:53.041444437 +0000 UTC m=+68.252634213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls") pod "dns-default-4795t" (UID: "9ad166b7-8da6-4903-8756-21e2d6f7826d") : secret "dns-default-metrics-tls" not found Jun 11 15:18:46.390499 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:46.390413 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvsr5" Jun 11 15:18:50.938204 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:50.938166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:50.938697 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:50.938227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:18:50.941160 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:50.941140 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:18:50.941160 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:50.941153 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:18:50.949348 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:50.949330 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:18:50.949438 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:50.949396 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs podName:5f92ba05-ee12-41ed-9793-f8afe2fa6e6a nodeName:}" failed. No retries permitted until 2026-06-11 15:19:54.949380598 +0000 UTC m=+130.160570374 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs") pod "network-metrics-daemon-xvlkl" (UID: "5f92ba05-ee12-41ed-9793-f8afe2fa6e6a") : secret "metrics-daemon-secret" not found Jun 11 15:18:50.952437 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:50.952412 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bf6c2b6-01c8-4995-9f22-350ed453fd06-original-pull-secret\") pod \"global-pull-secret-syncer-cw7jd\" (UID: \"5bf6c2b6-01c8-4995-9f22-350ed453fd06\") " pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:51.038537 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.038496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vs7\" (UniqueName: \"kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7\") pod \"network-check-target-p25nh\" (UID: \"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d\") " pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:51.040485 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.040463 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cw7jd" Jun 11 15:18:51.041704 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.041686 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:18:51.051593 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.051570 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:18:51.062641 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.062614 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vs7\" (UniqueName: \"kubernetes.io/projected/6a9c378a-8d6f-4ecb-88df-7797eaba5a0d-kube-api-access-m8vs7\") pod \"network-check-target-p25nh\" (UID: \"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d\") " pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:51.162914 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.162811 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cw7jd"] Jun 11 15:18:51.165571 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:18:51.165543 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf6c2b6_01c8_4995_9f22_350ed453fd06.slice/crio-c1946d756f38f2bb5bbd870b26a1f5fab0ee78df6bb0f0daa6b8d37da88c1403 WatchSource:0}: Error finding container c1946d756f38f2bb5bbd870b26a1f5fab0ee78df6bb0f0daa6b8d37da88c1403: Status 404 returned error can't find the container with id c1946d756f38f2bb5bbd870b26a1f5fab0ee78df6bb0f0daa6b8d37da88c1403 Jun 11 15:18:51.247796 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.247722 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92qml\"" Jun 11 15:18:51.255079 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.255060 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:51.376681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.376652 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p25nh"] Jun 11 15:18:51.379645 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:18:51.379619 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9c378a_8d6f_4ecb_88df_7797eaba5a0d.slice/crio-da566903f163af15b85f30f2d3a11a0c6494d4f3aef940f15f783f2d2072db9e WatchSource:0}: Error finding container da566903f163af15b85f30f2d3a11a0c6494d4f3aef940f15f783f2d2072db9e: Status 404 returned error can't find the container with id da566903f163af15b85f30f2d3a11a0c6494d4f3aef940f15f783f2d2072db9e Jun 11 15:18:51.473224 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.473084 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p25nh" event={"ID":"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d","Type":"ContainerStarted","Data":"da566903f163af15b85f30f2d3a11a0c6494d4f3aef940f15f783f2d2072db9e"} Jun 11 15:18:51.474165 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:51.474138 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cw7jd" event={"ID":"5bf6c2b6-01c8-4995-9f22-350ed453fd06","Type":"ContainerStarted","Data":"c1946d756f38f2bb5bbd870b26a1f5fab0ee78df6bb0f0daa6b8d37da88c1403"} Jun 11 15:18:53.052978 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:53.052930 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:18:53.053446 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:53.053110 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:53.053446 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:18:53.053199 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls podName:9ad166b7-8da6-4903-8756-21e2d6f7826d nodeName:}" failed. No retries permitted until 2026-06-11 15:19:25.053176393 +0000 UTC m=+100.264366171 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls") pod "dns-default-4795t" (UID: "9ad166b7-8da6-4903-8756-21e2d6f7826d") : secret "dns-default-metrics-tls" not found Jun 11 15:18:56.488649 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:56.488609 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p25nh" event={"ID":"6a9c378a-8d6f-4ecb-88df-7797eaba5a0d","Type":"ContainerStarted","Data":"264aea1d68bb922b5bd749c20ecba729a370acc2f49e150fd142429999a6ebe6"} Jun 11 15:18:56.489238 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:56.488705 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:18:56.490105 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:56.490079 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cw7jd" event={"ID":"5bf6c2b6-01c8-4995-9f22-350ed453fd06","Type":"ContainerStarted","Data":"a81e8c850834b3d0b6b96ed17ec7e5ff9a43a8caf4a7cb649a3f6481a414b0e4"} Jun 11 15:18:56.506045 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:56.505976 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p25nh" podStartSLOduration=67.361402766 podStartE2EDuration="1m11.505959673s" totalImagesPullingTime="4.144556907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:56.505935394 +0000 UTC m=+71.717125193" watchObservedRunningTime="2026-06-11 15:18:56.505959673 +0000 UTC m=+71.717149471" Jun 11 15:18:56.524788 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:18:56.524735 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cw7jd" podStartSLOduration=67.162416379 podStartE2EDuration="1m11.52471971s" totalImagesPullingTime="4.362303331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:56.524713675 +0000 UTC m=+71.735903473" watchObservedRunningTime="2026-06-11 15:18:56.52471971 +0000 UTC m=+71.735909497" Jun 11 15:19:25.071556 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:19:25.071518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:19:25.071922 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:19:25.071679 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:19:25.071922 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:19:25.071743 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls podName:9ad166b7-8da6-4903-8756-21e2d6f7826d nodeName:}" failed. No retries permitted until 2026-06-11 15:20:29.071728077 +0000 UTC m=+164.282917852 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls") pod "dns-default-4795t" (UID: "9ad166b7-8da6-4903-8756-21e2d6f7826d") : secret "dns-default-metrics-tls" not found Jun 11 15:19:27.494907 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:19:27.494877 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p25nh" Jun 11 15:19:54.959719 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:19:54.959669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:19:54.960238 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:19:54.959832 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:19:54.960238 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:19:54.959914 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs podName:5f92ba05-ee12-41ed-9793-f8afe2fa6e6a nodeName:}" failed. No retries permitted until 2026-06-11 15:21:56.959896849 +0000 UTC m=+252.171086624 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs") pod "network-metrics-daemon-xvlkl" (UID: "5f92ba05-ee12-41ed-9793-f8afe2fa6e6a") : secret "metrics-daemon-secret" not found Jun 11 15:20:11.865347 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.865310 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9"] Jun 11 15:20:11.867696 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.867671 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7"] Jun 11 15:20:11.867813 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.867791 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:11.869526 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.869509 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:11.872761 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.872741 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 15:20:11.873035 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.873016 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 15:20:11.873035 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.873030 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 15:20:11.873174 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.873034 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 15:20:11.873352 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.873336 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 15:20:11.873662 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.873641 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 15:20:11.873731 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.873670 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 15:20:11.873771 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.873735 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 15:20:11.881636 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.881614 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9"] Jun 11 15:20:11.882362 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.882342 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7"] Jun 11 15:20:11.972435 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.972391 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:11.972619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.972452 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7gkd\" (UniqueName: \"kubernetes.io/projected/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-kube-api-access-l7gkd\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:11.972619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.972514 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/862f6d94-11c2-4b74-b3d2-299baa89c754-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bfd8bd945-vm8l9\" (UID: \"862f6d94-11c2-4b74-b3d2-299baa89c754\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:11.972619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.972548 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-ca\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:11.972619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.972568 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-hub\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:11.972619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.972586 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/862f6d94-11c2-4b74-b3d2-299baa89c754-tmp\") pod \"klusterlet-addon-workmgr-6bfd8bd945-vm8l9\" (UID: \"862f6d94-11c2-4b74-b3d2-299baa89c754\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:11.972619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.972605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lg8z\" (UniqueName: \"kubernetes.io/projected/862f6d94-11c2-4b74-b3d2-299baa89c754-kube-api-access-4lg8z\") pod \"klusterlet-addon-workmgr-6bfd8bd945-vm8l9\" (UID: \"862f6d94-11c2-4b74-b3d2-299baa89c754\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:11.972873 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.972633 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:11.972873 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:11.972651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.073747 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.073709 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.073883 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.073762 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gkd\" (UniqueName: \"kubernetes.io/projected/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-kube-api-access-l7gkd\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.073883 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.073798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/862f6d94-11c2-4b74-b3d2-299baa89c754-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bfd8bd945-vm8l9\" (UID: \"862f6d94-11c2-4b74-b3d2-299baa89c754\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:12.073883 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.073814 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-ca\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.073883 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.073830 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-hub\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.073883 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.073846 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/862f6d94-11c2-4b74-b3d2-299baa89c754-tmp\") pod \"klusterlet-addon-workmgr-6bfd8bd945-vm8l9\" (UID: \"862f6d94-11c2-4b74-b3d2-299baa89c754\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:12.073883 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.073865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lg8z\" (UniqueName: \"kubernetes.io/projected/862f6d94-11c2-4b74-b3d2-299baa89c754-kube-api-access-4lg8z\") pod \"klusterlet-addon-workmgr-6bfd8bd945-vm8l9\" (UID: \"862f6d94-11c2-4b74-b3d2-299baa89c754\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:12.073883 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.073880 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.074250 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.074107 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.074358 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.074331 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/862f6d94-11c2-4b74-b3d2-299baa89c754-tmp\") pod \"klusterlet-addon-workmgr-6bfd8bd945-vm8l9\" (UID: \"862f6d94-11c2-4b74-b3d2-299baa89c754\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:12.074730 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.074704 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.076650 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.076622 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/862f6d94-11c2-4b74-b3d2-299baa89c754-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bfd8bd945-vm8l9\" (UID: \"862f6d94-11c2-4b74-b3d2-299baa89c754\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:12.076776 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.076753 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-ca\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.076940 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.076923 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.077121 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.077099 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.077266 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.077250 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-hub\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.084523 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.084499 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lg8z\" (UniqueName: \"kubernetes.io/projected/862f6d94-11c2-4b74-b3d2-299baa89c754-kube-api-access-4lg8z\") pod \"klusterlet-addon-workmgr-6bfd8bd945-vm8l9\" (UID: \"862f6d94-11c2-4b74-b3d2-299baa89c754\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:12.085247 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.085225 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7gkd\" (UniqueName: \"kubernetes.io/projected/3a2d521c-2690-4a47-9e64-d0d9f59c6fbe-kube-api-access-l7gkd\") pod \"cluster-proxy-proxy-agent-776b889657-v2mg7\" (UID: \"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.177678 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.177636 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:12.197009 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.196965 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:20:12.311528 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.311337 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9"] Jun 11 15:20:12.314959 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:20:12.314928 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862f6d94_11c2_4b74_b3d2_299baa89c754.slice/crio-c12ba26061f65af6c014bead5479da0b0c85cda0e178e241c2bf857f02707c33 WatchSource:0}: Error finding container c12ba26061f65af6c014bead5479da0b0c85cda0e178e241c2bf857f02707c33: Status 404 returned error can't find the container with id c12ba26061f65af6c014bead5479da0b0c85cda0e178e241c2bf857f02707c33 Jun 11 15:20:12.331625 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.331604 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7"] Jun 11 15:20:12.333800 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:20:12.333775 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a2d521c_2690_4a47_9e64_d0d9f59c6fbe.slice/crio-ad072eee20ac0bc55ed40c97f5fba4a6f670bfef25b524ce69873eee73140e7f WatchSource:0}: Error finding container ad072eee20ac0bc55ed40c97f5fba4a6f670bfef25b524ce69873eee73140e7f: Status 404 returned error can't find the container with id ad072eee20ac0bc55ed40c97f5fba4a6f670bfef25b524ce69873eee73140e7f Jun 11 15:20:12.665914 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.665883 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" event={"ID":"862f6d94-11c2-4b74-b3d2-299baa89c754","Type":"ContainerStarted","Data":"c12ba26061f65af6c014bead5479da0b0c85cda0e178e241c2bf857f02707c33"} Jun 11 15:20:12.666945 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:12.666918 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" event={"ID":"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe","Type":"ContainerStarted","Data":"ad072eee20ac0bc55ed40c97f5fba4a6f670bfef25b524ce69873eee73140e7f"} Jun 11 15:20:17.683967 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:17.683933 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" event={"ID":"862f6d94-11c2-4b74-b3d2-299baa89c754","Type":"ContainerStarted","Data":"c798f3bfa6305babbcfeaf99b250c4b51e64aac0705f03915cfa96d26bfd66ba"} Jun 11 15:20:17.684445 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:17.684115 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:17.685873 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:17.685842 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:20:17.686111 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:17.686090 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" event={"ID":"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe","Type":"ContainerStarted","Data":"695f5bfa234373e423a9934a37927509b072301b39a893bc59ca591ced587b64"} Jun 11 15:20:17.686182 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:17.686128 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" event={"ID":"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe","Type":"ContainerStarted","Data":"01198680d474a28c09dbe8261d92d6ef474adf672cffebcca7fca659eb924949"} Jun 11 15:20:17.686182 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:17.686144 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" event={"ID":"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe","Type":"ContainerStarted","Data":"de6f1bc35e1b2eedb3a9d8e347d4479bd441f1a7a864094cbfafcea735317a41"} Jun 11 15:20:17.708712 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:17.708671 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" podStartSLOduration=1.6643089309999999 podStartE2EDuration="6.70865798s" totalImagesPullingTime="5.044349049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:20:17.708325389 +0000 UTC m=+152.919515187" watchObservedRunningTime="2026-06-11 15:20:17.70865798 +0000 UTC m=+152.919847776" Jun 11 15:20:17.740695 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:17.740650 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" podStartSLOduration=1.714325278 podStartE2EDuration="6.740635749s" totalImagesPullingTime="5.026310471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:20:17.739602144 +0000 UTC m=+152.950791935" watchObservedRunningTime="2026-06-11 15:20:17.740635749 +0000 UTC m=+152.951825546" Jun 11 15:20:24.218648 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:20:24.218552 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4795t" podUID="9ad166b7-8da6-4903-8756-21e2d6f7826d" Jun 11 15:20:24.250885 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:20:24.250851 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xvlkl" podUID="5f92ba05-ee12-41ed-9793-f8afe2fa6e6a" Jun 11 15:20:24.710380 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:24.710350 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4795t" Jun 11 15:20:29.094000 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:29.093963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:20:29.094488 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:20:29.094150 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:20:29.094488 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:20:29.094239 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls podName:9ad166b7-8da6-4903-8756-21e2d6f7826d nodeName:}" failed. No retries permitted until 2026-06-11 15:22:31.094218221 +0000 UTC m=+286.305408002 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls") pod "dns-default-4795t" (UID: "9ad166b7-8da6-4903-8756-21e2d6f7826d") : secret "dns-default-metrics-tls" not found Jun 11 15:20:37.230148 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:20:37.230110 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:21:37.869887 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:37.869861 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tw7qk_546a5e49-90ce-450d-98ab-e223385e4e39/dns-node-resolver/0.log" Jun 11 15:21:38.887736 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:38.887711 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-shj99_ec312546-eabd-4bf5-b4fa-107a6791ec0a/node-ca/0.log" Jun 11 15:21:39.471508 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:39.471487 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbrzr_bb67107c-8286-416d-9c14-cddc1cab5eee/serve-healthcheck-canary/0.log" Jun 11 15:21:52.198476 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:52.198373 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" podUID="3a2d521c-2690-4a47-9e64-d0d9f59c6fbe" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 15:21:57.009729 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:57.009684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:21:57.012134 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:57.012108 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f92ba05-ee12-41ed-9793-f8afe2fa6e6a-metrics-certs\") pod \"network-metrics-daemon-xvlkl\" (UID: \"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a\") " pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:21:57.033945 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:57.033920 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cmv6\"" Jun 11 15:21:57.041456 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:57.041437 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvlkl" Jun 11 15:21:57.163601 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:57.163570 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xvlkl"] Jun 11 15:21:57.166764 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:21:57.166733 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f92ba05_ee12_41ed_9793_f8afe2fa6e6a.slice/crio-0eac529af61d0bc6f3ae6bf977a4cf0293ced2903584414ca3fba5ad5d08db97 WatchSource:0}: Error finding container 0eac529af61d0bc6f3ae6bf977a4cf0293ced2903584414ca3fba5ad5d08db97: Status 404 returned error can't find the container with id 0eac529af61d0bc6f3ae6bf977a4cf0293ced2903584414ca3fba5ad5d08db97 Jun 11 15:21:57.969542 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:57.969508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvlkl" event={"ID":"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a","Type":"ContainerStarted","Data":"0eac529af61d0bc6f3ae6bf977a4cf0293ced2903584414ca3fba5ad5d08db97"} Jun 11 15:21:58.973935 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:58.973898 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvlkl" event={"ID":"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a","Type":"ContainerStarted","Data":"dc88b1089173837fb7059d75dcdc1d1354df9eaa58344609538905d7cb6b7574"} Jun 11 15:21:58.974321 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:58.973962 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvlkl" event={"ID":"5f92ba05-ee12-41ed-9793-f8afe2fa6e6a","Type":"ContainerStarted","Data":"1f60f7e26195d649716507b0104c37a0d8d675e88bf6a5ea13e7bcaa8633c8b0"} Jun 11 15:21:59.002399 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.002351 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xvlkl" podStartSLOduration=252.999443063 podStartE2EDuration="4m14.002335984s" totalImagesPullingTime="1.002892921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:59.001935007 +0000 UTC m=+254.213124805" watchObservedRunningTime="2026-06-11 15:21:59.002335984 +0000 UTC m=+254.213525780" Jun 11 15:21:59.563627 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.563588 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j9bzw"] Jun 11 15:21:59.566600 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.566581 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.569596 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.569576 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 15:21:59.569777 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.569764 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 15:21:59.570304 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.570288 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 15:21:59.570357 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.570292 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 15:21:59.570720 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.570702 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l288v\"" Jun 11 15:21:59.582812 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.582792 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9bzw"] Jun 11 15:21:59.626898 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.626863 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f37afe7-ad2e-4ead-b228-a622981ac108-crio-socket\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.626898 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.626891 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f37afe7-ad2e-4ead-b228-a622981ac108-data-volume\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.627116 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.626942 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f37afe7-ad2e-4ead-b228-a622981ac108-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.627116 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.626968 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f37afe7-ad2e-4ead-b228-a622981ac108-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.627116 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.626983 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcv9m\" (UniqueName: \"kubernetes.io/projected/3f37afe7-ad2e-4ead-b228-a622981ac108-kube-api-access-qcv9m\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.727987 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.727938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f37afe7-ad2e-4ead-b228-a622981ac108-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.727987 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.727982 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcv9m\" (UniqueName: \"kubernetes.io/projected/3f37afe7-ad2e-4ead-b228-a622981ac108-kube-api-access-qcv9m\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.728244 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.728095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f37afe7-ad2e-4ead-b228-a622981ac108-crio-socket\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.728244 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.728139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f37afe7-ad2e-4ead-b228-a622981ac108-data-volume\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.728244 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.728194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f37afe7-ad2e-4ead-b228-a622981ac108-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.728244 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.728214 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f37afe7-ad2e-4ead-b228-a622981ac108-crio-socket\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.728542 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.728523 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f37afe7-ad2e-4ead-b228-a622981ac108-data-volume\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.728584 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.728540 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f37afe7-ad2e-4ead-b228-a622981ac108-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.730556 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.730539 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f37afe7-ad2e-4ead-b228-a622981ac108-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.738748 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.738728 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcv9m\" (UniqueName: \"kubernetes.io/projected/3f37afe7-ad2e-4ead-b228-a622981ac108-kube-api-access-qcv9m\") pod \"insights-runtime-extractor-j9bzw\" (UID: \"3f37afe7-ad2e-4ead-b228-a622981ac108\") " pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:21:59.875500 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:21:59.875471 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9bzw" Jun 11 15:22:00.001532 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:00.001500 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9bzw"] Jun 11 15:22:00.004523 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:22:00.004487 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f37afe7_ad2e_4ead_b228_a622981ac108.slice/crio-9f40e1dacf93f1dd9b2885d1a9d173475c8cee558105771fb14fe23514456091 WatchSource:0}: Error finding container 9f40e1dacf93f1dd9b2885d1a9d173475c8cee558105771fb14fe23514456091: Status 404 returned error can't find the container with id 9f40e1dacf93f1dd9b2885d1a9d173475c8cee558105771fb14fe23514456091 Jun 11 15:22:00.981925 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:00.981893 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9bzw" event={"ID":"3f37afe7-ad2e-4ead-b228-a622981ac108","Type":"ContainerStarted","Data":"ff043032c91440a56024cac312e56a04f4055bf2dd24728b690dc5aeb5492ab9"} Jun 11 15:22:00.982116 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:00.981956 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9bzw" event={"ID":"3f37afe7-ad2e-4ead-b228-a622981ac108","Type":"ContainerStarted","Data":"f61c54e602a78ebd3ea17c315923e491513fb7f035c9671b5c59d9fa47cfefb9"} Jun 11 15:22:00.982116 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:00.981984 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9bzw" event={"ID":"3f37afe7-ad2e-4ead-b228-a622981ac108","Type":"ContainerStarted","Data":"9f40e1dacf93f1dd9b2885d1a9d173475c8cee558105771fb14fe23514456091"} Jun 11 15:22:02.198955 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:02.198918 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" podUID="3a2d521c-2690-4a47-9e64-d0d9f59c6fbe" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 15:22:02.991932 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:02.991897 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9bzw" event={"ID":"3f37afe7-ad2e-4ead-b228-a622981ac108","Type":"ContainerStarted","Data":"35b919cb0edd3faa653c5bbd8b0f6af4e9768ba8dfb0a8afdb7d7bf28df58412"} Jun 11 15:22:03.016428 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:03.016372 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j9bzw" podStartSLOduration=1.6596357880000001 podStartE2EDuration="4.016353388s" totalImagesPullingTime="2.3567176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:21:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:03.011359299 +0000 UTC m=+258.222549095" watchObservedRunningTime="2026-06-11 15:22:03.016353388 +0000 UTC m=+258.227543184" Jun 11 15:22:08.753583 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.753545 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf"] Jun 11 15:22:08.756962 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.756938 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:08.763706 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.763685 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 15:22:08.763813 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.763691 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 15:22:08.765005 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.764967 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 15:22:08.765099 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.765015 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 15:22:08.765099 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.765026 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-d4xhh\"" Jun 11 15:22:08.765207 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.765030 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 15:22:08.806609 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.806582 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jrxqq"] Jun 11 15:22:08.809631 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.809615 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.814448 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.814428 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 15:22:08.814583 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.814491 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 15:22:08.815622 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.815598 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b7xsk\"" Jun 11 15:22:08.815849 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.815823 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 15:22:08.829137 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.829109 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf"] Jun 11 15:22:08.898214 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898176 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2nlc\" (UniqueName: \"kubernetes.io/projected/14091220-37dd-4abf-a2be-67f6abd54b64-kube-api-access-n2nlc\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:08.898373 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898239 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-sys\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.898373 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.898373 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898337 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-tls\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.898472 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898374 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.898472 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14091220-37dd-4abf-a2be-67f6abd54b64-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:08.898472 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898449 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-wtmp\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.898579 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-textfile\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.898579 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898495 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14091220-37dd-4abf-a2be-67f6abd54b64-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:08.898579 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898513 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-root\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.898579 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898558 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnfkj\" (UniqueName: \"kubernetes.io/projected/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-kube-api-access-fnfkj\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.898756 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898649 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14091220-37dd-4abf-a2be-67f6abd54b64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:08.898756 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.898678 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-metrics-client-ca\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.999506 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999454 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nlc\" (UniqueName: \"kubernetes.io/projected/14091220-37dd-4abf-a2be-67f6abd54b64-kube-api-access-n2nlc\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:08.999704 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-sys\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.999704 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999552 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.999704 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999579 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-tls\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.999704 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.999704 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999638 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-sys\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:08.999704 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14091220-37dd-4abf-a2be-67f6abd54b64-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:08.999704 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999700 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-wtmp\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.000084 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999723 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-textfile\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.000084 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14091220-37dd-4abf-a2be-67f6abd54b64-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:09.000084 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:22:08.999698 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 15:22:09.000084 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999796 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-root\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.000084 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:22:08.999858 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-tls podName:bc716dcd-ff09-455b-b2a8-73809d3ca6f1 nodeName:}" failed. No retries permitted until 2026-06-11 15:22:09.499838316 +0000 UTC m=+264.711028091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-tls") pod "node-exporter-jrxqq" (UID: "bc716dcd-ff09-455b-b2a8-73809d3ca6f1") : secret "node-exporter-tls" not found Jun 11 15:22:09.000084 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999933 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-wtmp\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.000084 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.000063 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-textfile\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.000084 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:08.999775 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-root\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.000486 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.000118 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnfkj\" (UniqueName: \"kubernetes.io/projected/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-kube-api-access-fnfkj\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.000486 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.000157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14091220-37dd-4abf-a2be-67f6abd54b64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:09.000486 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.000186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-metrics-client-ca\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.000486 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.000289 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.000486 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:22:09.000291 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 15:22:09.000486 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:22:09.000365 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14091220-37dd-4abf-a2be-67f6abd54b64-openshift-state-metrics-tls podName:14091220-37dd-4abf-a2be-67f6abd54b64 nodeName:}" failed. No retries permitted until 2026-06-11 15:22:09.500347883 +0000 UTC m=+264.711537684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/14091220-37dd-4abf-a2be-67f6abd54b64-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-ggjrf" (UID: "14091220-37dd-4abf-a2be-67f6abd54b64") : secret "openshift-state-metrics-tls" not found Jun 11 15:22:09.000486 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.000426 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14091220-37dd-4abf-a2be-67f6abd54b64-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:09.000734 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.000715 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-metrics-client-ca\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.002128 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.002112 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.002419 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.002403 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14091220-37dd-4abf-a2be-67f6abd54b64-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:09.009530 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.009475 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2nlc\" (UniqueName: \"kubernetes.io/projected/14091220-37dd-4abf-a2be-67f6abd54b64-kube-api-access-n2nlc\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:09.009633 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.009532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnfkj\" (UniqueName: \"kubernetes.io/projected/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-kube-api-access-fnfkj\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.504544 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.504491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14091220-37dd-4abf-a2be-67f6abd54b64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:09.504730 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.504574 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-tls\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.507006 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.506966 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc716dcd-ff09-455b-b2a8-73809d3ca6f1-node-exporter-tls\") pod \"node-exporter-jrxqq\" (UID: \"bc716dcd-ff09-455b-b2a8-73809d3ca6f1\") " pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.507103 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.507068 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14091220-37dd-4abf-a2be-67f6abd54b64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ggjrf\" (UID: \"14091220-37dd-4abf-a2be-67f6abd54b64\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:09.665716 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.665680 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" Jun 11 15:22:09.718589 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.718312 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jrxqq" Jun 11 15:22:09.732708 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:22:09.732676 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc716dcd_ff09_455b_b2a8_73809d3ca6f1.slice/crio-153afda66961539f0e9432e281a94e6edda40859d049edc41ea13b89a9175d11 WatchSource:0}: Error finding container 153afda66961539f0e9432e281a94e6edda40859d049edc41ea13b89a9175d11: Status 404 returned error can't find the container with id 153afda66961539f0e9432e281a94e6edda40859d049edc41ea13b89a9175d11 Jun 11 15:22:09.798465 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:09.798393 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf"] Jun 11 15:22:09.801375 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:22:09.801347 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14091220_37dd_4abf_a2be_67f6abd54b64.slice/crio-1bdc6b359d4ae14690ed63169aadeca5b86b688958cf7e4399c581c8b5e9664d WatchSource:0}: Error finding container 1bdc6b359d4ae14690ed63169aadeca5b86b688958cf7e4399c581c8b5e9664d: Status 404 returned error can't find the container with id 1bdc6b359d4ae14690ed63169aadeca5b86b688958cf7e4399c581c8b5e9664d Jun 11 15:22:10.015876 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:10.015835 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" event={"ID":"14091220-37dd-4abf-a2be-67f6abd54b64","Type":"ContainerStarted","Data":"60c5edfc7e4d7927a170eb19bd476332d18bc232050ca358ba317ca1e5dcca34"} Jun 11 15:22:10.016095 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:10.015900 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" event={"ID":"14091220-37dd-4abf-a2be-67f6abd54b64","Type":"ContainerStarted","Data":"7c5049069a322f9e60d63498ef8bdcd52bc0ba522a19fa4432611fef6a2d4c6c"} Jun 11 15:22:10.016095 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:10.015931 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" event={"ID":"14091220-37dd-4abf-a2be-67f6abd54b64","Type":"ContainerStarted","Data":"1bdc6b359d4ae14690ed63169aadeca5b86b688958cf7e4399c581c8b5e9664d"} Jun 11 15:22:10.016823 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:10.016800 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrxqq" event={"ID":"bc716dcd-ff09-455b-b2a8-73809d3ca6f1","Type":"ContainerStarted","Data":"153afda66961539f0e9432e281a94e6edda40859d049edc41ea13b89a9175d11"} Jun 11 15:22:11.020869 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:11.020837 2560 generic.go:356] "Generic (PLEG): container finished" podID="bc716dcd-ff09-455b-b2a8-73809d3ca6f1" containerID="a46232701d49ff0438729768f30ec3c8673308735529b871066118bc109c535e" exitCode=0 Jun 11 15:22:11.021228 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:11.020890 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrxqq" event={"ID":"bc716dcd-ff09-455b-b2a8-73809d3ca6f1","Type":"ContainerDied","Data":"a46232701d49ff0438729768f30ec3c8673308735529b871066118bc109c535e"} Jun 11 15:22:12.029553 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:12.029514 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" event={"ID":"14091220-37dd-4abf-a2be-67f6abd54b64","Type":"ContainerStarted","Data":"51b3209152a8f052f5cdb6909caa0661161805bfa37cea62003b0f7d8fb18d97"} Jun 11 15:22:12.031597 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:12.031572 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrxqq" event={"ID":"bc716dcd-ff09-455b-b2a8-73809d3ca6f1","Type":"ContainerStarted","Data":"78c35b909e86be5acf3fe1f0dafe4e1ee38f762a04deaf82a812f90d187f6f0a"} Jun 11 15:22:12.031716 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:12.031614 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrxqq" event={"ID":"bc716dcd-ff09-455b-b2a8-73809d3ca6f1","Type":"ContainerStarted","Data":"82415eb448e92a85129019311d01a6273291f3751c2e5a6288ecf0c6ec12a0e0"} Jun 11 15:22:12.050028 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:12.049961 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ggjrf" podStartSLOduration=2.5046197660000002 podStartE2EDuration="4.049946918s" totalImagesPullingTime="1.545327152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:12.048898264 +0000 UTC m=+267.260088053" watchObservedRunningTime="2026-06-11 15:22:12.049946918 +0000 UTC m=+267.261136715" Jun 11 15:22:12.069063 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:12.069007 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jrxqq" podStartSLOduration=3.220702421 podStartE2EDuration="4.068974282s" totalImagesPullingTime="778.409927ms" totalInitContainerRuntime="69.861934ms" isStatefulPod=true podCreationTimestamp="2026-06-11 15:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:12.067824433 +0000 UTC m=+267.279014243" watchObservedRunningTime="2026-06-11 15:22:12.068974282 +0000 UTC m=+267.280164080" Jun 11 15:22:12.198091 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:12.198049 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" podUID="3a2d521c-2690-4a47-9e64-d0d9f59c6fbe" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 15:22:12.198230 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:12.198123 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" Jun 11 15:22:12.198679 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:12.198647 2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"695f5bfa234373e423a9934a37927509b072301b39a893bc59ca591ced587b64"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 15:22:12.198719 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:12.198703 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" podUID="3a2d521c-2690-4a47-9e64-d0d9f59c6fbe" containerName="service-proxy" containerID="cri-o://695f5bfa234373e423a9934a37927509b072301b39a893bc59ca591ced587b64" gracePeriod=30 Jun 11 15:22:13.022650 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.022609 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fbb69cf6f-j2nxn"] Jun 11 15:22:13.025617 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.025596 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.028346 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.028316 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 15:22:13.028452 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.028316 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rf9js\"" Jun 11 15:22:13.029429 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.029358 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 15:22:13.029429 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.029393 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 15:22:13.029597 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.029435 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 15:22:13.029597 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.029441 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 15:22:13.029597 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.029470 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 15:22:13.029597 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.029443 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 15:22:13.035146 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.035112 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 15:22:13.037577 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.037556 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fbb69cf6f-j2nxn"] Jun 11 15:22:13.037923 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.037904 2560 generic.go:356] "Generic (PLEG): container finished" podID="3a2d521c-2690-4a47-9e64-d0d9f59c6fbe" containerID="695f5bfa234373e423a9934a37927509b072301b39a893bc59ca591ced587b64" exitCode=2 Jun 11 15:22:13.038041 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.037972 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" event={"ID":"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe","Type":"ContainerDied","Data":"695f5bfa234373e423a9934a37927509b072301b39a893bc59ca591ced587b64"} Jun 11 15:22:13.038041 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.038036 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-776b889657-v2mg7" event={"ID":"3a2d521c-2690-4a47-9e64-d0d9f59c6fbe","Type":"ContainerStarted","Data":"4f996a9a0a847eae9f270a82f010b81ed5ab3673946d6b10c5f0ea0440299c90"} Jun 11 15:22:13.129228 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.129188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-serving-cert\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.129228 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.129220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-config\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.129436 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.129275 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-service-ca\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.129436 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.129323 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz5fr\" (UniqueName: \"kubernetes.io/projected/c7ffaa30-246e-44b0-838e-10dabf2ccae6-kube-api-access-hz5fr\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.129570 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.129552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-oauth-config\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.129777 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.129755 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-oauth-serving-cert\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.129858 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.129818 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-trusted-ca-bundle\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.230761 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.230727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-trusted-ca-bundle\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.230932 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.230770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-serving-cert\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.230932 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.230797 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-config\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.230932 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.230826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-service-ca\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.230932 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.230849 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5fr\" (UniqueName: \"kubernetes.io/projected/c7ffaa30-246e-44b0-838e-10dabf2ccae6-kube-api-access-hz5fr\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.230932 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.230909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-oauth-config\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.231298 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.231269 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-oauth-serving-cert\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.231686 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.231624 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-service-ca\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.231882 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.231857 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-oauth-serving-cert\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.232032 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.231983 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-config\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.232259 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.232234 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-trusted-ca-bundle\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.233542 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.233512 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-serving-cert\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.233690 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.233670 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-oauth-config\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.240458 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.240438 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz5fr\" (UniqueName: \"kubernetes.io/projected/c7ffaa30-246e-44b0-838e-10dabf2ccae6-kube-api-access-hz5fr\") pod \"console-5fbb69cf6f-j2nxn\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.335820 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.335718 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:13.466487 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.466459 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fbb69cf6f-j2nxn"] Jun 11 15:22:13.468961 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:22:13.468937 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ffaa30_246e_44b0_838e_10dabf2ccae6.slice/crio-fb0678d936a892c9896463ba47eee629eb74a17cc71dc753f39bf352ff47a8a3 WatchSource:0}: Error finding container fb0678d936a892c9896463ba47eee629eb74a17cc71dc753f39bf352ff47a8a3: Status 404 returned error can't find the container with id fb0678d936a892c9896463ba47eee629eb74a17cc71dc753f39bf352ff47a8a3 Jun 11 15:22:13.527581 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.527551 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-scnc4"] Jun 11 15:22:13.531565 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.531548 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" Jun 11 15:22:13.534011 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.533966 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 15:22:13.534122 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.534042 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xh8d8\"" Jun 11 15:22:13.541123 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.541100 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-scnc4"] Jun 11 15:22:13.633880 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.633847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87nd\" (UniqueName: \"kubernetes.io/projected/f2d4b856-4ff8-4066-b807-8b9728a3d227-kube-api-access-z87nd\") pod \"monitoring-plugin-76b68cc874-scnc4\" (UID: \"f2d4b856-4ff8-4066-b807-8b9728a3d227\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" Jun 11 15:22:13.634059 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.633898 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2d4b856-4ff8-4066-b807-8b9728a3d227-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-scnc4\" (UID: \"f2d4b856-4ff8-4066-b807-8b9728a3d227\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" Jun 11 15:22:13.734492 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.734456 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z87nd\" (UniqueName: \"kubernetes.io/projected/f2d4b856-4ff8-4066-b807-8b9728a3d227-kube-api-access-z87nd\") pod \"monitoring-plugin-76b68cc874-scnc4\" (UID: \"f2d4b856-4ff8-4066-b807-8b9728a3d227\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" Jun 11 15:22:13.734629 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.734512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2d4b856-4ff8-4066-b807-8b9728a3d227-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-scnc4\" (UID: \"f2d4b856-4ff8-4066-b807-8b9728a3d227\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" Jun 11 15:22:13.737028 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.736988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f2d4b856-4ff8-4066-b807-8b9728a3d227-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-scnc4\" (UID: \"f2d4b856-4ff8-4066-b807-8b9728a3d227\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" Jun 11 15:22:13.756076 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.756047 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87nd\" (UniqueName: \"kubernetes.io/projected/f2d4b856-4ff8-4066-b807-8b9728a3d227-kube-api-access-z87nd\") pod \"monitoring-plugin-76b68cc874-scnc4\" (UID: \"f2d4b856-4ff8-4066-b807-8b9728a3d227\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" Jun 11 15:22:13.840201 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.840167 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" Jun 11 15:22:13.984748 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:13.984726 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-scnc4"] Jun 11 15:22:13.987024 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:22:13.986987 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d4b856_4ff8_4066_b807_8b9728a3d227.slice/crio-6d0b0fedeabe23ac2406bbe15b09b6a05afcf9ade87822b8c597a8e889046ed4 WatchSource:0}: Error finding container 6d0b0fedeabe23ac2406bbe15b09b6a05afcf9ade87822b8c597a8e889046ed4: Status 404 returned error can't find the container with id 6d0b0fedeabe23ac2406bbe15b09b6a05afcf9ade87822b8c597a8e889046ed4 Jun 11 15:22:14.046774 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:14.046734 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbb69cf6f-j2nxn" event={"ID":"c7ffaa30-246e-44b0-838e-10dabf2ccae6","Type":"ContainerStarted","Data":"fb0678d936a892c9896463ba47eee629eb74a17cc71dc753f39bf352ff47a8a3"} Jun 11 15:22:14.047866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:14.047844 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" event={"ID":"f2d4b856-4ff8-4066-b807-8b9728a3d227","Type":"ContainerStarted","Data":"6d0b0fedeabe23ac2406bbe15b09b6a05afcf9ade87822b8c597a8e889046ed4"} Jun 11 15:22:17.059644 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:17.059551 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" event={"ID":"f2d4b856-4ff8-4066-b807-8b9728a3d227","Type":"ContainerStarted","Data":"0efacf3cf8c7bc1565f39c54eb87171cbc1a968a510df6e06b4e0fb17b7311d2"} Jun 11 15:22:17.060104 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:17.059737 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" Jun 11 15:22:17.061104 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:17.061070 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbb69cf6f-j2nxn" event={"ID":"c7ffaa30-246e-44b0-838e-10dabf2ccae6","Type":"ContainerStarted","Data":"36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584"} Jun 11 15:22:17.064927 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:17.064908 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" Jun 11 15:22:17.081505 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:17.081447 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-scnc4" podStartSLOduration=1.407193232 podStartE2EDuration="4.081432853s" totalImagesPullingTime="2.674239621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:17.080321746 +0000 UTC m=+272.291511534" watchObservedRunningTime="2026-06-11 15:22:17.081432853 +0000 UTC m=+272.292622628" Jun 11 15:22:17.124189 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:17.124117 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fbb69cf6f-j2nxn" podStartSLOduration=0.925088276 podStartE2EDuration="4.124100937s" totalImagesPullingTime="3.199012661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:17.123160823 +0000 UTC m=+272.334350611" watchObservedRunningTime="2026-06-11 15:22:17.124100937 +0000 UTC m=+272.335290734" Jun 11 15:22:17.685305 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:17.685264 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" podUID="862f6d94-11c2-4b74-b3d2-299baa89c754" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 11 15:22:18.066390 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:18.066355 2560 generic.go:356] "Generic (PLEG): container finished" podID="862f6d94-11c2-4b74-b3d2-299baa89c754" containerID="c798f3bfa6305babbcfeaf99b250c4b51e64aac0705f03915cfa96d26bfd66ba" exitCode=1 Jun 11 15:22:18.066786 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:18.066424 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" event={"ID":"862f6d94-11c2-4b74-b3d2-299baa89c754","Type":"ContainerDied","Data":"c798f3bfa6305babbcfeaf99b250c4b51e64aac0705f03915cfa96d26bfd66ba"} Jun 11 15:22:18.066889 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:18.066873 2560 scope.go:117] "RemoveContainer" containerID="c798f3bfa6305babbcfeaf99b250c4b51e64aac0705f03915cfa96d26bfd66ba" Jun 11 15:22:19.071800 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:19.071764 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" event={"ID":"862f6d94-11c2-4b74-b3d2-299baa89c754","Type":"ContainerStarted","Data":"0f11e82512124c24e9b88450284053859577e43d090b9a199b47457d36457d12"} Jun 11 15:22:19.072235 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:19.072200 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:22:19.072729 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:19.072711 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bfd8bd945-vm8l9" Jun 11 15:22:23.336042 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:23.335973 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:23.336042 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:23.336056 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:23.337504 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:23.337479 2560 patch_prober.go:28] interesting pod/console-5fbb69cf6f-j2nxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 11 15:22:23.337601 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:23.337530 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5fbb69cf6f-j2nxn" podUID="c7ffaa30-246e-44b0-838e-10dabf2ccae6" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 11 15:22:27.711117 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:22:27.711066 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4795t" podUID="9ad166b7-8da6-4903-8756-21e2d6f7826d" Jun 11 15:22:28.102056 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:28.101963 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4795t" Jun 11 15:22:31.164372 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:31.164333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:22:31.166884 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:31.166857 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad166b7-8da6-4903-8756-21e2d6f7826d-metrics-tls\") pod \"dns-default-4795t\" (UID: \"9ad166b7-8da6-4903-8756-21e2d6f7826d\") " pod="openshift-dns/dns-default-4795t" Jun 11 15:22:31.405842 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:31.405806 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jps6d\"" Jun 11 15:22:31.414069 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:31.414044 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4795t" Jun 11 15:22:31.560878 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:31.560848 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4795t"] Jun 11 15:22:31.563697 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:22:31.563671 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad166b7_8da6_4903_8756_21e2d6f7826d.slice/crio-8d86714ab3c66d4a434518adff01c5548a161c7d503fcd277a1353fb4d709534 WatchSource:0}: Error finding container 8d86714ab3c66d4a434518adff01c5548a161c7d503fcd277a1353fb4d709534: Status 404 returned error can't find the container with id 8d86714ab3c66d4a434518adff01c5548a161c7d503fcd277a1353fb4d709534 Jun 11 15:22:32.117418 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:32.117382 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4795t" event={"ID":"9ad166b7-8da6-4903-8756-21e2d6f7826d","Type":"ContainerStarted","Data":"8d86714ab3c66d4a434518adff01c5548a161c7d503fcd277a1353fb4d709534"} Jun 11 15:22:33.341259 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:33.341224 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:33.345030 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:33.345011 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:22:34.126287 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:34.126254 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4795t" event={"ID":"9ad166b7-8da6-4903-8756-21e2d6f7826d","Type":"ContainerStarted","Data":"61bb265436de029af6c65910cb096239ec659a3b54d2e8afffd0e79c4a1f2034"} Jun 11 15:22:34.126474 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:34.126307 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4795t" event={"ID":"9ad166b7-8da6-4903-8756-21e2d6f7826d","Type":"ContainerStarted","Data":"a2e6d14c9ebc8416be736362a7966faabff71315a30b030dc145c68a8e0ae3bc"} Jun 11 15:22:34.126474 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:34.126405 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4795t" Jun 11 15:22:34.147935 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:34.147881 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4795t" podStartSLOduration=251.361857669 podStartE2EDuration="4m13.147864082s" totalImagesPullingTime="1.786006413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:34.146765996 +0000 UTC m=+289.357955793" watchObservedRunningTime="2026-06-11 15:22:34.147864082 +0000 UTC m=+289.359053879" Jun 11 15:22:40.918932 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:40.918895 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fbb69cf6f-j2nxn"] Jun 11 15:22:44.132423 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:44.132393 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4795t" Jun 11 15:22:45.170668 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:45.170637 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:22:45.176932 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:45.176912 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:22:45.178676 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:22:45.178655 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 15:23:01.193187 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:01.193128 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbrzr_bb67107c-8286-416d-9c14-cddc1cab5eee/serve-healthcheck-canary/0.log" Jun 11 15:23:05.938757 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:05.938703 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5fbb69cf6f-j2nxn" podUID="c7ffaa30-246e-44b0-838e-10dabf2ccae6" containerName="console" containerID="cri-o://36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584" gracePeriod=15 Jun 11 15:23:06.174715 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.174691 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:23:06.210498 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.210417 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-serving-cert\") pod \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " Jun 11 15:23:06.210498 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.210458 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-oauth-config\") pod \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " Jun 11 15:23:06.210498 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.210485 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-oauth-serving-cert\") pod \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " Jun 11 15:23:06.210747 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.210543 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-service-ca\") pod \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " Jun 11 15:23:06.210747 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.210582 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-trusted-ca-bundle\") pod \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " Jun 11 15:23:06.210747 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.210693 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz5fr\" (UniqueName: \"kubernetes.io/projected/c7ffaa30-246e-44b0-838e-10dabf2ccae6-kube-api-access-hz5fr\") pod \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " Jun 11 15:23:06.210747 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.210743 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-config\") pod \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\" (UID: \"c7ffaa30-246e-44b0-838e-10dabf2ccae6\") " Jun 11 15:23:06.210945 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.210910 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7ffaa30-246e-44b0-838e-10dabf2ccae6" (UID: "c7ffaa30-246e-44b0-838e-10dabf2ccae6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:06.211027 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.210952 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7ffaa30-246e-44b0-838e-10dabf2ccae6" (UID: "c7ffaa30-246e-44b0-838e-10dabf2ccae6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:06.211027 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.210980 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7ffaa30-246e-44b0-838e-10dabf2ccae6" (UID: "c7ffaa30-246e-44b0-838e-10dabf2ccae6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:06.211477 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.211452 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-config" (OuterVolumeSpecName: "console-config") pod "c7ffaa30-246e-44b0-838e-10dabf2ccae6" (UID: "c7ffaa30-246e-44b0-838e-10dabf2ccae6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:06.212913 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.212886 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7ffaa30-246e-44b0-838e-10dabf2ccae6" (UID: "c7ffaa30-246e-44b0-838e-10dabf2ccae6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:06.212913 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.212907 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ffaa30-246e-44b0-838e-10dabf2ccae6-kube-api-access-hz5fr" (OuterVolumeSpecName: "kube-api-access-hz5fr") pod "c7ffaa30-246e-44b0-838e-10dabf2ccae6" (UID: "c7ffaa30-246e-44b0-838e-10dabf2ccae6"). InnerVolumeSpecName "kube-api-access-hz5fr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:23:06.213129 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.212946 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7ffaa30-246e-44b0-838e-10dabf2ccae6" (UID: "c7ffaa30-246e-44b0-838e-10dabf2ccae6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:06.242603 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.242565 2560 generic.go:356] "Generic (PLEG): container finished" podID="c7ffaa30-246e-44b0-838e-10dabf2ccae6" containerID="36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584" exitCode=0 Jun 11 15:23:06.242603 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.242605 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbb69cf6f-j2nxn" event={"ID":"c7ffaa30-246e-44b0-838e-10dabf2ccae6","Type":"ContainerDied","Data":"36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584"} Jun 11 15:23:06.242817 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.242623 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbb69cf6f-j2nxn" Jun 11 15:23:06.242817 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.242680 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbb69cf6f-j2nxn" event={"ID":"c7ffaa30-246e-44b0-838e-10dabf2ccae6","Type":"ContainerDied","Data":"fb0678d936a892c9896463ba47eee629eb74a17cc71dc753f39bf352ff47a8a3"} Jun 11 15:23:06.242817 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.242707 2560 scope.go:117] "RemoveContainer" containerID="36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584" Jun 11 15:23:06.250969 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.250950 2560 scope.go:117] "RemoveContainer" containerID="36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584" Jun 11 15:23:06.251255 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:23:06.251234 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584\": container with ID starting with 36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584 not found: ID does not exist" containerID="36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584" Jun 11 15:23:06.251313 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.251263 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584"} err="failed to get container status \"36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584\": rpc error: code = NotFound desc = could not find container \"36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584\": container with ID starting with 36075e73ed39b1ededecb8257fe9d7fd43082dac63cfcd507de9f92fe2579584 not found: ID does not exist" Jun 11 15:23:06.263815 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.263795 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fbb69cf6f-j2nxn"] Jun 11 15:23:06.268469 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.268448 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fbb69cf6f-j2nxn"] Jun 11 15:23:06.311418 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.311391 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-service-ca\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:23:06.311418 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.311414 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-trusted-ca-bundle\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:23:06.311561 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.311424 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz5fr\" (UniqueName: \"kubernetes.io/projected/c7ffaa30-246e-44b0-838e-10dabf2ccae6-kube-api-access-hz5fr\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:23:06.311561 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.311434 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-config\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:23:06.311561 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.311443 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-serving-cert\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:23:06.311561 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.311450 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7ffaa30-246e-44b0-838e-10dabf2ccae6-console-oauth-config\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:23:06.311561 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:06.311459 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7ffaa30-246e-44b0-838e-10dabf2ccae6-oauth-serving-cert\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:23:07.234267 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:07.234235 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ffaa30-246e-44b0-838e-10dabf2ccae6" path="/var/lib/kubelet/pods/c7ffaa30-246e-44b0-838e-10dabf2ccae6/volumes" Jun 11 15:23:46.258503 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.258469 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cdf4d4b56-bw6wn"] Jun 11 15:23:46.258933 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.258704 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ffaa30-246e-44b0-838e-10dabf2ccae6" containerName="console" Jun 11 15:23:46.258933 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.258716 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ffaa30-246e-44b0-838e-10dabf2ccae6" containerName="console" Jun 11 15:23:46.258933 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.258776 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ffaa30-246e-44b0-838e-10dabf2ccae6" containerName="console" Jun 11 15:23:46.262880 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.262861 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.265860 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.265840 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 15:23:46.265963 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.265841 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 15:23:46.266867 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.266784 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 15:23:46.266867 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.266855 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rf9js\"" Jun 11 15:23:46.267042 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.267016 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 15:23:46.267042 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.267036 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 15:23:46.267168 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.267081 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 15:23:46.267168 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.267149 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 15:23:46.278881 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.278856 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 15:23:46.282539 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.282514 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cdf4d4b56-bw6wn"] Jun 11 15:23:46.382397 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.382364 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-trusted-ca-bundle\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.382553 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.382434 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-config\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.382553 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.382463 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zqr7\" (UniqueName: \"kubernetes.io/projected/13e2ef8d-994a-4d42-9dfa-bfeca8846254-kube-api-access-4zqr7\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.382553 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.382498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-service-ca\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.382553 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.382526 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-serving-cert\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.382726 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.382556 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-oauth-config\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.382726 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.382584 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-oauth-serving-cert\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.483706 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.483674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-config\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.483706 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.483706 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zqr7\" (UniqueName: \"kubernetes.io/projected/13e2ef8d-994a-4d42-9dfa-bfeca8846254-kube-api-access-4zqr7\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.483931 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.483731 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-service-ca\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.483931 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.483750 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-serving-cert\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.483931 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.483798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-oauth-config\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.483931 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.483843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-oauth-serving-cert\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.483931 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.483882 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-trusted-ca-bundle\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.484692 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.484665 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-oauth-serving-cert\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.484790 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.484742 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-config\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.484790 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.484765 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-service-ca\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.484871 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.484788 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-trusted-ca-bundle\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.486430 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.486397 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-serving-cert\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.486538 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.486460 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-oauth-config\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.493868 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.493845 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zqr7\" (UniqueName: \"kubernetes.io/projected/13e2ef8d-994a-4d42-9dfa-bfeca8846254-kube-api-access-4zqr7\") pod \"console-5cdf4d4b56-bw6wn\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.572774 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.572709 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:46.706818 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:46.706789 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cdf4d4b56-bw6wn"] Jun 11 15:23:46.710079 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:23:46.710054 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e2ef8d_994a_4d42_9dfa_bfeca8846254.slice/crio-707412454c9c6dfd5cbf134844e4b23444f79e1b118b5a16165177d2dcc55563 WatchSource:0}: Error finding container 707412454c9c6dfd5cbf134844e4b23444f79e1b118b5a16165177d2dcc55563: Status 404 returned error can't find the container with id 707412454c9c6dfd5cbf134844e4b23444f79e1b118b5a16165177d2dcc55563 Jun 11 15:23:47.383917 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:47.383880 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdf4d4b56-bw6wn" event={"ID":"13e2ef8d-994a-4d42-9dfa-bfeca8846254","Type":"ContainerStarted","Data":"765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6"} Jun 11 15:23:47.384411 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:47.383932 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdf4d4b56-bw6wn" event={"ID":"13e2ef8d-994a-4d42-9dfa-bfeca8846254","Type":"ContainerStarted","Data":"707412454c9c6dfd5cbf134844e4b23444f79e1b118b5a16165177d2dcc55563"} Jun 11 15:23:47.406036 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:47.405970 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cdf4d4b56-bw6wn" podStartSLOduration=1.4059543030000001 podStartE2EDuration="1.405954303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:23:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:23:47.4049373 +0000 UTC m=+362.616127099" watchObservedRunningTime="2026-06-11 15:23:47.405954303 +0000 UTC m=+362.617144169" Jun 11 15:23:56.572971 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:56.572930 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:56.572971 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:56.572985 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:56.577576 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:56.577552 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:23:57.422331 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:23:57.422301 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:26:07.910914 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:07.910877 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-kldh6"] Jun 11 15:26:07.913821 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:07.913804 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-kldh6" Jun 11 15:26:07.916717 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:07.916694 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 15:26:07.916849 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:07.916798 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nkkmz\"" Jun 11 15:26:07.916941 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:07.916919 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 15:26:07.923646 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:07.923625 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-kldh6"] Jun 11 15:26:08.075467 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:08.075432 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4mqp\" (UniqueName: \"kubernetes.io/projected/718d2625-5a95-4970-aa10-a351d0296fc9-kube-api-access-b4mqp\") pod \"cert-manager-59c77684cc-kldh6\" (UID: \"718d2625-5a95-4970-aa10-a351d0296fc9\") " pod="cert-manager/cert-manager-59c77684cc-kldh6" Jun 11 15:26:08.075645 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:08.075489 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/718d2625-5a95-4970-aa10-a351d0296fc9-bound-sa-token\") pod \"cert-manager-59c77684cc-kldh6\" (UID: \"718d2625-5a95-4970-aa10-a351d0296fc9\") " pod="cert-manager/cert-manager-59c77684cc-kldh6" Jun 11 15:26:08.176082 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:08.175971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/718d2625-5a95-4970-aa10-a351d0296fc9-bound-sa-token\") pod \"cert-manager-59c77684cc-kldh6\" (UID: \"718d2625-5a95-4970-aa10-a351d0296fc9\") " pod="cert-manager/cert-manager-59c77684cc-kldh6" Jun 11 15:26:08.176082 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:08.176066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4mqp\" (UniqueName: \"kubernetes.io/projected/718d2625-5a95-4970-aa10-a351d0296fc9-kube-api-access-b4mqp\") pod \"cert-manager-59c77684cc-kldh6\" (UID: \"718d2625-5a95-4970-aa10-a351d0296fc9\") " pod="cert-manager/cert-manager-59c77684cc-kldh6" Jun 11 15:26:08.185403 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:08.185379 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/718d2625-5a95-4970-aa10-a351d0296fc9-bound-sa-token\") pod \"cert-manager-59c77684cc-kldh6\" (UID: \"718d2625-5a95-4970-aa10-a351d0296fc9\") " pod="cert-manager/cert-manager-59c77684cc-kldh6" Jun 11 15:26:08.185721 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:08.185702 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4mqp\" (UniqueName: \"kubernetes.io/projected/718d2625-5a95-4970-aa10-a351d0296fc9-kube-api-access-b4mqp\") pod \"cert-manager-59c77684cc-kldh6\" (UID: \"718d2625-5a95-4970-aa10-a351d0296fc9\") " pod="cert-manager/cert-manager-59c77684cc-kldh6" Jun 11 15:26:08.222659 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:08.222621 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-kldh6" Jun 11 15:26:08.361714 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:08.361681 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-kldh6"] Jun 11 15:26:08.364849 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:26:08.364812 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod718d2625_5a95_4970_aa10_a351d0296fc9.slice/crio-513237be4ea1cefd3b13347976d0a6a452c1b3e94557c5fe64f7e5a51a8ea6bd WatchSource:0}: Error finding container 513237be4ea1cefd3b13347976d0a6a452c1b3e94557c5fe64f7e5a51a8ea6bd: Status 404 returned error can't find the container with id 513237be4ea1cefd3b13347976d0a6a452c1b3e94557c5fe64f7e5a51a8ea6bd Jun 11 15:26:08.367273 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:08.367252 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:26:08.846182 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:08.846141 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-kldh6" event={"ID":"718d2625-5a95-4970-aa10-a351d0296fc9","Type":"ContainerStarted","Data":"513237be4ea1cefd3b13347976d0a6a452c1b3e94557c5fe64f7e5a51a8ea6bd"} Jun 11 15:26:11.861917 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:11.861828 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-kldh6" event={"ID":"718d2625-5a95-4970-aa10-a351d0296fc9","Type":"ContainerStarted","Data":"3348fb5d5f2e67075e7eddedb966ae9ebfed0669e1acadf9d5f15f1c90355103"} Jun 11 15:26:11.880422 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:11.880368 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-kldh6" podStartSLOduration=1.759952296 podStartE2EDuration="4.880353854s" totalImagesPullingTime="3.120401558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:26:11.879433016 +0000 UTC m=+507.090622838" watchObservedRunningTime="2026-06-11 15:26:11.880353854 +0000 UTC m=+507.091543651" Jun 11 15:26:38.503738 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.503704 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng"] Jun 11 15:26:38.506876 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.506858 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.511568 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.511399 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 15:26:38.511568 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.511441 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fx5k4\"" Jun 11 15:26:38.511568 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.511481 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 15:26:38.512059 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.512037 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:26:38.512556 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.512540 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 15:26:38.512956 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.512938 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 15:26:38.525493 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.525466 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng"] Jun 11 15:26:38.586557 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.586525 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/494220ab-7755-4ef9-91c1-fbfbac761489-manager-config\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.586713 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.586578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/494220ab-7755-4ef9-91c1-fbfbac761489-cert\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.586713 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.586597 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvcwr\" (UniqueName: \"kubernetes.io/projected/494220ab-7755-4ef9-91c1-fbfbac761489-kube-api-access-hvcwr\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.586713 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.586621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/494220ab-7755-4ef9-91c1-fbfbac761489-metrics-cert\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.687199 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.687161 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/494220ab-7755-4ef9-91c1-fbfbac761489-cert\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.687199 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.687201 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvcwr\" (UniqueName: \"kubernetes.io/projected/494220ab-7755-4ef9-91c1-fbfbac761489-kube-api-access-hvcwr\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.687399 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.687219 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/494220ab-7755-4ef9-91c1-fbfbac761489-metrics-cert\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.687399 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.687257 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/494220ab-7755-4ef9-91c1-fbfbac761489-manager-config\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.687900 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.687879 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/494220ab-7755-4ef9-91c1-fbfbac761489-manager-config\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.689844 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.689816 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/494220ab-7755-4ef9-91c1-fbfbac761489-metrics-cert\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.689954 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.689856 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/494220ab-7755-4ef9-91c1-fbfbac761489-cert\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.702314 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.702290 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvcwr\" (UniqueName: \"kubernetes.io/projected/494220ab-7755-4ef9-91c1-fbfbac761489-kube-api-access-hvcwr\") pod \"lws-controller-manager-7c548d559f-v9kng\" (UID: \"494220ab-7755-4ef9-91c1-fbfbac761489\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.818314 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.818242 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:38.959117 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:38.959080 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng"] Jun 11 15:26:38.961977 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:26:38.961949 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494220ab_7755_4ef9_91c1_fbfbac761489.slice/crio-d3a833ea39a94528188ba0ceb27717ccd126bc665b7996403bab3723a97428b2 WatchSource:0}: Error finding container d3a833ea39a94528188ba0ceb27717ccd126bc665b7996403bab3723a97428b2: Status 404 returned error can't find the container with id d3a833ea39a94528188ba0ceb27717ccd126bc665b7996403bab3723a97428b2 Jun 11 15:26:39.960632 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:39.960592 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" event={"ID":"494220ab-7755-4ef9-91c1-fbfbac761489","Type":"ContainerStarted","Data":"d3a833ea39a94528188ba0ceb27717ccd126bc665b7996403bab3723a97428b2"} Jun 11 15:26:40.663646 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.663612 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9"] Jun 11 15:26:40.666621 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.666606 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.673239 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.673220 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 15:26:40.673552 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.673534 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 15:26:40.674168 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.674153 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 15:26:40.674257 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.674240 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pgv5s\"" Jun 11 15:26:40.674524 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.674511 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 15:26:40.682681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.682657 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9"] Jun 11 15:26:40.704195 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.704170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-tmp\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.704300 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.704196 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.704300 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.704216 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.704388 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.704300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-manifests\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.704388 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.704350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7chk4\" (UniqueName: \"kubernetes.io/projected/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-kube-api-access-7chk4\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.805520 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.805485 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-manifests\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.805627 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.805529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7chk4\" (UniqueName: \"kubernetes.io/projected/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-kube-api-access-7chk4\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.805627 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.805573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-tmp\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.805627 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.805595 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.805627 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.805619 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.805970 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.805945 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-manifests\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.808070 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.808048 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-tmp\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.808242 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.808222 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.808298 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.808248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.816485 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.816463 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7chk4\" (UniqueName: \"kubernetes.io/projected/dc70ea5e-028f-4a18-bfda-fbfb1d41215d-kube-api-access-7chk4\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-wgjn9\" (UID: \"dc70ea5e-028f-4a18-bfda-fbfb1d41215d\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:40.976961 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:40.976870 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:41.107161 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:41.107138 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9"] Jun 11 15:26:41.109546 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:26:41.109521 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc70ea5e_028f_4a18_bfda_fbfb1d41215d.slice/crio-120695cf553e70326f65fd87c3efb9bf8194882698252f1ad65592fe7a3628bc WatchSource:0}: Error finding container 120695cf553e70326f65fd87c3efb9bf8194882698252f1ad65592fe7a3628bc: Status 404 returned error can't find the container with id 120695cf553e70326f65fd87c3efb9bf8194882698252f1ad65592fe7a3628bc Jun 11 15:26:41.970511 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:41.970468 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" event={"ID":"dc70ea5e-028f-4a18-bfda-fbfb1d41215d","Type":"ContainerStarted","Data":"120695cf553e70326f65fd87c3efb9bf8194882698252f1ad65592fe7a3628bc"} Jun 11 15:26:44.982807 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:44.982765 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" event={"ID":"dc70ea5e-028f-4a18-bfda-fbfb1d41215d","Type":"ContainerStarted","Data":"7d1fd46f33281c38b29255bc9449e839ce37b0743e33b5222fc9b51084399681"} Jun 11 15:26:44.984232 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:44.984209 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" event={"ID":"494220ab-7755-4ef9-91c1-fbfbac761489","Type":"ContainerStarted","Data":"8caff650bb8fa29bafff2fc776beeb933adbac807e77bbe8bda4319bfa61b3b5"} Jun 11 15:26:44.984350 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:44.984323 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:45.025712 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:45.025669 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" podStartSLOduration=1.5184462600000002 podStartE2EDuration="7.025653292s" totalImagesPullingTime="5.507207032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:26:45.024962407 +0000 UTC m=+540.236152204" watchObservedRunningTime="2026-06-11 15:26:45.025653292 +0000 UTC m=+540.236843089" Jun 11 15:26:45.989038 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:45.988978 2560 generic.go:356] "Generic (PLEG): container finished" podID="dc70ea5e-028f-4a18-bfda-fbfb1d41215d" containerID="7d1fd46f33281c38b29255bc9449e839ce37b0743e33b5222fc9b51084399681" exitCode=0 Jun 11 15:26:45.989507 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:45.989065 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" event={"ID":"dc70ea5e-028f-4a18-bfda-fbfb1d41215d","Type":"ContainerDied","Data":"7d1fd46f33281c38b29255bc9449e839ce37b0743e33b5222fc9b51084399681"} Jun 11 15:26:46.994737 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:46.994706 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" event={"ID":"dc70ea5e-028f-4a18-bfda-fbfb1d41215d","Type":"ContainerStarted","Data":"d9e51d4ae61431f3ffc790b6f5a1f86486f1c43b57c00da026bea97158205516"} Jun 11 15:26:46.995132 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:46.994832 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:26:47.022370 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:47.022320 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" podStartSLOduration=2.404539924 podStartE2EDuration="7.022306477s" totalImagesPullingTime="3.702697379s" totalInitContainerRuntime="915.069174ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:26:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:26:47.020362789 +0000 UTC m=+542.231552585" watchObservedRunningTime="2026-06-11 15:26:47.022306477 +0000 UTC m=+542.233496274" Jun 11 15:26:55.991672 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:55.991639 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-v9kng" Jun 11 15:26:58.001016 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:26:58.000962 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-wgjn9" Jun 11 15:27:37.093264 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.093231 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-65d958f89-x45p7"] Jun 11 15:27:37.096138 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.096117 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-65d958f89-x45p7" Jun 11 15:27:37.098594 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.098571 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mqpd6\"" Jun 11 15:27:37.098594 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.098587 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 15:27:37.107133 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.107106 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-65d958f89-x45p7"] Jun 11 15:27:37.131950 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.131923 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a51beed3-5271-4a7a-84e8-4e3db12767c1-redirect-config\") pod \"dashboard-redirect-65d958f89-x45p7\" (UID: \"a51beed3-5271-4a7a-84e8-4e3db12767c1\") " pod="opendatahub/dashboard-redirect-65d958f89-x45p7" Jun 11 15:27:37.132086 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.131957 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chdqv\" (UniqueName: \"kubernetes.io/projected/a51beed3-5271-4a7a-84e8-4e3db12767c1-kube-api-access-chdqv\") pod \"dashboard-redirect-65d958f89-x45p7\" (UID: \"a51beed3-5271-4a7a-84e8-4e3db12767c1\") " pod="opendatahub/dashboard-redirect-65d958f89-x45p7" Jun 11 15:27:37.232328 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.232301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chdqv\" (UniqueName: \"kubernetes.io/projected/a51beed3-5271-4a7a-84e8-4e3db12767c1-kube-api-access-chdqv\") pod \"dashboard-redirect-65d958f89-x45p7\" (UID: \"a51beed3-5271-4a7a-84e8-4e3db12767c1\") " pod="opendatahub/dashboard-redirect-65d958f89-x45p7" Jun 11 15:27:37.232562 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.232364 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a51beed3-5271-4a7a-84e8-4e3db12767c1-redirect-config\") pod \"dashboard-redirect-65d958f89-x45p7\" (UID: \"a51beed3-5271-4a7a-84e8-4e3db12767c1\") " pod="opendatahub/dashboard-redirect-65d958f89-x45p7" Jun 11 15:27:37.233285 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.233261 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a51beed3-5271-4a7a-84e8-4e3db12767c1-redirect-config\") pod \"dashboard-redirect-65d958f89-x45p7\" (UID: \"a51beed3-5271-4a7a-84e8-4e3db12767c1\") " pod="opendatahub/dashboard-redirect-65d958f89-x45p7" Jun 11 15:27:37.243255 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.243226 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chdqv\" (UniqueName: \"kubernetes.io/projected/a51beed3-5271-4a7a-84e8-4e3db12767c1-kube-api-access-chdqv\") pod \"dashboard-redirect-65d958f89-x45p7\" (UID: \"a51beed3-5271-4a7a-84e8-4e3db12767c1\") " pod="opendatahub/dashboard-redirect-65d958f89-x45p7" Jun 11 15:27:37.406696 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.406661 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-65d958f89-x45p7" Jun 11 15:27:37.533162 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:37.533136 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-65d958f89-x45p7"] Jun 11 15:27:37.535785 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:27:37.535757 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51beed3_5271_4a7a_84e8_4e3db12767c1.slice/crio-1db20bafe8ccad486212de36d924090bed4814719e4aef159348b3afd63b3a8e WatchSource:0}: Error finding container 1db20bafe8ccad486212de36d924090bed4814719e4aef159348b3afd63b3a8e: Status 404 returned error can't find the container with id 1db20bafe8ccad486212de36d924090bed4814719e4aef159348b3afd63b3a8e Jun 11 15:27:38.187183 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:38.187145 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-65d958f89-x45p7" event={"ID":"a51beed3-5271-4a7a-84e8-4e3db12767c1","Type":"ContainerStarted","Data":"1db20bafe8ccad486212de36d924090bed4814719e4aef159348b3afd63b3a8e"} Jun 11 15:27:45.197536 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:45.197510 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:27:45.199426 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:45.199406 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:27:45.215754 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:45.215724 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-65d958f89-x45p7" event={"ID":"a51beed3-5271-4a7a-84e8-4e3db12767c1","Type":"ContainerStarted","Data":"a7e716f6aad7b8c82cf6943e7e20cf426a32f0b13d7c58e0be37ecea6ecec75d"} Jun 11 15:27:45.234546 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:45.234501 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-65d958f89-x45p7" podStartSLOduration=1.522059122 podStartE2EDuration="8.234486695s" totalImagesPullingTime="6.712427573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:27:45.233949433 +0000 UTC m=+600.445139231" watchObservedRunningTime="2026-06-11 15:27:45.234486695 +0000 UTC m=+600.445676491" Jun 11 15:27:55.539984 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.539946 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst"] Jun 11 15:27:55.543267 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.543243 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.545669 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.545645 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 15:27:55.545871 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.545851 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 15:27:55.545958 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.545937 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rzpjb\"" Jun 11 15:27:55.546028 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.545952 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 15:27:55.555698 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.555678 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst"] Jun 11 15:27:55.563353 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.563324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.563455 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.563366 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.563455 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.563383 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.563455 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.563404 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvvkd\" (UniqueName: \"kubernetes.io/projected/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-kube-api-access-pvvkd\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.563576 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.563481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.563576 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.563517 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.563576 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.563569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.563674 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.563589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.563674 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.563629 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.664464 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.664427 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.664636 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.664473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.664636 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.664493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.664636 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.664612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.664764 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.664655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.664764 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.664690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.664764 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.664718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.664764 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.664755 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvvkd\" (UniqueName: \"kubernetes.io/projected/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-kube-api-access-pvvkd\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.664957 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.664807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.665115 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.665082 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.665234 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.665124 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.665299 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.665241 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.665299 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.665246 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.665498 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.665478 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.666946 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.666919 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.667065 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.667049 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.678064 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.677847 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.681013 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.678256 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvvkd\" (UniqueName: \"kubernetes.io/projected/56b6760e-4bf9-405e-a67e-ddc5d88e7a15-kube-api-access-pvvkd\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kqsst\" (UID: \"56b6760e-4bf9-405e-a67e-ddc5d88e7a15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.853237 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.853157 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:27:55.984277 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:55.984251 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst"] Jun 11 15:27:55.986367 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:27:55.986341 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b6760e_4bf9_405e_a67e_ddc5d88e7a15.slice/crio-648fdd0b3ba28404e10e0de9786aaa32f516398f510d72c0771c6574167162ea WatchSource:0}: Error finding container 648fdd0b3ba28404e10e0de9786aaa32f516398f510d72c0771c6574167162ea: Status 404 returned error can't find the container with id 648fdd0b3ba28404e10e0de9786aaa32f516398f510d72c0771c6574167162ea Jun 11 15:27:56.253821 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:56.253786 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" event={"ID":"56b6760e-4bf9-405e-a67e-ddc5d88e7a15","Type":"ContainerStarted","Data":"648fdd0b3ba28404e10e0de9786aaa32f516398f510d72c0771c6574167162ea"} Jun 11 15:27:59.006453 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:59.006407 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:27:59.006723 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:59.006497 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:27:59.006723 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:59.006526 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:27:59.267518 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:59.267427 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" event={"ID":"56b6760e-4bf9-405e-a67e-ddc5d88e7a15","Type":"ContainerStarted","Data":"ab202571370ec4ef5bbb556990a894b7f314ad3f2837b5e4482a2eb47e76b90a"} Jun 11 15:27:59.290154 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:59.290098 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" podStartSLOduration=1.272215796 podStartE2EDuration="4.290081818s" totalImagesPullingTime="3.017866022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:27:59.28930554 +0000 UTC m=+614.500495338" watchObservedRunningTime="2026-06-11 15:27:59.290081818 +0000 UTC m=+614.501271615" Jun 11 15:27:59.853500 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:27:59.853458 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:28:00.858963 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:00.858933 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:28:01.275511 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:01.275404 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:28:01.289444 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:01.276501 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kqsst" Jun 11 15:28:02.354714 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.354679 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkd9x"] Jun 11 15:28:02.357709 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.357694 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" Jun 11 15:28:02.360915 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.360897 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 15:28:02.361667 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.361644 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-d9mm2\"" Jun 11 15:28:02.361769 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.361753 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 15:28:02.374284 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.374255 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkd9x"] Jun 11 15:28:02.422084 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.422048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzkgh\" (UniqueName: \"kubernetes.io/projected/b9c02c21-6f92-4069-b658-109a3cb47a82-kube-api-access-tzkgh\") pod \"kuadrant-operator-catalog-xkd9x\" (UID: \"b9c02c21-6f92-4069-b658-109a3cb47a82\") " pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" Jun 11 15:28:02.522797 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.522761 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzkgh\" (UniqueName: \"kubernetes.io/projected/b9c02c21-6f92-4069-b658-109a3cb47a82-kube-api-access-tzkgh\") pod \"kuadrant-operator-catalog-xkd9x\" (UID: \"b9c02c21-6f92-4069-b658-109a3cb47a82\") " pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" Jun 11 15:28:02.533268 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.533244 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzkgh\" (UniqueName: \"kubernetes.io/projected/b9c02c21-6f92-4069-b658-109a3cb47a82-kube-api-access-tzkgh\") pod \"kuadrant-operator-catalog-xkd9x\" (UID: \"b9c02c21-6f92-4069-b658-109a3cb47a82\") " pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" Jun 11 15:28:02.666664 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.666622 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" Jun 11 15:28:02.677761 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.677732 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkd9x"] Jun 11 15:28:02.805061 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.805027 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkd9x"] Jun 11 15:28:02.808012 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:28:02.807966 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c02c21_6f92_4069_b658_109a3cb47a82.slice/crio-1c489f9e16c4f2c8c7bde0dfb4ba13b799695d0c1b622358abdc0bd62c396b4b WatchSource:0}: Error finding container 1c489f9e16c4f2c8c7bde0dfb4ba13b799695d0c1b622358abdc0bd62c396b4b: Status 404 returned error can't find the container with id 1c489f9e16c4f2c8c7bde0dfb4ba13b799695d0c1b622358abdc0bd62c396b4b Jun 11 15:28:02.889568 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.889534 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xffc5"] Jun 11 15:28:02.893611 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.893595 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xffc5" Jun 11 15:28:02.901907 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:02.901885 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xffc5"] Jun 11 15:28:03.027810 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:03.027722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpc6g\" (UniqueName: \"kubernetes.io/projected/57ccef89-f423-4003-b986-44f921352de6-kube-api-access-hpc6g\") pod \"kuadrant-operator-catalog-xffc5\" (UID: \"57ccef89-f423-4003-b986-44f921352de6\") " pod="kuadrant-system/kuadrant-operator-catalog-xffc5" Jun 11 15:28:03.128208 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:03.128172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpc6g\" (UniqueName: \"kubernetes.io/projected/57ccef89-f423-4003-b986-44f921352de6-kube-api-access-hpc6g\") pod \"kuadrant-operator-catalog-xffc5\" (UID: \"57ccef89-f423-4003-b986-44f921352de6\") " pod="kuadrant-system/kuadrant-operator-catalog-xffc5" Jun 11 15:28:03.140145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:03.140117 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpc6g\" (UniqueName: \"kubernetes.io/projected/57ccef89-f423-4003-b986-44f921352de6-kube-api-access-hpc6g\") pod \"kuadrant-operator-catalog-xffc5\" (UID: \"57ccef89-f423-4003-b986-44f921352de6\") " pod="kuadrant-system/kuadrant-operator-catalog-xffc5" Jun 11 15:28:03.202812 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:03.202774 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xffc5" Jun 11 15:28:03.284700 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:03.284627 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" event={"ID":"b9c02c21-6f92-4069-b658-109a3cb47a82","Type":"ContainerStarted","Data":"1c489f9e16c4f2c8c7bde0dfb4ba13b799695d0c1b622358abdc0bd62c396b4b"} Jun 11 15:28:03.345527 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:03.345485 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xffc5"] Jun 11 15:28:03.359882 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:28:03.359850 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ccef89_f423_4003_b986_44f921352de6.slice/crio-a0630ceec9e366dc3e7a097e263d7f3e0c927411c2b7d49c865fdf47ffe51e47 WatchSource:0}: Error finding container a0630ceec9e366dc3e7a097e263d7f3e0c927411c2b7d49c865fdf47ffe51e47: Status 404 returned error can't find the container with id a0630ceec9e366dc3e7a097e263d7f3e0c927411c2b7d49c865fdf47ffe51e47 Jun 11 15:28:04.290629 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:04.290595 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xffc5" event={"ID":"57ccef89-f423-4003-b986-44f921352de6","Type":"ContainerStarted","Data":"a0630ceec9e366dc3e7a097e263d7f3e0c927411c2b7d49c865fdf47ffe51e47"} Jun 11 15:28:05.295950 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:05.295911 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" event={"ID":"b9c02c21-6f92-4069-b658-109a3cb47a82","Type":"ContainerStarted","Data":"8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8"} Jun 11 15:28:05.296428 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:05.295987 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" podUID="b9c02c21-6f92-4069-b658-109a3cb47a82" containerName="registry-server" containerID="cri-o://8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8" gracePeriod=2 Jun 11 15:28:05.297681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:05.297656 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xffc5" event={"ID":"57ccef89-f423-4003-b986-44f921352de6","Type":"ContainerStarted","Data":"513a51cce2aa54454ef99ac273cc5420bdda340748a81ebea0545a07d8efaa9d"} Jun 11 15:28:05.313055 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:05.312987 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" podStartSLOduration=1.450374705 podStartE2EDuration="3.312971967s" totalImagesPullingTime="1.862597262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:05.312209976 +0000 UTC m=+620.523399776" watchObservedRunningTime="2026-06-11 15:28:05.312971967 +0000 UTC m=+620.524161763" Jun 11 15:28:05.328516 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:05.328471 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xffc5" podStartSLOduration=2.016958448 podStartE2EDuration="3.328459748s" totalImagesPullingTime="1.3115013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:05.327894749 +0000 UTC m=+620.539084547" watchObservedRunningTime="2026-06-11 15:28:05.328459748 +0000 UTC m=+620.539649544" Jun 11 15:28:05.541588 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:05.541563 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" Jun 11 15:28:05.652206 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:05.652171 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzkgh\" (UniqueName: \"kubernetes.io/projected/b9c02c21-6f92-4069-b658-109a3cb47a82-kube-api-access-tzkgh\") pod \"b9c02c21-6f92-4069-b658-109a3cb47a82\" (UID: \"b9c02c21-6f92-4069-b658-109a3cb47a82\") " Jun 11 15:28:05.654461 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:05.654426 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c02c21-6f92-4069-b658-109a3cb47a82-kube-api-access-tzkgh" (OuterVolumeSpecName: "kube-api-access-tzkgh") pod "b9c02c21-6f92-4069-b658-109a3cb47a82" (UID: "b9c02c21-6f92-4069-b658-109a3cb47a82"). InnerVolumeSpecName "kube-api-access-tzkgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:28:05.753619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:05.753579 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzkgh\" (UniqueName: \"kubernetes.io/projected/b9c02c21-6f92-4069-b658-109a3cb47a82-kube-api-access-tzkgh\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:28:06.302711 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:06.302677 2560 generic.go:356] "Generic (PLEG): container finished" podID="b9c02c21-6f92-4069-b658-109a3cb47a82" containerID="8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8" exitCode=0 Jun 11 15:28:06.303210 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:06.302724 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" Jun 11 15:28:06.303210 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:06.302770 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" event={"ID":"b9c02c21-6f92-4069-b658-109a3cb47a82","Type":"ContainerDied","Data":"8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8"} Jun 11 15:28:06.303210 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:06.302825 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xkd9x" event={"ID":"b9c02c21-6f92-4069-b658-109a3cb47a82","Type":"ContainerDied","Data":"1c489f9e16c4f2c8c7bde0dfb4ba13b799695d0c1b622358abdc0bd62c396b4b"} Jun 11 15:28:06.303210 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:06.302857 2560 scope.go:117] "RemoveContainer" containerID="8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8" Jun 11 15:28:06.312133 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:06.312114 2560 scope.go:117] "RemoveContainer" containerID="8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8" Jun 11 15:28:06.312381 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:28:06.312364 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8\": container with ID starting with 8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8 not found: ID does not exist" containerID="8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8" Jun 11 15:28:06.312430 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:06.312390 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8"} err="failed to get container status \"8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8\": rpc error: code = NotFound desc = could not find container \"8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8\": container with ID starting with 8473fecd2fb1ea3cbc26f985fedbc7a795ae22ac56e1df73d3b005fdfa42a0d8 not found: ID does not exist" Jun 11 15:28:06.324663 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:06.324643 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkd9x"] Jun 11 15:28:06.328700 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:06.328679 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkd9x"] Jun 11 15:28:07.234754 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:07.234723 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c02c21-6f92-4069-b658-109a3cb47a82" path="/var/lib/kubelet/pods/b9c02c21-6f92-4069-b658-109a3cb47a82/volumes" Jun 11 15:28:13.203235 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:13.203205 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xffc5" Jun 11 15:28:13.203745 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:13.203280 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xffc5" Jun 11 15:28:13.226188 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:13.226164 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xffc5" Jun 11 15:28:13.354281 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:13.354254 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xffc5" Jun 11 15:28:28.678053 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.678013 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw"] Jun 11 15:28:28.678445 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.678301 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c02c21-6f92-4069-b658-109a3cb47a82" containerName="registry-server" Jun 11 15:28:28.678445 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.678313 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c02c21-6f92-4069-b658-109a3cb47a82" containerName="registry-server" Jun 11 15:28:28.678445 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.678369 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c02c21-6f92-4069-b658-109a3cb47a82" containerName="registry-server" Jun 11 15:28:28.681241 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.681225 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw" Jun 11 15:28:28.684028 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.684009 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-znsbk\"" Jun 11 15:28:28.692097 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.692075 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw"] Jun 11 15:28:28.844541 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.844502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8hfn\" (UniqueName: \"kubernetes.io/projected/b2e93fcb-61e2-4e2d-9615-809b68ff11f9-kube-api-access-v8hfn\") pod \"authorino-operator-75cc8d5cb7-r9pjw\" (UID: \"b2e93fcb-61e2-4e2d-9615-809b68ff11f9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw" Jun 11 15:28:28.944977 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.944870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8hfn\" (UniqueName: \"kubernetes.io/projected/b2e93fcb-61e2-4e2d-9615-809b68ff11f9-kube-api-access-v8hfn\") pod \"authorino-operator-75cc8d5cb7-r9pjw\" (UID: \"b2e93fcb-61e2-4e2d-9615-809b68ff11f9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw" Jun 11 15:28:28.955898 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.955870 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8hfn\" (UniqueName: \"kubernetes.io/projected/b2e93fcb-61e2-4e2d-9615-809b68ff11f9-kube-api-access-v8hfn\") pod \"authorino-operator-75cc8d5cb7-r9pjw\" (UID: \"b2e93fcb-61e2-4e2d-9615-809b68ff11f9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw" Jun 11 15:28:28.990845 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:28.990809 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw" Jun 11 15:28:29.121420 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:29.121395 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw"] Jun 11 15:28:29.123708 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:28:29.123684 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e93fcb_61e2_4e2d_9615_809b68ff11f9.slice/crio-61593e5f9e53fc22ab517e62affed08b816327e3c6f85bbe8a90f433f93ee8d6 WatchSource:0}: Error finding container 61593e5f9e53fc22ab517e62affed08b816327e3c6f85bbe8a90f433f93ee8d6: Status 404 returned error can't find the container with id 61593e5f9e53fc22ab517e62affed08b816327e3c6f85bbe8a90f433f93ee8d6 Jun 11 15:28:29.397145 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:29.397108 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw" event={"ID":"b2e93fcb-61e2-4e2d-9615-809b68ff11f9","Type":"ContainerStarted","Data":"61593e5f9e53fc22ab517e62affed08b816327e3c6f85bbe8a90f433f93ee8d6"} Jun 11 15:28:32.368887 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.368847 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b"] Jun 11 15:28:32.372074 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.372058 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b" Jun 11 15:28:32.374614 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.374578 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 15:28:32.374734 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.374627 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nqt95\"" Jun 11 15:28:32.384497 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.384474 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b"] Jun 11 15:28:32.412038 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.411977 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw" event={"ID":"b2e93fcb-61e2-4e2d-9615-809b68ff11f9","Type":"ContainerStarted","Data":"c572ab4b37a1b0a24209dd8269336af4695941162ec62a085cd17fa53aec556d"} Jun 11 15:28:32.412191 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.412075 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw" Jun 11 15:28:32.438119 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.438065 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw" podStartSLOduration=1.897978993 podStartE2EDuration="4.438050031s" totalImagesPullingTime="2.540071038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:32.436326406 +0000 UTC m=+647.647516213" watchObservedRunningTime="2026-06-11 15:28:32.438050031 +0000 UTC m=+647.649239827" Jun 11 15:28:32.476566 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.476529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch4v2\" (UniqueName: \"kubernetes.io/projected/8d56662d-d7c7-448b-af2a-205b58840348-kube-api-access-ch4v2\") pod \"dns-operator-controller-manager-864dd78c4c-bpf7b\" (UID: \"8d56662d-d7c7-448b-af2a-205b58840348\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b" Jun 11 15:28:32.577421 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.577382 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch4v2\" (UniqueName: \"kubernetes.io/projected/8d56662d-d7c7-448b-af2a-205b58840348-kube-api-access-ch4v2\") pod \"dns-operator-controller-manager-864dd78c4c-bpf7b\" (UID: \"8d56662d-d7c7-448b-af2a-205b58840348\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b" Jun 11 15:28:32.591565 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.591526 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch4v2\" (UniqueName: \"kubernetes.io/projected/8d56662d-d7c7-448b-af2a-205b58840348-kube-api-access-ch4v2\") pod \"dns-operator-controller-manager-864dd78c4c-bpf7b\" (UID: \"8d56662d-d7c7-448b-af2a-205b58840348\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b" Jun 11 15:28:32.681788 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.681687 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b" Jun 11 15:28:32.822109 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:32.822077 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b"] Jun 11 15:28:32.824894 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:28:32.824862 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d56662d_d7c7_448b_af2a_205b58840348.slice/crio-d3519a4c823694b70fbf5f83746e6abe73def06eb52ca0cf393c02f97c7ffa66 WatchSource:0}: Error finding container d3519a4c823694b70fbf5f83746e6abe73def06eb52ca0cf393c02f97c7ffa66: Status 404 returned error can't find the container with id d3519a4c823694b70fbf5f83746e6abe73def06eb52ca0cf393c02f97c7ffa66 Jun 11 15:28:33.417602 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:33.417562 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b" event={"ID":"8d56662d-d7c7-448b-af2a-205b58840348","Type":"ContainerStarted","Data":"d3519a4c823694b70fbf5f83746e6abe73def06eb52ca0cf393c02f97c7ffa66"} Jun 11 15:28:35.426681 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.426590 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b" event={"ID":"8d56662d-d7c7-448b-af2a-205b58840348","Type":"ContainerStarted","Data":"9357b6d89a42220aaebe24be850309ab4d7a3ed58ebc58ab9cd0b76dd9bb17b1"} Jun 11 15:28:35.427051 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.426728 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b" Jun 11 15:28:35.446581 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.446531 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b" podStartSLOduration=1.146035662 podStartE2EDuration="3.446514837s" totalImagesPullingTime="2.300479175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:35.445419347 +0000 UTC m=+650.656609144" watchObservedRunningTime="2026-06-11 15:28:35.446514837 +0000 UTC m=+650.657704674" Jun 11 15:28:35.610011 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.609951 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd"] Jun 11 15:28:35.613212 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.613194 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:28:35.616067 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.616044 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-shmlh\"" Jun 11 15:28:35.627386 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.627362 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd"] Jun 11 15:28:35.703448 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.703356 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6scbx\" (UniqueName: \"kubernetes.io/projected/43a096c9-b98e-4905-a0a4-477b73c925a3-kube-api-access-6scbx\") pod \"limitador-operator-controller-manager-859d7b78bd-45sjd\" (UID: \"43a096c9-b98e-4905-a0a4-477b73c925a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:28:35.804182 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.804139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6scbx\" (UniqueName: \"kubernetes.io/projected/43a096c9-b98e-4905-a0a4-477b73c925a3-kube-api-access-6scbx\") pod \"limitador-operator-controller-manager-859d7b78bd-45sjd\" (UID: \"43a096c9-b98e-4905-a0a4-477b73c925a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:28:35.814191 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.814163 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6scbx\" (UniqueName: \"kubernetes.io/projected/43a096c9-b98e-4905-a0a4-477b73c925a3-kube-api-access-6scbx\") pod \"limitador-operator-controller-manager-859d7b78bd-45sjd\" (UID: \"43a096c9-b98e-4905-a0a4-477b73c925a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:28:35.923522 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:35.923482 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:28:36.057678 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:36.057653 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd"] Jun 11 15:28:36.059878 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:28:36.059846 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a096c9_b98e_4905_a0a4_477b73c925a3.slice/crio-ce44096583408414965b6a41c358463aba9ab397a424f1bffef7c07123ec7968 WatchSource:0}: Error finding container ce44096583408414965b6a41c358463aba9ab397a424f1bffef7c07123ec7968: Status 404 returned error can't find the container with id ce44096583408414965b6a41c358463aba9ab397a424f1bffef7c07123ec7968 Jun 11 15:28:36.432736 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:36.432700 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" event={"ID":"43a096c9-b98e-4905-a0a4-477b73c925a3","Type":"ContainerStarted","Data":"ce44096583408414965b6a41c358463aba9ab397a424f1bffef7c07123ec7968"} Jun 11 15:28:38.445676 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:38.445639 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" event={"ID":"43a096c9-b98e-4905-a0a4-477b73c925a3","Type":"ContainerStarted","Data":"b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0"} Jun 11 15:28:38.446125 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:38.445704 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:28:38.469139 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:38.469088 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" podStartSLOduration=1.997724423 podStartE2EDuration="3.469073945s" totalImagesPullingTime="1.471349522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:38.468131834 +0000 UTC m=+653.679321630" watchObservedRunningTime="2026-06-11 15:28:38.469073945 +0000 UTC m=+653.680263742" Jun 11 15:28:43.419858 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:43.419827 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9pjw" Jun 11 15:28:46.435634 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:46.435602 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpf7b" Jun 11 15:28:49.452220 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:49.452188 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:28:50.905391 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:50.905355 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb"] Jun 11 15:28:50.910112 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:50.910093 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:50.912682 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:50.912658 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 15:28:50.912776 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:50.912658 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 15:28:50.912776 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:50.912700 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8xmzz\"" Jun 11 15:28:50.922969 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:50.922945 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb"] Jun 11 15:28:51.016820 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.016785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e286d93-4c87-438f-aad7-03e0f937afa2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rlhhb\" (UID: \"0e286d93-4c87-438f-aad7-03e0f937afa2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.016820 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.016826 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjlkp\" (UniqueName: \"kubernetes.io/projected/0e286d93-4c87-438f-aad7-03e0f937afa2-kube-api-access-hjlkp\") pod \"kuadrant-console-plugin-66b5774985-rlhhb\" (UID: \"0e286d93-4c87-438f-aad7-03e0f937afa2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.017097 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.016918 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e286d93-4c87-438f-aad7-03e0f937afa2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rlhhb\" (UID: \"0e286d93-4c87-438f-aad7-03e0f937afa2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.118089 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.118055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e286d93-4c87-438f-aad7-03e0f937afa2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rlhhb\" (UID: \"0e286d93-4c87-438f-aad7-03e0f937afa2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.118234 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.118103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e286d93-4c87-438f-aad7-03e0f937afa2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rlhhb\" (UID: \"0e286d93-4c87-438f-aad7-03e0f937afa2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.118234 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.118128 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjlkp\" (UniqueName: \"kubernetes.io/projected/0e286d93-4c87-438f-aad7-03e0f937afa2-kube-api-access-hjlkp\") pod \"kuadrant-console-plugin-66b5774985-rlhhb\" (UID: \"0e286d93-4c87-438f-aad7-03e0f937afa2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.118234 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:28:51.118219 2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 15:28:51.118392 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:28:51.118312 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e286d93-4c87-438f-aad7-03e0f937afa2-plugin-serving-cert podName:0e286d93-4c87-438f-aad7-03e0f937afa2 nodeName:}" failed. No retries permitted until 2026-06-11 15:28:51.618288431 +0000 UTC m=+666.829478207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/0e286d93-4c87-438f-aad7-03e0f937afa2-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-rlhhb" (UID: "0e286d93-4c87-438f-aad7-03e0f937afa2") : secret "plugin-serving-cert" not found Jun 11 15:28:51.118678 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.118656 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e286d93-4c87-438f-aad7-03e0f937afa2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rlhhb\" (UID: \"0e286d93-4c87-438f-aad7-03e0f937afa2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.128868 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.128840 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjlkp\" (UniqueName: \"kubernetes.io/projected/0e286d93-4c87-438f-aad7-03e0f937afa2-kube-api-access-hjlkp\") pod \"kuadrant-console-plugin-66b5774985-rlhhb\" (UID: \"0e286d93-4c87-438f-aad7-03e0f937afa2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.620793 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.620749 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e286d93-4c87-438f-aad7-03e0f937afa2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rlhhb\" (UID: \"0e286d93-4c87-438f-aad7-03e0f937afa2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.623370 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.623345 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e286d93-4c87-438f-aad7-03e0f937afa2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rlhhb\" (UID: \"0e286d93-4c87-438f-aad7-03e0f937afa2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.818762 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.818724 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" Jun 11 15:28:51.952091 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:51.952057 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb"] Jun 11 15:28:51.954891 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:28:51.954864 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e286d93_4c87_438f_aad7_03e0f937afa2.slice/crio-61ac37fd59129a78e4bd1a96181c7f5e73775e67da5db3bec833d6479708506c WatchSource:0}: Error finding container 61ac37fd59129a78e4bd1a96181c7f5e73775e67da5db3bec833d6479708506c: Status 404 returned error can't find the container with id 61ac37fd59129a78e4bd1a96181c7f5e73775e67da5db3bec833d6479708506c Jun 11 15:28:52.511784 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:28:52.511735 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" event={"ID":"0e286d93-4c87-438f-aad7-03e0f937afa2","Type":"ContainerStarted","Data":"61ac37fd59129a78e4bd1a96181c7f5e73775e67da5db3bec833d6479708506c"} Jun 11 15:29:00.831834 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:00.831793 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd"] Jun 11 15:29:00.832549 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:00.832046 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" containerName="manager" containerID="cri-o://b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0" gracePeriod=2 Jun 11 15:29:00.848744 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:00.848711 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd"] Jun 11 15:29:00.869664 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:00.869634 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf"] Jun 11 15:29:00.870089 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:00.870066 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" containerName="manager" Jun 11 15:29:00.870089 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:00.870092 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" containerName="manager" Jun 11 15:29:00.870268 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:00.870207 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" containerName="manager" Jun 11 15:29:00.874819 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:00.874798 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf" Jun 11 15:29:00.888347 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:00.888281 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf"] Jun 11 15:29:00.908142 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:29:00.908098 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45sjd\" is forbidden: User \"system:node:ip-10-0-131-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-203.ec2.internal' and this object" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:29:00.908464 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:00.908417 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nclbf\" (UniqueName: \"kubernetes.io/projected/5dfde31f-a4e4-4e6a-b4d2-f40bd3cdf427-kube-api-access-nclbf\") pod \"limitador-operator-controller-manager-859d7b78bd-742gf\" (UID: \"5dfde31f-a4e4-4e6a-b4d2-f40bd3cdf427\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf" Jun 11 15:29:01.009704 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:01.009658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nclbf\" (UniqueName: \"kubernetes.io/projected/5dfde31f-a4e4-4e6a-b4d2-f40bd3cdf427-kube-api-access-nclbf\") pod \"limitador-operator-controller-manager-859d7b78bd-742gf\" (UID: \"5dfde31f-a4e4-4e6a-b4d2-f40bd3cdf427\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf" Jun 11 15:29:01.019494 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:01.019462 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nclbf\" (UniqueName: \"kubernetes.io/projected/5dfde31f-a4e4-4e6a-b4d2-f40bd3cdf427-kube-api-access-nclbf\") pod \"limitador-operator-controller-manager-859d7b78bd-742gf\" (UID: \"5dfde31f-a4e4-4e6a-b4d2-f40bd3cdf427\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf" Jun 11 15:29:01.213430 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:01.213397 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf" Jun 11 15:29:12.822048 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:12.821977 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:29:12.822357 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:12.822324 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf"] Jun 11 15:29:12.824220 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:29:12.824192 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45sjd\" is forbidden: User \"system:node:ip-10-0-131-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-203.ec2.internal' and this object" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:29:12.829078 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:29:12.829052 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dfde31f_a4e4_4e6a_b4d2_f40bd3cdf427.slice/crio-8c515408b426bfafae49bb6bb78cffbbefa62dcedbb16a7d19438587eb6ce310 WatchSource:0}: Error finding container 8c515408b426bfafae49bb6bb78cffbbefa62dcedbb16a7d19438587eb6ce310: Status 404 returned error can't find the container with id 8c515408b426bfafae49bb6bb78cffbbefa62dcedbb16a7d19438587eb6ce310 Jun 11 15:29:12.918419 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:12.918389 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6scbx\" (UniqueName: \"kubernetes.io/projected/43a096c9-b98e-4905-a0a4-477b73c925a3-kube-api-access-6scbx\") pod \"43a096c9-b98e-4905-a0a4-477b73c925a3\" (UID: \"43a096c9-b98e-4905-a0a4-477b73c925a3\") " Jun 11 15:29:12.920421 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:12.920394 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a096c9-b98e-4905-a0a4-477b73c925a3-kube-api-access-6scbx" (OuterVolumeSpecName: "kube-api-access-6scbx") pod "43a096c9-b98e-4905-a0a4-477b73c925a3" (UID: "43a096c9-b98e-4905-a0a4-477b73c925a3"). InnerVolumeSpecName "kube-api-access-6scbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:29:13.019785 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.019708 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6scbx\" (UniqueName: \"kubernetes.io/projected/43a096c9-b98e-4905-a0a4-477b73c925a3-kube-api-access-6scbx\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:29:13.236327 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.236290 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" path="/var/lib/kubelet/pods/43a096c9-b98e-4905-a0a4-477b73c925a3/volumes" Jun 11 15:29:13.620524 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.620489 2560 generic.go:356] "Generic (PLEG): container finished" podID="43a096c9-b98e-4905-a0a4-477b73c925a3" containerID="b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0" exitCode=0 Jun 11 15:29:13.620719 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.620544 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:29:13.620719 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.620593 2560 scope.go:117] "RemoveContainer" containerID="b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0" Jun 11 15:29:13.624082 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:29:13.624044 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45sjd\" is forbidden: User \"system:node:ip-10-0-131-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-203.ec2.internal' and this object" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:29:13.624937 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.624898 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf" event={"ID":"5dfde31f-a4e4-4e6a-b4d2-f40bd3cdf427","Type":"ContainerStarted","Data":"928d03fe1cf3e7a51b4b8ac479be70db1036d81694a121a1bdb60250cc7bc1fc"} Jun 11 15:29:13.625075 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.625020 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf" event={"ID":"5dfde31f-a4e4-4e6a-b4d2-f40bd3cdf427","Type":"ContainerStarted","Data":"8c515408b426bfafae49bb6bb78cffbbefa62dcedbb16a7d19438587eb6ce310"} Jun 11 15:29:13.625492 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.625462 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf" Jun 11 15:29:13.626605 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:29:13.626577 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45sjd\" is forbidden: User \"system:node:ip-10-0-131-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-203.ec2.internal' and this object" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:29:13.631714 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.631686 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" event={"ID":"0e286d93-4c87-438f-aad7-03e0f937afa2","Type":"ContainerStarted","Data":"d8837d68680e9afc2d68e02dcda0e90a552c42ad2c152e0b722256c5cb877a55"} Jun 11 15:29:13.635801 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.635784 2560 scope.go:117] "RemoveContainer" containerID="b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0" Jun 11 15:29:13.636087 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:29:13.636068 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0\": container with ID starting with b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0 not found: ID does not exist" containerID="b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0" Jun 11 15:29:13.636159 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.636095 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0"} err="failed to get container status \"b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0\": rpc error: code = NotFound desc = could not find container \"b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0\": container with ID starting with b68599b673bbc88bcc49e07d707371bd83b6cf84d4f8147d94769a05c8fc6da0 not found: ID does not exist" Jun 11 15:29:13.651265 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.651228 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf" podStartSLOduration=13.651216988 podStartE2EDuration="13.651216988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:29:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:29:13.649957704 +0000 UTC m=+688.861147500" watchObservedRunningTime="2026-06-11 15:29:13.651216988 +0000 UTC m=+688.862406785" Jun 11 15:29:13.652063 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:29:13.651973 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45sjd\" is forbidden: User \"system:node:ip-10-0-131-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-203.ec2.internal' and this object" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:29:13.672028 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:13.671974 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rlhhb" podStartSLOduration=2.84773184 podStartE2EDuration="23.67196057s" totalImagesPullingTime="20.82422873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:29:13.671388177 +0000 UTC m=+688.882577972" watchObservedRunningTime="2026-06-11 15:29:13.67196057 +0000 UTC m=+688.883150366" Jun 11 15:29:13.673372 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:29:13.673349 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45sjd\" is forbidden: User \"system:node:ip-10-0-131-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-203.ec2.internal' and this object" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:29:15.233735 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:29:15.233696 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-45sjd\" is forbidden: User \"system:node:ip-10-0-131-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-203.ec2.internal' and this object" podUID="43a096c9-b98e-4905-a0a4-477b73c925a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-45sjd" Jun 11 15:29:24.639206 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:24.639170 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-742gf" Jun 11 15:29:47.774786 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:47.774752 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-cbdzl"] Jun 11 15:29:47.825398 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:47.825369 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cbdzl"] Jun 11 15:29:47.825542 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:47.825457 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cbdzl" Jun 11 15:29:47.829773 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:47.829746 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wkdgr\"" Jun 11 15:29:47.883442 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:47.883410 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlw28\" (UniqueName: \"kubernetes.io/projected/0f2809a5-98ae-456b-94fc-194fbf9daa58-kube-api-access-nlw28\") pod \"authorino-58cd955675-cbdzl\" (UID: \"0f2809a5-98ae-456b-94fc-194fbf9daa58\") " pod="kuadrant-system/authorino-58cd955675-cbdzl" Jun 11 15:29:47.984415 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:47.984373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlw28\" (UniqueName: \"kubernetes.io/projected/0f2809a5-98ae-456b-94fc-194fbf9daa58-kube-api-access-nlw28\") pod \"authorino-58cd955675-cbdzl\" (UID: \"0f2809a5-98ae-456b-94fc-194fbf9daa58\") " pod="kuadrant-system/authorino-58cd955675-cbdzl" Jun 11 15:29:47.994131 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:47.994103 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlw28\" (UniqueName: \"kubernetes.io/projected/0f2809a5-98ae-456b-94fc-194fbf9daa58-kube-api-access-nlw28\") pod \"authorino-58cd955675-cbdzl\" (UID: \"0f2809a5-98ae-456b-94fc-194fbf9daa58\") " pod="kuadrant-system/authorino-58cd955675-cbdzl" Jun 11 15:29:48.134371 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:48.134326 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cbdzl" Jun 11 15:29:48.260194 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:48.260165 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cbdzl"] Jun 11 15:29:48.262575 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:29:48.262543 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f2809a5_98ae_456b_94fc_194fbf9daa58.slice/crio-da3c6dfe69344c7ac0583c9d7fb8f2176afbae7994e4b4e060bc749dbfffe446 WatchSource:0}: Error finding container da3c6dfe69344c7ac0583c9d7fb8f2176afbae7994e4b4e060bc749dbfffe446: Status 404 returned error can't find the container with id da3c6dfe69344c7ac0583c9d7fb8f2176afbae7994e4b4e060bc749dbfffe446 Jun 11 15:29:48.776790 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:48.776755 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cbdzl" event={"ID":"0f2809a5-98ae-456b-94fc-194fbf9daa58","Type":"ContainerStarted","Data":"da3c6dfe69344c7ac0583c9d7fb8f2176afbae7994e4b4e060bc749dbfffe446"} Jun 11 15:29:51.794492 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:51.794457 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cbdzl" event={"ID":"0f2809a5-98ae-456b-94fc-194fbf9daa58","Type":"ContainerStarted","Data":"bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab"} Jun 11 15:29:51.811311 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:51.811265 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-cbdzl" podStartSLOduration=1.792886325 podStartE2EDuration="4.811250238s" totalImagesPullingTime="3.018363913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:29:51.810123268 +0000 UTC m=+727.021313066" watchObservedRunningTime="2026-06-11 15:29:51.811250238 +0000 UTC m=+727.022440035" Jun 11 15:29:52.442525 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:52.442494 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cbdzl"] Jun 11 15:29:53.803244 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:53.803207 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-cbdzl" podUID="0f2809a5-98ae-456b-94fc-194fbf9daa58" containerName="authorino" containerID="cri-o://bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab" gracePeriod=30 Jun 11 15:29:54.041960 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.041934 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cbdzl" Jun 11 15:29:54.130173 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.130151 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlw28\" (UniqueName: \"kubernetes.io/projected/0f2809a5-98ae-456b-94fc-194fbf9daa58-kube-api-access-nlw28\") pod \"0f2809a5-98ae-456b-94fc-194fbf9daa58\" (UID: \"0f2809a5-98ae-456b-94fc-194fbf9daa58\") " Jun 11 15:29:54.132277 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.132245 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f2809a5-98ae-456b-94fc-194fbf9daa58-kube-api-access-nlw28" (OuterVolumeSpecName: "kube-api-access-nlw28") pod "0f2809a5-98ae-456b-94fc-194fbf9daa58" (UID: "0f2809a5-98ae-456b-94fc-194fbf9daa58"). InnerVolumeSpecName "kube-api-access-nlw28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:29:54.231482 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.231451 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlw28\" (UniqueName: \"kubernetes.io/projected/0f2809a5-98ae-456b-94fc-194fbf9daa58-kube-api-access-nlw28\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:29:54.808917 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.808881 2560 generic.go:356] "Generic (PLEG): container finished" podID="0f2809a5-98ae-456b-94fc-194fbf9daa58" containerID="bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab" exitCode=0 Jun 11 15:29:54.809369 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.808922 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cbdzl" Jun 11 15:29:54.809369 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.808967 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cbdzl" event={"ID":"0f2809a5-98ae-456b-94fc-194fbf9daa58","Type":"ContainerDied","Data":"bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab"} Jun 11 15:29:54.809369 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.809029 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cbdzl" event={"ID":"0f2809a5-98ae-456b-94fc-194fbf9daa58","Type":"ContainerDied","Data":"da3c6dfe69344c7ac0583c9d7fb8f2176afbae7994e4b4e060bc749dbfffe446"} Jun 11 15:29:54.809369 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.809048 2560 scope.go:117] "RemoveContainer" containerID="bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab" Jun 11 15:29:54.817360 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.817340 2560 scope.go:117] "RemoveContainer" containerID="bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab" Jun 11 15:29:54.817615 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:29:54.817597 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab\": container with ID starting with bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab not found: ID does not exist" containerID="bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab" Jun 11 15:29:54.817680 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.817623 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab"} err="failed to get container status \"bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab\": rpc error: code = NotFound desc = could not find container \"bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab\": container with ID starting with bd750e4912afb182d78c6fd952b1afc7b3211c3a75a0bf0e3c3093959f32d6ab not found: ID does not exist" Jun 11 15:29:54.831396 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.831374 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cbdzl"] Jun 11 15:29:54.836154 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:54.836133 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-cbdzl"] Jun 11 15:29:55.240489 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:29:55.240457 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f2809a5-98ae-456b-94fc-194fbf9daa58" path="/var/lib/kubelet/pods/0f2809a5-98ae-456b-94fc-194fbf9daa58/volumes" Jun 11 15:30:45.758137 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.758104 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:30:45.758509 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.758384 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f2809a5-98ae-456b-94fc-194fbf9daa58" containerName="authorino" Jun 11 15:30:45.758509 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.758394 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f2809a5-98ae-456b-94fc-194fbf9daa58" containerName="authorino" Jun 11 15:30:45.758509 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.758458 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f2809a5-98ae-456b-94fc-194fbf9daa58" containerName="authorino" Jun 11 15:30:45.761948 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.761929 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:45.764589 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.764559 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 15:30:45.764711 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.764615 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 15:30:45.764711 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.764658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hfmx\" (UniqueName: \"kubernetes.io/projected/f7509066-6c8d-482f-992d-20020a41bcd9-kube-api-access-7hfmx\") pod \"maas-keycloak-0\" (UID: \"f7509066-6c8d-482f-992d-20020a41bcd9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:45.765716 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.765695 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 15:30:45.765820 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.765719 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-ngxb6\"" Jun 11 15:30:45.772384 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.772363 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:30:45.865066 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.865035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hfmx\" (UniqueName: \"kubernetes.io/projected/f7509066-6c8d-482f-992d-20020a41bcd9-kube-api-access-7hfmx\") pod \"maas-keycloak-0\" (UID: \"f7509066-6c8d-482f-992d-20020a41bcd9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:45.874698 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:45.874672 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hfmx\" (UniqueName: \"kubernetes.io/projected/f7509066-6c8d-482f-992d-20020a41bcd9-kube-api-access-7hfmx\") pod \"maas-keycloak-0\" (UID: \"f7509066-6c8d-482f-992d-20020a41bcd9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:46.071672 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:46.071580 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:46.199183 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:46.199155 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:30:46.201803 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:30:46.201767 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7509066_6c8d_482f_992d_20020a41bcd9.slice/crio-f38f1758f0e89ef90ed7a0b573da8b739957d4a439f2e5fd363148c91c5d338c WatchSource:0}: Error finding container f38f1758f0e89ef90ed7a0b573da8b739957d4a439f2e5fd363148c91c5d338c: Status 404 returned error can't find the container with id f38f1758f0e89ef90ed7a0b573da8b739957d4a439f2e5fd363148c91c5d338c Jun 11 15:30:47.030723 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:47.030652 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f7509066-6c8d-482f-992d-20020a41bcd9","Type":"ContainerStarted","Data":"f38f1758f0e89ef90ed7a0b573da8b739957d4a439f2e5fd363148c91c5d338c"} Jun 11 15:30:51.053964 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:51.053922 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f7509066-6c8d-482f-992d-20020a41bcd9","Type":"ContainerStarted","Data":"7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4"} Jun 11 15:30:51.072067 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:51.072030 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:51.073444 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:51.073396 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:30:51.073614 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:51.073574 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.681990834 podStartE2EDuration="6.073556217s" totalImagesPullingTime="4.391565383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:30:51.071761696 +0000 UTC m=+786.282951493" watchObservedRunningTime="2026-06-11 15:30:51.073556217 +0000 UTC m=+786.284746014" Jun 11 15:30:52.072898 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:52.072805 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:30:53.072408 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:53.072372 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:30:54.072341 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:54.072292 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:30:55.076117 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:55.073887 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:30:56.072760 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:56.072060 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:30:56.073786 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:56.073396 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:30:57.072983 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:57.072927 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:30:58.072461 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:58.072416 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:30:59.072532 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:30:59.072486 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:31:00.072441 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:00.072390 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:31:01.072426 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:01.072379 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:31:02.072215 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:02.072166 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:31:03.072411 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:03.072356 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 11 15:31:04.161934 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:04.161896 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 15:31:04.175010 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:04.174953 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:31:14.170269 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:14.170223 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:31:20.503614 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.503578 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b54fdfbfc-pn2t7"] Jun 11 15:31:20.511304 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.511281 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:20.514206 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.514181 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 15:31:20.515369 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.515347 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2ps4h\"" Jun 11 15:31:20.515586 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.515557 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 15:31:20.517081 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.517059 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b54fdfbfc-pn2t7"] Jun 11 15:31:20.670705 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.670669 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6tdr\" (UniqueName: \"kubernetes.io/projected/5694a33a-6b61-4551-9a1b-287891bb0e96-kube-api-access-g6tdr\") pod \"maas-controller-b54fdfbfc-pn2t7\" (UID: \"5694a33a-6b61-4551-9a1b-287891bb0e96\") " pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:20.670705 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.670709 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5694a33a-6b61-4551-9a1b-287891bb0e96-webhook-cert\") pod \"maas-controller-b54fdfbfc-pn2t7\" (UID: \"5694a33a-6b61-4551-9a1b-287891bb0e96\") " pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:20.688733 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.688705 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c6f77956-7lhvm"] Jun 11 15:31:20.690860 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.690841 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:20.703609 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.703586 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c6f77956-7lhvm"] Jun 11 15:31:20.771412 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.771323 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522cc59d-a122-48fe-8935-8cc28ffe9c16-webhook-cert\") pod \"maas-controller-5c6f77956-7lhvm\" (UID: \"522cc59d-a122-48fe-8935-8cc28ffe9c16\") " pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:20.771412 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.771393 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gtkd\" (UniqueName: \"kubernetes.io/projected/522cc59d-a122-48fe-8935-8cc28ffe9c16-kube-api-access-2gtkd\") pod \"maas-controller-5c6f77956-7lhvm\" (UID: \"522cc59d-a122-48fe-8935-8cc28ffe9c16\") " pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:20.771599 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.771491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6tdr\" (UniqueName: \"kubernetes.io/projected/5694a33a-6b61-4551-9a1b-287891bb0e96-kube-api-access-g6tdr\") pod \"maas-controller-b54fdfbfc-pn2t7\" (UID: \"5694a33a-6b61-4551-9a1b-287891bb0e96\") " pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:20.771599 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.771526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5694a33a-6b61-4551-9a1b-287891bb0e96-webhook-cert\") pod \"maas-controller-b54fdfbfc-pn2t7\" (UID: \"5694a33a-6b61-4551-9a1b-287891bb0e96\") " pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:20.771664 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:31:20.771646 2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 15:31:20.771717 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:31:20.771708 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5694a33a-6b61-4551-9a1b-287891bb0e96-webhook-cert podName:5694a33a-6b61-4551-9a1b-287891bb0e96 nodeName:}" failed. No retries permitted until 2026-06-11 15:31:21.271691335 +0000 UTC m=+816.482881109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5694a33a-6b61-4551-9a1b-287891bb0e96-webhook-cert") pod "maas-controller-b54fdfbfc-pn2t7" (UID: "5694a33a-6b61-4551-9a1b-287891bb0e96") : secret "maas-controller-webhook-cert" not found Jun 11 15:31:20.783925 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.783901 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6tdr\" (UniqueName: \"kubernetes.io/projected/5694a33a-6b61-4551-9a1b-287891bb0e96-kube-api-access-g6tdr\") pod \"maas-controller-b54fdfbfc-pn2t7\" (UID: \"5694a33a-6b61-4551-9a1b-287891bb0e96\") " pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:20.872878 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.872838 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gtkd\" (UniqueName: \"kubernetes.io/projected/522cc59d-a122-48fe-8935-8cc28ffe9c16-kube-api-access-2gtkd\") pod \"maas-controller-5c6f77956-7lhvm\" (UID: \"522cc59d-a122-48fe-8935-8cc28ffe9c16\") " pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:20.873064 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.872912 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522cc59d-a122-48fe-8935-8cc28ffe9c16-webhook-cert\") pod \"maas-controller-5c6f77956-7lhvm\" (UID: \"522cc59d-a122-48fe-8935-8cc28ffe9c16\") " pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:20.873064 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:31:20.873033 2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 15:31:20.873143 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:31:20.873084 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522cc59d-a122-48fe-8935-8cc28ffe9c16-webhook-cert podName:522cc59d-a122-48fe-8935-8cc28ffe9c16 nodeName:}" failed. No retries permitted until 2026-06-11 15:31:21.37306995 +0000 UTC m=+816.584259725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/522cc59d-a122-48fe-8935-8cc28ffe9c16-webhook-cert") pod "maas-controller-5c6f77956-7lhvm" (UID: "522cc59d-a122-48fe-8935-8cc28ffe9c16") : secret "maas-controller-webhook-cert" not found Jun 11 15:31:20.885863 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:20.885834 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gtkd\" (UniqueName: \"kubernetes.io/projected/522cc59d-a122-48fe-8935-8cc28ffe9c16-kube-api-access-2gtkd\") pod \"maas-controller-5c6f77956-7lhvm\" (UID: \"522cc59d-a122-48fe-8935-8cc28ffe9c16\") " pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:21.277121 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:21.277078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5694a33a-6b61-4551-9a1b-287891bb0e96-webhook-cert\") pod \"maas-controller-b54fdfbfc-pn2t7\" (UID: \"5694a33a-6b61-4551-9a1b-287891bb0e96\") " pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:21.279617 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:21.279591 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5694a33a-6b61-4551-9a1b-287891bb0e96-webhook-cert\") pod \"maas-controller-b54fdfbfc-pn2t7\" (UID: \"5694a33a-6b61-4551-9a1b-287891bb0e96\") " pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:21.378574 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:21.378537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522cc59d-a122-48fe-8935-8cc28ffe9c16-webhook-cert\") pod \"maas-controller-5c6f77956-7lhvm\" (UID: \"522cc59d-a122-48fe-8935-8cc28ffe9c16\") " pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:21.381074 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:21.381052 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522cc59d-a122-48fe-8935-8cc28ffe9c16-webhook-cert\") pod \"maas-controller-5c6f77956-7lhvm\" (UID: \"522cc59d-a122-48fe-8935-8cc28ffe9c16\") " pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:21.422762 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:21.422727 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:21.553855 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:21.553831 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b54fdfbfc-pn2t7"] Jun 11 15:31:21.555835 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:31:21.555798 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5694a33a_6b61_4551_9a1b_287891bb0e96.slice/crio-e74a1f6c79cf264db336fdbc3b6302bd03582117b76a282cba70773a3257b3cb WatchSource:0}: Error finding container e74a1f6c79cf264db336fdbc3b6302bd03582117b76a282cba70773a3257b3cb: Status 404 returned error can't find the container with id e74a1f6c79cf264db336fdbc3b6302bd03582117b76a282cba70773a3257b3cb Jun 11 15:31:21.557130 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:21.557115 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:31:21.600111 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:21.600090 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:21.726678 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:21.726654 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c6f77956-7lhvm"] Jun 11 15:31:21.728884 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:31:21.728859 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522cc59d_a122_48fe_8935_8cc28ffe9c16.slice/crio-e092ea3545ead371875c33bc98d9cf3179e187234e835202324a231c29d41ddd WatchSource:0}: Error finding container e092ea3545ead371875c33bc98d9cf3179e187234e835202324a231c29d41ddd: Status 404 returned error can't find the container with id e092ea3545ead371875c33bc98d9cf3179e187234e835202324a231c29d41ddd Jun 11 15:31:22.214316 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:22.214235 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" event={"ID":"5694a33a-6b61-4551-9a1b-287891bb0e96","Type":"ContainerStarted","Data":"e74a1f6c79cf264db336fdbc3b6302bd03582117b76a282cba70773a3257b3cb"} Jun 11 15:31:22.215912 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:22.215879 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6f77956-7lhvm" event={"ID":"522cc59d-a122-48fe-8935-8cc28ffe9c16","Type":"ContainerStarted","Data":"e092ea3545ead371875c33bc98d9cf3179e187234e835202324a231c29d41ddd"} Jun 11 15:31:24.230843 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:24.230730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6f77956-7lhvm" event={"ID":"522cc59d-a122-48fe-8935-8cc28ffe9c16","Type":"ContainerStarted","Data":"34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009"} Jun 11 15:31:24.230843 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:24.230807 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:24.232916 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:24.232889 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" event={"ID":"5694a33a-6b61-4551-9a1b-287891bb0e96","Type":"ContainerStarted","Data":"30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c"} Jun 11 15:31:24.233057 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:24.232944 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:24.253601 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:24.253544 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c6f77956-7lhvm" podStartSLOduration=1.8795498510000002 podStartE2EDuration="4.253524953s" totalImagesPullingTime="2.373975102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:24.25329606 +0000 UTC m=+819.464485870" watchObservedRunningTime="2026-06-11 15:31:24.253524953 +0000 UTC m=+819.464714752" Jun 11 15:31:24.283537 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:24.283490 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" podStartSLOduration=1.746875723 podStartE2EDuration="4.28347652s" totalImagesPullingTime="2.536600797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:24.281823344 +0000 UTC m=+819.493013146" watchObservedRunningTime="2026-06-11 15:31:24.28347652 +0000 UTC m=+819.494666316" Jun 11 15:31:35.247655 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.247618 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:35.248126 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.248070 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:31:35.318737 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.318705 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b54fdfbfc-pn2t7"] Jun 11 15:31:35.318933 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.318907 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" podUID="5694a33a-6b61-4551-9a1b-287891bb0e96" containerName="manager" containerID="cri-o://30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c" gracePeriod=30 Jun 11 15:31:35.566234 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.566213 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:35.696217 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.696186 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6tdr\" (UniqueName: \"kubernetes.io/projected/5694a33a-6b61-4551-9a1b-287891bb0e96-kube-api-access-g6tdr\") pod \"5694a33a-6b61-4551-9a1b-287891bb0e96\" (UID: \"5694a33a-6b61-4551-9a1b-287891bb0e96\") " Jun 11 15:31:35.696381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.696254 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5694a33a-6b61-4551-9a1b-287891bb0e96-webhook-cert\") pod \"5694a33a-6b61-4551-9a1b-287891bb0e96\" (UID: \"5694a33a-6b61-4551-9a1b-287891bb0e96\") " Jun 11 15:31:35.698538 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.698504 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5694a33a-6b61-4551-9a1b-287891bb0e96-kube-api-access-g6tdr" (OuterVolumeSpecName: "kube-api-access-g6tdr") pod "5694a33a-6b61-4551-9a1b-287891bb0e96" (UID: "5694a33a-6b61-4551-9a1b-287891bb0e96"). InnerVolumeSpecName "kube-api-access-g6tdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:31:35.698639 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.698536 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5694a33a-6b61-4551-9a1b-287891bb0e96-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5694a33a-6b61-4551-9a1b-287891bb0e96" (UID: "5694a33a-6b61-4551-9a1b-287891bb0e96"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:31:35.797661 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.797588 2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5694a33a-6b61-4551-9a1b-287891bb0e96-webhook-cert\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:31:35.797661 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:35.797623 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6tdr\" (UniqueName: \"kubernetes.io/projected/5694a33a-6b61-4551-9a1b-287891bb0e96-kube-api-access-g6tdr\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:31:36.294525 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:36.294485 2560 generic.go:356] "Generic (PLEG): container finished" podID="5694a33a-6b61-4551-9a1b-287891bb0e96" containerID="30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c" exitCode=0 Jun 11 15:31:36.294933 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:36.294535 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" Jun 11 15:31:36.294933 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:36.294571 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" event={"ID":"5694a33a-6b61-4551-9a1b-287891bb0e96","Type":"ContainerDied","Data":"30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c"} Jun 11 15:31:36.294933 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:36.294621 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b54fdfbfc-pn2t7" event={"ID":"5694a33a-6b61-4551-9a1b-287891bb0e96","Type":"ContainerDied","Data":"e74a1f6c79cf264db336fdbc3b6302bd03582117b76a282cba70773a3257b3cb"} Jun 11 15:31:36.294933 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:36.294642 2560 scope.go:117] "RemoveContainer" containerID="30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c" Jun 11 15:31:36.303559 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:36.303542 2560 scope.go:117] "RemoveContainer" containerID="30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c" Jun 11 15:31:36.303810 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:31:36.303791 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c\": container with ID starting with 30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c not found: ID does not exist" containerID="30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c" Jun 11 15:31:36.303855 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:36.303820 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c"} err="failed to get container status \"30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c\": rpc error: code = NotFound desc = could not find container \"30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c\": container with ID starting with 30512cc7ac3a5eb39ffa390e249e031271e607d55294766a554609f9dfb1f04c not found: ID does not exist" Jun 11 15:31:36.317509 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:36.317488 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b54fdfbfc-pn2t7"] Jun 11 15:31:36.323827 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:36.323802 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b54fdfbfc-pn2t7"] Jun 11 15:31:37.234857 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:37.234822 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5694a33a-6b61-4551-9a1b-287891bb0e96" path="/var/lib/kubelet/pods/5694a33a-6b61-4551-9a1b-287891bb0e96/volumes" Jun 11 15:31:55.458754 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.458723 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-765b8cfdc5-7jwkk"] Jun 11 15:31:55.459207 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.459074 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5694a33a-6b61-4551-9a1b-287891bb0e96" containerName="manager" Jun 11 15:31:55.459207 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.459093 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5694a33a-6b61-4551-9a1b-287891bb0e96" containerName="manager" Jun 11 15:31:55.459207 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.459150 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5694a33a-6b61-4551-9a1b-287891bb0e96" containerName="manager" Jun 11 15:31:55.461805 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.461791 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.464248 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.464225 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-splzw\"" Jun 11 15:31:55.465156 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.465136 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 15:31:55.472579 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.472548 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-765b8cfdc5-7jwkk"] Jun 11 15:31:55.543894 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.543864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3778c1df-64ca-4546-bc6e-5d905f09b9ce-maas-api-tls\") pod \"maas-api-765b8cfdc5-7jwkk\" (UID: \"3778c1df-64ca-4546-bc6e-5d905f09b9ce\") " pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.544078 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.543913 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3778c1df-64ca-4546-bc6e-5d905f09b9ce-openshift-service-ca\") pod \"maas-api-765b8cfdc5-7jwkk\" (UID: \"3778c1df-64ca-4546-bc6e-5d905f09b9ce\") " pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.544078 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.544036 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llctx\" (UniqueName: \"kubernetes.io/projected/3778c1df-64ca-4546-bc6e-5d905f09b9ce-kube-api-access-llctx\") pod \"maas-api-765b8cfdc5-7jwkk\" (UID: \"3778c1df-64ca-4546-bc6e-5d905f09b9ce\") " pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.644764 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.644723 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3778c1df-64ca-4546-bc6e-5d905f09b9ce-maas-api-tls\") pod \"maas-api-765b8cfdc5-7jwkk\" (UID: \"3778c1df-64ca-4546-bc6e-5d905f09b9ce\") " pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.644764 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.644769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3778c1df-64ca-4546-bc6e-5d905f09b9ce-openshift-service-ca\") pod \"maas-api-765b8cfdc5-7jwkk\" (UID: \"3778c1df-64ca-4546-bc6e-5d905f09b9ce\") " pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.645020 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.644825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llctx\" (UniqueName: \"kubernetes.io/projected/3778c1df-64ca-4546-bc6e-5d905f09b9ce-kube-api-access-llctx\") pod \"maas-api-765b8cfdc5-7jwkk\" (UID: \"3778c1df-64ca-4546-bc6e-5d905f09b9ce\") " pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.645529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.645509 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3778c1df-64ca-4546-bc6e-5d905f09b9ce-openshift-service-ca\") pod \"maas-api-765b8cfdc5-7jwkk\" (UID: \"3778c1df-64ca-4546-bc6e-5d905f09b9ce\") " pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.647382 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.647357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3778c1df-64ca-4546-bc6e-5d905f09b9ce-maas-api-tls\") pod \"maas-api-765b8cfdc5-7jwkk\" (UID: \"3778c1df-64ca-4546-bc6e-5d905f09b9ce\") " pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.654440 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.654415 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llctx\" (UniqueName: \"kubernetes.io/projected/3778c1df-64ca-4546-bc6e-5d905f09b9ce-kube-api-access-llctx\") pod \"maas-api-765b8cfdc5-7jwkk\" (UID: \"3778c1df-64ca-4546-bc6e-5d905f09b9ce\") " pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.771658 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.771596 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:55.909389 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:55.909365 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-765b8cfdc5-7jwkk"] Jun 11 15:31:55.911784 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:31:55.911751 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3778c1df_64ca_4546_bc6e_5d905f09b9ce.slice/crio-bb69dac9956bd2690e152e5821d8ded278ed5c3a1828ba3d230a7331a3536392 WatchSource:0}: Error finding container bb69dac9956bd2690e152e5821d8ded278ed5c3a1828ba3d230a7331a3536392: Status 404 returned error can't find the container with id bb69dac9956bd2690e152e5821d8ded278ed5c3a1828ba3d230a7331a3536392 Jun 11 15:31:56.013821 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.013790 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-798lh"] Jun 11 15:31:56.018156 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.018140 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-798lh" Jun 11 15:31:56.021017 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.020975 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 15:31:56.021135 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.021038 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xf9mk\"" Jun 11 15:31:56.027261 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.027231 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-798lh"] Jun 11 15:31:56.048152 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.048130 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjjgz\" (UniqueName: \"kubernetes.io/projected/a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2-kube-api-access-sjjgz\") pod \"payload-processing-699b6cd6c-798lh\" (UID: \"a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2\") " pod="openshift-ingress/payload-processing-699b6cd6c-798lh" Jun 11 15:31:56.055464 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.055443 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-64gt5"] Jun 11 15:31:56.058578 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.058564 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-64gt5" Jun 11 15:31:56.069022 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.068978 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-64gt5"] Jun 11 15:31:56.148842 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.148808 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjjgz\" (UniqueName: \"kubernetes.io/projected/a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2-kube-api-access-sjjgz\") pod \"payload-processing-699b6cd6c-798lh\" (UID: \"a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2\") " pod="openshift-ingress/payload-processing-699b6cd6c-798lh" Jun 11 15:31:56.149028 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.148886 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjzsw\" (UniqueName: \"kubernetes.io/projected/4d5e2d27-7cf1-4755-9d41-f155106be6db-kube-api-access-qjzsw\") pod \"payload-pre-processing-579785bc64-64gt5\" (UID: \"4d5e2d27-7cf1-4755-9d41-f155106be6db\") " pod="openshift-ingress/payload-pre-processing-579785bc64-64gt5" Jun 11 15:31:56.158275 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.158248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjjgz\" (UniqueName: \"kubernetes.io/projected/a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2-kube-api-access-sjjgz\") pod \"payload-processing-699b6cd6c-798lh\" (UID: \"a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2\") " pod="openshift-ingress/payload-processing-699b6cd6c-798lh" Jun 11 15:31:56.249502 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.249463 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjzsw\" (UniqueName: \"kubernetes.io/projected/4d5e2d27-7cf1-4755-9d41-f155106be6db-kube-api-access-qjzsw\") pod \"payload-pre-processing-579785bc64-64gt5\" (UID: \"4d5e2d27-7cf1-4755-9d41-f155106be6db\") " pod="openshift-ingress/payload-pre-processing-579785bc64-64gt5" Jun 11 15:31:56.258598 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.258567 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjzsw\" (UniqueName: \"kubernetes.io/projected/4d5e2d27-7cf1-4755-9d41-f155106be6db-kube-api-access-qjzsw\") pod \"payload-pre-processing-579785bc64-64gt5\" (UID: \"4d5e2d27-7cf1-4755-9d41-f155106be6db\") " pod="openshift-ingress/payload-pre-processing-579785bc64-64gt5" Jun 11 15:31:56.329097 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.329020 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-798lh" Jun 11 15:31:56.368424 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.368117 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-64gt5" Jun 11 15:31:56.384600 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.384529 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-765b8cfdc5-7jwkk" event={"ID":"3778c1df-64ca-4546-bc6e-5d905f09b9ce","Type":"ContainerStarted","Data":"bb69dac9956bd2690e152e5821d8ded278ed5c3a1828ba3d230a7331a3536392"} Jun 11 15:31:56.473506 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.473469 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-798lh"] Jun 11 15:31:56.475294 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:31:56.475269 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c49e4b_c6e4_4133_a8c8_e4eeae913cd2.slice/crio-fc4fef5ae55eb62ace6310321cc3430840cb4c46867d6a3a0eb8ecf2c4dbf04b WatchSource:0}: Error finding container fc4fef5ae55eb62ace6310321cc3430840cb4c46867d6a3a0eb8ecf2c4dbf04b: Status 404 returned error can't find the container with id fc4fef5ae55eb62ace6310321cc3430840cb4c46867d6a3a0eb8ecf2c4dbf04b Jun 11 15:31:56.519741 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:56.519719 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-64gt5"] Jun 11 15:31:56.522027 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:31:56.521981 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5e2d27_7cf1_4755_9d41_f155106be6db.slice/crio-2d7f78e7cc872f59f6307bfffcb12e20e6d509b30d89a48bcc5b2de3a1583502 WatchSource:0}: Error finding container 2d7f78e7cc872f59f6307bfffcb12e20e6d509b30d89a48bcc5b2de3a1583502: Status 404 returned error can't find the container with id 2d7f78e7cc872f59f6307bfffcb12e20e6d509b30d89a48bcc5b2de3a1583502 Jun 11 15:31:57.395673 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:57.395630 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-64gt5" event={"ID":"4d5e2d27-7cf1-4755-9d41-f155106be6db","Type":"ContainerStarted","Data":"2d7f78e7cc872f59f6307bfffcb12e20e6d509b30d89a48bcc5b2de3a1583502"} Jun 11 15:31:57.399766 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:57.399730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-798lh" event={"ID":"a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2","Type":"ContainerStarted","Data":"fc4fef5ae55eb62ace6310321cc3430840cb4c46867d6a3a0eb8ecf2c4dbf04b"} Jun 11 15:31:59.412446 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:59.412403 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-798lh" event={"ID":"a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2","Type":"ContainerStarted","Data":"5b9952f89566f362f58b2f9329d9a81c7ec47655f994a1d428cd16f80b0948df"} Jun 11 15:31:59.412930 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:59.412499 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-798lh" Jun 11 15:31:59.414238 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:59.414213 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-765b8cfdc5-7jwkk" event={"ID":"3778c1df-64ca-4546-bc6e-5d905f09b9ce","Type":"ContainerStarted","Data":"51ffa65fdf50212cc92fbb30bc2b814aa8fd01c264a38f0e3ca7d0a2b42a1d8b"} Jun 11 15:31:59.414359 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:59.414264 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:31:59.415885 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:59.415864 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-64gt5" event={"ID":"4d5e2d27-7cf1-4755-9d41-f155106be6db","Type":"ContainerStarted","Data":"4aaf272c30f02552ed41414457ed8428686aa18a8dc2a225be1f21c1b39fe8f0"} Jun 11 15:31:59.416029 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:59.416015 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-64gt5" Jun 11 15:31:59.433141 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:59.433093 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-798lh" podStartSLOduration=1.791993712 podStartE2EDuration="4.433074589s" totalImagesPullingTime="2.641080877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:59.432722104 +0000 UTC m=+854.643911902" watchObservedRunningTime="2026-06-11 15:31:59.433074589 +0000 UTC m=+854.644264386" Jun 11 15:31:59.451858 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:59.451809 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-765b8cfdc5-7jwkk" podStartSLOduration=1.27850988 podStartE2EDuration="4.451796958s" totalImagesPullingTime="3.173287078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:59.451067329 +0000 UTC m=+854.662257125" watchObservedRunningTime="2026-06-11 15:31:59.451796958 +0000 UTC m=+854.662986754" Jun 11 15:31:59.468854 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:31:59.468815 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-64gt5" podStartSLOduration=0.879759059 podStartE2EDuration="3.468800872s" totalImagesPullingTime="2.589041813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:59.467954385 +0000 UTC m=+854.679144195" watchObservedRunningTime="2026-06-11 15:31:59.468800872 +0000 UTC m=+854.679990670" Jun 11 15:32:05.426516 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:32:05.426478 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-765b8cfdc5-7jwkk" Jun 11 15:32:10.423330 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:32:10.423296 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-64gt5" Jun 11 15:32:10.423773 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:32:10.423368 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-798lh" Jun 11 15:32:45.224919 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:32:45.224892 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:32:45.225445 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:32:45.224930 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:34:09.836764 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:09.836685 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:34:09.837272 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:09.836881 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" containerID="cri-o://7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4" gracePeriod=30 Jun 11 15:34:11.479125 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:11.479103 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:11.550303 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:11.550226 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hfmx\" (UniqueName: \"kubernetes.io/projected/f7509066-6c8d-482f-992d-20020a41bcd9-kube-api-access-7hfmx\") pod \"f7509066-6c8d-482f-992d-20020a41bcd9\" (UID: \"f7509066-6c8d-482f-992d-20020a41bcd9\") " Jun 11 15:34:11.552446 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:11.552420 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7509066-6c8d-482f-992d-20020a41bcd9-kube-api-access-7hfmx" (OuterVolumeSpecName: "kube-api-access-7hfmx") pod "f7509066-6c8d-482f-992d-20020a41bcd9" (UID: "f7509066-6c8d-482f-992d-20020a41bcd9"). InnerVolumeSpecName "kube-api-access-7hfmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:34:11.650872 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:11.650847 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hfmx\" (UniqueName: \"kubernetes.io/projected/f7509066-6c8d-482f-992d-20020a41bcd9-kube-api-access-7hfmx\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:34:12.003929 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.003893 2560 generic.go:356] "Generic (PLEG): container finished" podID="f7509066-6c8d-482f-992d-20020a41bcd9" containerID="7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4" exitCode=143 Jun 11 15:34:12.004097 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.003939 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f7509066-6c8d-482f-992d-20020a41bcd9","Type":"ContainerDied","Data":"7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4"} Jun 11 15:34:12.004097 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.003982 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f7509066-6c8d-482f-992d-20020a41bcd9","Type":"ContainerDied","Data":"f38f1758f0e89ef90ed7a0b573da8b739957d4a439f2e5fd363148c91c5d338c"} Jun 11 15:34:12.004097 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.003942 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:12.004211 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.004032 2560 scope.go:117] "RemoveContainer" containerID="7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4" Jun 11 15:34:12.013753 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.013736 2560 scope.go:117] "RemoveContainer" containerID="7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4" Jun 11 15:34:12.014109 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:34:12.013987 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4\": container with ID starting with 7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4 not found: ID does not exist" containerID="7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4" Jun 11 15:34:12.014212 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.014117 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4"} err="failed to get container status \"7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4\": rpc error: code = NotFound desc = could not find container \"7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4\": container with ID starting with 7018cde52a21b09bdcbeab62262cd762eef6ba38c57cc7d720a562d372c9dca4 not found: ID does not exist" Jun 11 15:34:12.028654 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.028633 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:34:12.034081 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.034062 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:34:12.065512 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.065482 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:34:12.065866 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.065849 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" Jun 11 15:34:12.065938 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.065869 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" Jun 11 15:34:12.066010 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.065946 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" containerName="keycloak" Jun 11 15:34:12.070100 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.070082 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:12.073943 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.073926 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 15:34:12.074056 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.074043 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 15:34:12.074235 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.074216 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 15:34:12.074329 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.074287 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 15:34:12.074396 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.074378 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-ngxb6\"" Jun 11 15:34:12.082487 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.082464 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:34:12.155410 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.155385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/57a5bd3b-ba14-483d-9a73-edc811ad92d1-test-realms\") pod \"maas-keycloak-0\" (UID: \"57a5bd3b-ba14-483d-9a73-edc811ad92d1\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:12.155521 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.155424 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gthlj\" (UniqueName: \"kubernetes.io/projected/57a5bd3b-ba14-483d-9a73-edc811ad92d1-kube-api-access-gthlj\") pod \"maas-keycloak-0\" (UID: \"57a5bd3b-ba14-483d-9a73-edc811ad92d1\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:12.256680 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.256612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/57a5bd3b-ba14-483d-9a73-edc811ad92d1-test-realms\") pod \"maas-keycloak-0\" (UID: \"57a5bd3b-ba14-483d-9a73-edc811ad92d1\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:12.256680 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.256652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gthlj\" (UniqueName: \"kubernetes.io/projected/57a5bd3b-ba14-483d-9a73-edc811ad92d1-kube-api-access-gthlj\") pod \"maas-keycloak-0\" (UID: \"57a5bd3b-ba14-483d-9a73-edc811ad92d1\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:12.257351 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.257332 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/57a5bd3b-ba14-483d-9a73-edc811ad92d1-test-realms\") pod \"maas-keycloak-0\" (UID: \"57a5bd3b-ba14-483d-9a73-edc811ad92d1\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:12.266114 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.266089 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gthlj\" (UniqueName: \"kubernetes.io/projected/57a5bd3b-ba14-483d-9a73-edc811ad92d1-kube-api-access-gthlj\") pod \"maas-keycloak-0\" (UID: \"57a5bd3b-ba14-483d-9a73-edc811ad92d1\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:12.379917 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.379890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:12.515674 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:12.515651 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:34:12.518082 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:34:12.518056 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a5bd3b_ba14_483d_9a73_edc811ad92d1.slice/crio-55db43bb0c93d37acc7f6501293e721a60310dc8a1ccf3cd09bdfb2b5d07d47f WatchSource:0}: Error finding container 55db43bb0c93d37acc7f6501293e721a60310dc8a1ccf3cd09bdfb2b5d07d47f: Status 404 returned error can't find the container with id 55db43bb0c93d37acc7f6501293e721a60310dc8a1ccf3cd09bdfb2b5d07d47f Jun 11 15:34:13.010367 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:13.010335 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"57a5bd3b-ba14-483d-9a73-edc811ad92d1","Type":"ContainerStarted","Data":"6b0498f92b7697bf2755b1a374619c1d5eb012ba1eb9711f641f764fb9873dcd"} Jun 11 15:34:13.010529 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:13.010392 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"57a5bd3b-ba14-483d-9a73-edc811ad92d1","Type":"ContainerStarted","Data":"55db43bb0c93d37acc7f6501293e721a60310dc8a1ccf3cd09bdfb2b5d07d47f"} Jun 11 15:34:13.035793 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:13.035741 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.676800798 podStartE2EDuration="1.035727029s" totalImagesPullingTime="358.926231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:34:13.034425118 +0000 UTC m=+988.245614916" watchObservedRunningTime="2026-06-11 15:34:13.035727029 +0000 UTC m=+988.246916853" Jun 11 15:34:13.238272 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:13.238197 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7509066-6c8d-482f-992d-20020a41bcd9" path="/var/lib/kubelet/pods/f7509066-6c8d-482f-992d-20020a41bcd9/volumes" Jun 11 15:34:13.380221 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:13.380189 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:13.381505 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:13.381470 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:14.380411 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:14.380359 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:15.381227 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:15.381175 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:16.381460 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:16.381415 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:17.381230 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:17.381175 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:18.380511 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:18.380461 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:19.380888 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:19.380844 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:20.380930 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:20.380879 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:21.380849 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:21.380803 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:22.380711 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:22.380661 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:22.381252 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:22.380979 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:23.381504 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:23.381454 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:24.381093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:24.381049 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:25.380535 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:25.380486 2560 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:34:26.502736 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:26.502699 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 15:34:26.520525 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:26.520466 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="57a5bd3b-ba14-483d-9a73-edc811ad92d1" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:34:36.508386 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:34:36.508349 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:35:00.251012 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.250966 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh"] Jun 11 15:35:00.254435 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.254415 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.257162 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.257138 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 15:35:00.257296 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.257279 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d7ns9\"" Jun 11 15:35:00.258261 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.258239 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 15:35:00.258445 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.258309 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 15:35:00.270260 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.270235 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh"] Jun 11 15:35:00.371777 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.371737 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.371945 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.371791 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.371945 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.371816 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0dad01f-70d8-4cb7-a37f-899efdc0f158-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.371945 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.371858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kn68\" (UniqueName: \"kubernetes.io/projected/b0dad01f-70d8-4cb7-a37f-899efdc0f158-kube-api-access-6kn68\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.371945 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.371882 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.372131 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.371958 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.472829 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.472785 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.472829 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.472837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.473093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.472857 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0dad01f-70d8-4cb7-a37f-899efdc0f158-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.473093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.472885 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kn68\" (UniqueName: \"kubernetes.io/projected/b0dad01f-70d8-4cb7-a37f-899efdc0f158-kube-api-access-6kn68\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.473093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.472911 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.473093 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.472956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.473327 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.473233 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.473327 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.473289 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.473327 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.473314 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.475357 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.475330 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0dad01f-70d8-4cb7-a37f-899efdc0f158-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.475624 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.475604 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0dad01f-70d8-4cb7-a37f-899efdc0f158-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.483329 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.483307 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kn68\" (UniqueName: \"kubernetes.io/projected/b0dad01f-70d8-4cb7-a37f-899efdc0f158-kube-api-access-6kn68\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh\" (UID: \"b0dad01f-70d8-4cb7-a37f-899efdc0f158\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.571385 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.571295 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:00.713192 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:00.713163 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh"] Jun 11 15:35:00.714938 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:35:00.714910 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0dad01f_70d8_4cb7_a37f_899efdc0f158.slice/crio-fb10c39460b38ae52f8c9c1fd013c0b5157278accdc7ae0ee6864b62ea2a7b4a WatchSource:0}: Error finding container fb10c39460b38ae52f8c9c1fd013c0b5157278accdc7ae0ee6864b62ea2a7b4a: Status 404 returned error can't find the container with id fb10c39460b38ae52f8c9c1fd013c0b5157278accdc7ae0ee6864b62ea2a7b4a Jun 11 15:35:01.276628 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:01.276589 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" event={"ID":"b0dad01f-70d8-4cb7-a37f-899efdc0f158","Type":"ContainerStarted","Data":"fb10c39460b38ae52f8c9c1fd013c0b5157278accdc7ae0ee6864b62ea2a7b4a"} Jun 11 15:35:05.297619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:05.297576 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" event={"ID":"b0dad01f-70d8-4cb7-a37f-899efdc0f158","Type":"ContainerStarted","Data":"3fdb4089742e239cd721f4effcd86441d0da21302c51fed77f4fb7efb2b69c8b"} Jun 11 15:35:09.315758 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:09.315722 2560 generic.go:356] "Generic (PLEG): container finished" podID="b0dad01f-70d8-4cb7-a37f-899efdc0f158" containerID="3fdb4089742e239cd721f4effcd86441d0da21302c51fed77f4fb7efb2b69c8b" exitCode=0 Jun 11 15:35:09.316115 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:09.315792 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" event={"ID":"b0dad01f-70d8-4cb7-a37f-899efdc0f158","Type":"ContainerDied","Data":"3fdb4089742e239cd721f4effcd86441d0da21302c51fed77f4fb7efb2b69c8b"} Jun 11 15:35:11.328010 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:11.327904 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" event={"ID":"b0dad01f-70d8-4cb7-a37f-899efdc0f158","Type":"ContainerStarted","Data":"f37cb8d3b6707f01047f64d27e88c9aa1ab1a53ffc399c4ed22f375f1576a24c"} Jun 11 15:35:11.350930 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:11.350878 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" podStartSLOduration=1.611734606 podStartE2EDuration="11.350863967s" totalImagesPullingTime="5.687060399s" totalInitContainerRuntime="4.052068962s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:35:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:35:11.349031285 +0000 UTC m=+1046.560221082" watchObservedRunningTime="2026-06-11 15:35:11.350863967 +0000 UTC m=+1046.562053763" Jun 11 15:35:20.571903 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:20.571864 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:20.572390 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:20.571926 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:20.584133 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:20.584103 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:21.382620 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:21.382593 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh" Jun 11 15:35:24.115510 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.115474 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx"] Jun 11 15:35:24.121963 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.121942 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.125648 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.125625 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 15:35:24.143953 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.143930 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx"] Jun 11 15:35:24.277559 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.277506 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.277559 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.277562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.277763 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.277581 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.277763 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.277640 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.277763 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.277711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9gx2\" (UniqueName: \"kubernetes.io/projected/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-kube-api-access-b9gx2\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.277763 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.277751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.378270 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.378240 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.378441 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.378276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.378441 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.378312 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.378441 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.378367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9gx2\" (UniqueName: \"kubernetes.io/projected/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-kube-api-access-b9gx2\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.378441 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.378396 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.378441 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.378426 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.378702 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.378653 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.378757 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.378712 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.378810 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.378758 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.380725 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.380696 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.380856 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.380806 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.393572 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.393544 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9gx2\" (UniqueName: \"kubernetes.io/projected/06d6b6f7-82be-4ba5-9f4f-a9ae41244d22-kube-api-access-b9gx2\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx\" (UID: \"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.433099 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.433063 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" Jun 11 15:35:24.595019 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:35:24.594971 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d6b6f7_82be_4ba5_9f4f_a9ae41244d22.slice/crio-1c7db5892317e82c522d7769fe6b746b66b31145bfa10cfeb742542a79ec664c WatchSource:0}: Error finding container 1c7db5892317e82c522d7769fe6b746b66b31145bfa10cfeb742542a79ec664c: Status 404 returned error can't find the container with id 1c7db5892317e82c522d7769fe6b746b66b31145bfa10cfeb742542a79ec664c Jun 11 15:35:24.595452 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:24.595428 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx"] Jun 11 15:35:25.392634 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:25.392596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" event={"ID":"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22","Type":"ContainerStarted","Data":"a17b7b6c67cb19ed21dad409fefeeb7622e84a74e454d8e82f934142e6774200"} Jun 11 15:35:25.393015 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:25.392661 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx" event={"ID":"06d6b6f7-82be-4ba5-9f4f-a9ae41244d22","Type":"ContainerStarted","Data":"1c7db5892317e82c522d7769fe6b746b66b31145bfa10cfeb742542a79ec664c"} Jun 11 15:35:50.445337 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.445309 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l"] Jun 11 15:35:50.465945 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.465919 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.467063 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.467036 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l"] Jun 11 15:35:50.468773 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.468749 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 15:35:50.484769 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.484735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbkvj\" (UniqueName: \"kubernetes.io/projected/5a12ee70-88d3-403c-86e7-6738761ad45d-kube-api-access-fbkvj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.484926 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.484801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.484926 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.484895 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.485050 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.484936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a12ee70-88d3-403c-86e7-6738761ad45d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.485050 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.485029 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.485128 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.485057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.586329 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.586290 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.586538 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.586335 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.586538 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.586388 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbkvj\" (UniqueName: \"kubernetes.io/projected/5a12ee70-88d3-403c-86e7-6738761ad45d-kube-api-access-fbkvj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.586538 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.586439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.586538 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.586477 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.586538 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.586502 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a12ee70-88d3-403c-86e7-6738761ad45d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.586816 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.586714 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.586816 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.586740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.586816 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.586791 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.588787 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.588761 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a12ee70-88d3-403c-86e7-6738761ad45d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.589070 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.589052 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a12ee70-88d3-403c-86e7-6738761ad45d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.596574 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.596550 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbkvj\" (UniqueName: \"kubernetes.io/projected/5a12ee70-88d3-403c-86e7-6738761ad45d-kube-api-access-fbkvj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-cn97l\" (UID: \"5a12ee70-88d3-403c-86e7-6738761ad45d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.777333 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.777241 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:35:50.912892 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:50.912864 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l"] Jun 11 15:35:50.915410 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:35:50.915382 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a12ee70_88d3_403c_86e7_6738761ad45d.slice/crio-95f8b706905eda5e49415a80bfd64441bb67570a61beb3bbc38865031ccc2a13 WatchSource:0}: Error finding container 95f8b706905eda5e49415a80bfd64441bb67570a61beb3bbc38865031ccc2a13: Status 404 returned error can't find the container with id 95f8b706905eda5e49415a80bfd64441bb67570a61beb3bbc38865031ccc2a13 Jun 11 15:35:51.511723 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:51.511688 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" event={"ID":"5a12ee70-88d3-403c-86e7-6738761ad45d","Type":"ContainerStarted","Data":"143f19f04eacd2036eb103e3bd921aaa889cc38d288cfee5d7484b9b40b8ba87"} Jun 11 15:35:51.512144 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:35:51.511742 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" event={"ID":"5a12ee70-88d3-403c-86e7-6738761ad45d","Type":"ContainerStarted","Data":"95f8b706905eda5e49415a80bfd64441bb67570a61beb3bbc38865031ccc2a13"} Jun 11 15:37:35.988473 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:35.988438 2560 generic.go:356] "Generic (PLEG): container finished" podID="5a12ee70-88d3-403c-86e7-6738761ad45d" containerID="143f19f04eacd2036eb103e3bd921aaa889cc38d288cfee5d7484b9b40b8ba87" exitCode=0 Jun 11 15:37:35.988890 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:35.988490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" event={"ID":"5a12ee70-88d3-403c-86e7-6738761ad45d","Type":"ContainerDied","Data":"143f19f04eacd2036eb103e3bd921aaa889cc38d288cfee5d7484b9b40b8ba87"} Jun 11 15:37:35.989087 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:35.989072 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:37:36.994513 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:36.994470 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" event={"ID":"5a12ee70-88d3-403c-86e7-6738761ad45d","Type":"ContainerStarted","Data":"bbc45912078b7634496b722b90d81ee47dd69255b33d63074dffb09a1bdbb97e"} Jun 11 15:37:37.022649 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:37.022603 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" podStartSLOduration=2.648692956 podStartE2EDuration="1m47.022586166s" totalImagesPullingTime="233.241611ms" totalInitContainerRuntime="1m44.140651599s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:37:37.021530992 +0000 UTC m=+1192.232720789" watchObservedRunningTime="2026-06-11 15:37:37.022586166 +0000 UTC m=+1192.233775942" Jun 11 15:37:40.778090 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:40.778052 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:37:40.778558 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:40.778130 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:37:40.790798 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:40.790765 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:37:41.023975 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:41.023946 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-cn97l" Jun 11 15:37:45.258790 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:45.258766 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:37:45.259206 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:45.258766 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:37:51.254927 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:37:51.254893 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cdf4d4b56-bw6wn"] Jun 11 15:38:16.276476 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.276410 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cdf4d4b56-bw6wn" podUID="13e2ef8d-994a-4d42-9dfa-bfeca8846254" containerName="console" containerID="cri-o://765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6" gracePeriod=15 Jun 11 15:38:16.535355 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.535067 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:38:16.623562 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.623533 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zqr7\" (UniqueName: \"kubernetes.io/projected/13e2ef8d-994a-4d42-9dfa-bfeca8846254-kube-api-access-4zqr7\") pod \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " Jun 11 15:38:16.623731 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.623600 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-trusted-ca-bundle\") pod \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " Jun 11 15:38:16.623731 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.623633 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-config\") pod \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " Jun 11 15:38:16.623731 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.623652 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-oauth-config\") pod \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " Jun 11 15:38:16.623731 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.623667 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-serving-cert\") pod \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " Jun 11 15:38:16.623731 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.623686 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-oauth-serving-cert\") pod \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " Jun 11 15:38:16.624027 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.623875 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-service-ca\") pod \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\" (UID: \"13e2ef8d-994a-4d42-9dfa-bfeca8846254\") " Jun 11 15:38:16.624194 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.624133 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-config" (OuterVolumeSpecName: "console-config") pod "13e2ef8d-994a-4d42-9dfa-bfeca8846254" (UID: "13e2ef8d-994a-4d42-9dfa-bfeca8846254"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:16.624194 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.624140 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "13e2ef8d-994a-4d42-9dfa-bfeca8846254" (UID: "13e2ef8d-994a-4d42-9dfa-bfeca8846254"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:16.624194 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.624159 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "13e2ef8d-994a-4d42-9dfa-bfeca8846254" (UID: "13e2ef8d-994a-4d42-9dfa-bfeca8846254"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:16.624722 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.624411 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-service-ca" (OuterVolumeSpecName: "service-ca") pod "13e2ef8d-994a-4d42-9dfa-bfeca8846254" (UID: "13e2ef8d-994a-4d42-9dfa-bfeca8846254"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:16.625896 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.625866 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13e2ef8d-994a-4d42-9dfa-bfeca8846254-kube-api-access-4zqr7" (OuterVolumeSpecName: "kube-api-access-4zqr7") pod "13e2ef8d-994a-4d42-9dfa-bfeca8846254" (UID: "13e2ef8d-994a-4d42-9dfa-bfeca8846254"). InnerVolumeSpecName "kube-api-access-4zqr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:38:16.626014 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.625973 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "13e2ef8d-994a-4d42-9dfa-bfeca8846254" (UID: "13e2ef8d-994a-4d42-9dfa-bfeca8846254"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:16.626107 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.626083 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "13e2ef8d-994a-4d42-9dfa-bfeca8846254" (UID: "13e2ef8d-994a-4d42-9dfa-bfeca8846254"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:16.724775 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.724748 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-config\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:38:16.724775 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.724769 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-oauth-config\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:38:16.724775 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.724779 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13e2ef8d-994a-4d42-9dfa-bfeca8846254-console-serving-cert\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:38:16.724951 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.724789 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-oauth-serving-cert\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:38:16.724951 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.724797 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-service-ca\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:38:16.724951 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.724805 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zqr7\" (UniqueName: \"kubernetes.io/projected/13e2ef8d-994a-4d42-9dfa-bfeca8846254-kube-api-access-4zqr7\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:38:16.724951 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:16.724814 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13e2ef8d-994a-4d42-9dfa-bfeca8846254-trusted-ca-bundle\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:38:17.177432 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:17.177384 2560 generic.go:356] "Generic (PLEG): container finished" podID="13e2ef8d-994a-4d42-9dfa-bfeca8846254" containerID="765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6" exitCode=0 Jun 11 15:38:17.177432 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:17.177432 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdf4d4b56-bw6wn" Jun 11 15:38:17.177636 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:17.177463 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdf4d4b56-bw6wn" event={"ID":"13e2ef8d-994a-4d42-9dfa-bfeca8846254","Type":"ContainerDied","Data":"765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6"} Jun 11 15:38:17.177636 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:17.177530 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdf4d4b56-bw6wn" event={"ID":"13e2ef8d-994a-4d42-9dfa-bfeca8846254","Type":"ContainerDied","Data":"707412454c9c6dfd5cbf134844e4b23444f79e1b118b5a16165177d2dcc55563"} Jun 11 15:38:17.177636 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:17.177552 2560 scope.go:117] "RemoveContainer" containerID="765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6" Jun 11 15:38:17.186795 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:17.186781 2560 scope.go:117] "RemoveContainer" containerID="765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6" Jun 11 15:38:17.187053 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:38:17.187034 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6\": container with ID starting with 765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6 not found: ID does not exist" containerID="765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6" Jun 11 15:38:17.187133 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:17.187060 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6"} err="failed to get container status \"765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6\": rpc error: code = NotFound desc = could not find container \"765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6\": container with ID starting with 765e4994f8e4d826c527af9719641e8c8f3f17316da6cf8fa799ac92b83e1fa6 not found: ID does not exist" Jun 11 15:38:17.200841 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:17.200813 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cdf4d4b56-bw6wn"] Jun 11 15:38:17.207883 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:17.207858 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cdf4d4b56-bw6wn"] Jun 11 15:38:17.235594 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:38:17.235569 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13e2ef8d-994a-4d42-9dfa-bfeca8846254" path="/var/lib/kubelet/pods/13e2ef8d-994a-4d42-9dfa-bfeca8846254/volumes" Jun 11 15:39:14.473288 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:14.473251 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c6f77956-7lhvm"] Jun 11 15:39:14.473775 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:14.473443 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c6f77956-7lhvm" podUID="522cc59d-a122-48fe-8935-8cc28ffe9c16" containerName="manager" containerID="cri-o://34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009" gracePeriod=30 Jun 11 15:39:14.717454 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:14.717428 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:39:14.782408 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:14.782332 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gtkd\" (UniqueName: \"kubernetes.io/projected/522cc59d-a122-48fe-8935-8cc28ffe9c16-kube-api-access-2gtkd\") pod \"522cc59d-a122-48fe-8935-8cc28ffe9c16\" (UID: \"522cc59d-a122-48fe-8935-8cc28ffe9c16\") " Jun 11 15:39:14.782535 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:14.782425 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522cc59d-a122-48fe-8935-8cc28ffe9c16-webhook-cert\") pod \"522cc59d-a122-48fe-8935-8cc28ffe9c16\" (UID: \"522cc59d-a122-48fe-8935-8cc28ffe9c16\") " Jun 11 15:39:14.784470 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:14.784437 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522cc59d-a122-48fe-8935-8cc28ffe9c16-kube-api-access-2gtkd" (OuterVolumeSpecName: "kube-api-access-2gtkd") pod "522cc59d-a122-48fe-8935-8cc28ffe9c16" (UID: "522cc59d-a122-48fe-8935-8cc28ffe9c16"). InnerVolumeSpecName "kube-api-access-2gtkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:39:14.784579 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:14.784517 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/522cc59d-a122-48fe-8935-8cc28ffe9c16-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "522cc59d-a122-48fe-8935-8cc28ffe9c16" (UID: "522cc59d-a122-48fe-8935-8cc28ffe9c16"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:39:14.883231 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:14.883201 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gtkd\" (UniqueName: \"kubernetes.io/projected/522cc59d-a122-48fe-8935-8cc28ffe9c16-kube-api-access-2gtkd\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:39:14.883231 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:14.883227 2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522cc59d-a122-48fe-8935-8cc28ffe9c16-webhook-cert\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 15:39:15.448779 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:15.448735 2560 generic.go:356] "Generic (PLEG): container finished" podID="522cc59d-a122-48fe-8935-8cc28ffe9c16" containerID="34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009" exitCode=0 Jun 11 15:39:15.448779 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:15.448778 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6f77956-7lhvm" Jun 11 15:39:15.448779 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:15.448787 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6f77956-7lhvm" event={"ID":"522cc59d-a122-48fe-8935-8cc28ffe9c16","Type":"ContainerDied","Data":"34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009"} Jun 11 15:39:15.449086 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:15.448836 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6f77956-7lhvm" event={"ID":"522cc59d-a122-48fe-8935-8cc28ffe9c16","Type":"ContainerDied","Data":"e092ea3545ead371875c33bc98d9cf3179e187234e835202324a231c29d41ddd"} Jun 11 15:39:15.449086 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:15.448861 2560 scope.go:117] "RemoveContainer" containerID="34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009" Jun 11 15:39:15.458630 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:15.458610 2560 scope.go:117] "RemoveContainer" containerID="34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009" Jun 11 15:39:15.458873 ip-10-0-131-203 kubenswrapper[2560]: E0611 15:39:15.458855 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009\": container with ID starting with 34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009 not found: ID does not exist" containerID="34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009" Jun 11 15:39:15.458933 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:15.458881 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009"} err="failed to get container status \"34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009\": rpc error: code = NotFound desc = could not find container \"34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009\": container with ID starting with 34b3b8bfb22743cc716be1d6f6c78ae3016ffbf2857fa7ba44d9c70a88581009 not found: ID does not exist" Jun 11 15:39:15.470292 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:15.470264 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c6f77956-7lhvm"] Jun 11 15:39:15.472381 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:15.472359 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c6f77956-7lhvm"] Jun 11 15:39:16.288466 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.288432 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c6f77956-8fzv6"] Jun 11 15:39:16.289015 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.288969 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e2ef8d-994a-4d42-9dfa-bfeca8846254" containerName="console" Jun 11 15:39:16.289015 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.289009 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e2ef8d-994a-4d42-9dfa-bfeca8846254" containerName="console" Jun 11 15:39:16.289192 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.289030 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="522cc59d-a122-48fe-8935-8cc28ffe9c16" containerName="manager" Jun 11 15:39:16.289192 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.289039 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="522cc59d-a122-48fe-8935-8cc28ffe9c16" containerName="manager" Jun 11 15:39:16.289192 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.289154 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="13e2ef8d-994a-4d42-9dfa-bfeca8846254" containerName="console" Jun 11 15:39:16.289192 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.289173 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="522cc59d-a122-48fe-8935-8cc28ffe9c16" containerName="manager" Jun 11 15:39:16.293311 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.293288 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6f77956-8fzv6" Jun 11 15:39:16.296697 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.296675 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 15:39:16.296817 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.296715 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 15:39:16.296817 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.296740 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2ps4h\"" Jun 11 15:39:16.301307 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.301287 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c6f77956-8fzv6"] Jun 11 15:39:16.398327 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.398288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97qgp\" (UniqueName: \"kubernetes.io/projected/4fc34a04-a9f1-466a-9352-77c75e66531a-kube-api-access-97qgp\") pod \"maas-controller-5c6f77956-8fzv6\" (UID: \"4fc34a04-a9f1-466a-9352-77c75e66531a\") " pod="opendatahub/maas-controller-5c6f77956-8fzv6" Jun 11 15:39:16.398479 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.398355 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fc34a04-a9f1-466a-9352-77c75e66531a-webhook-cert\") pod \"maas-controller-5c6f77956-8fzv6\" (UID: \"4fc34a04-a9f1-466a-9352-77c75e66531a\") " pod="opendatahub/maas-controller-5c6f77956-8fzv6" Jun 11 15:39:16.499360 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.499322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fc34a04-a9f1-466a-9352-77c75e66531a-webhook-cert\") pod \"maas-controller-5c6f77956-8fzv6\" (UID: \"4fc34a04-a9f1-466a-9352-77c75e66531a\") " pod="opendatahub/maas-controller-5c6f77956-8fzv6" Jun 11 15:39:16.499535 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.499410 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97qgp\" (UniqueName: \"kubernetes.io/projected/4fc34a04-a9f1-466a-9352-77c75e66531a-kube-api-access-97qgp\") pod \"maas-controller-5c6f77956-8fzv6\" (UID: \"4fc34a04-a9f1-466a-9352-77c75e66531a\") " pod="opendatahub/maas-controller-5c6f77956-8fzv6" Jun 11 15:39:16.501783 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.501762 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fc34a04-a9f1-466a-9352-77c75e66531a-webhook-cert\") pod \"maas-controller-5c6f77956-8fzv6\" (UID: \"4fc34a04-a9f1-466a-9352-77c75e66531a\") " pod="opendatahub/maas-controller-5c6f77956-8fzv6" Jun 11 15:39:16.510470 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.510446 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97qgp\" (UniqueName: \"kubernetes.io/projected/4fc34a04-a9f1-466a-9352-77c75e66531a-kube-api-access-97qgp\") pod \"maas-controller-5c6f77956-8fzv6\" (UID: \"4fc34a04-a9f1-466a-9352-77c75e66531a\") " pod="opendatahub/maas-controller-5c6f77956-8fzv6" Jun 11 15:39:16.605369 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.605302 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c6f77956-8fzv6" Jun 11 15:39:16.742892 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:16.742866 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c6f77956-8fzv6"] Jun 11 15:39:16.745225 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:39:16.745197 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc34a04_a9f1_466a_9352_77c75e66531a.slice/crio-357985fdfac42315650a03c80eeef54c03f0fa565842be484ecd26c5086952e7 WatchSource:0}: Error finding container 357985fdfac42315650a03c80eeef54c03f0fa565842be484ecd26c5086952e7: Status 404 returned error can't find the container with id 357985fdfac42315650a03c80eeef54c03f0fa565842be484ecd26c5086952e7 Jun 11 15:39:17.235608 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:17.235580 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="522cc59d-a122-48fe-8935-8cc28ffe9c16" path="/var/lib/kubelet/pods/522cc59d-a122-48fe-8935-8cc28ffe9c16/volumes" Jun 11 15:39:17.461258 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:17.461173 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6f77956-8fzv6" event={"ID":"4fc34a04-a9f1-466a-9352-77c75e66531a","Type":"ContainerStarted","Data":"a234e3ba350bb09a67186d8fbdc16d3084d35189fc7e18afab8ea128fccb554a"} Jun 11 15:39:17.461258 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:17.461223 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c6f77956-8fzv6" event={"ID":"4fc34a04-a9f1-466a-9352-77c75e66531a","Type":"ContainerStarted","Data":"357985fdfac42315650a03c80eeef54c03f0fa565842be484ecd26c5086952e7"} Jun 11 15:39:17.461626 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:17.461275 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c6f77956-8fzv6" Jun 11 15:39:17.480468 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:17.480425 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c6f77956-8fzv6" podStartSLOduration=1.050675519 podStartE2EDuration="1.480412345s" totalImagesPullingTime="429.736826ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:39:17.478973113 +0000 UTC m=+1292.690162911" watchObservedRunningTime="2026-06-11 15:39:17.480412345 +0000 UTC m=+1292.691602142" Jun 11 15:39:28.474753 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:39:28.474723 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c6f77956-8fzv6" Jun 11 15:42:45.285430 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:42:45.285393 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:42:45.286614 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:42:45.286593 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:47:45.311638 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:47:45.311608 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:47:45.313807 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:47:45.313784 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:52:45.338020 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:52:45.337963 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:52:45.341128 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:52:45.341106 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:57:45.365619 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:57:45.365590 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:57:45.370408 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:57:45.370383 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvsr5_3198fde8-993b-4cb9-82f3-142f563d542f/ovn-acl-logging/0.log" Jun 11 15:59:53.359156 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.359119 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s"] Jun 11 15:59:53.362537 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.362513 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.365523 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.365495 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e8b9b93f-openshift-default-dockercfg-ztcsk\"" Jun 11 15:59:53.380836 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.380812 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s"] Jun 11 15:59:53.511406 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.511370 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-data\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.511574 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.511425 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/883ff846-7038-4f98-8684-2595532a462c-istio-podinfo\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.511574 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.511451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-istio-token\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.511574 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.511504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-credential-socket\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.511728 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.511582 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/883ff846-7038-4f98-8684-2595532a462c-istiod-ca-cert\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.511728 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.511615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-envoy\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.511728 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.511642 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-socket\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.511728 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.511683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvbl8\" (UniqueName: \"kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-kube-api-access-fvbl8\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.511870 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.511729 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-certs\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.612948 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.612841 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/883ff846-7038-4f98-8684-2595532a462c-istio-podinfo\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.612948 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.612906 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-istio-token\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.612948 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.612929 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-credential-socket\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.612948 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.612953 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/883ff846-7038-4f98-8684-2595532a462c-istiod-ca-cert\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.613320 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.612973 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-envoy\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.613320 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.613007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-socket\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.613320 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.613041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbl8\" (UniqueName: \"kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-kube-api-access-fvbl8\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.613320 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.613071 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-certs\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.613320 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.613123 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-data\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.613539 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.613393 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-credential-socket\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.613539 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.613410 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-socket\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.613539 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.613510 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-data\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.613667 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.613548 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-certs\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.613853 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.613834 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/883ff846-7038-4f98-8684-2595532a462c-istiod-ca-cert\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.615506 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.615486 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-envoy\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.615615 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.615599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/883ff846-7038-4f98-8684-2595532a462c-istio-podinfo\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.622240 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.622219 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-istio-token\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.624963 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.624944 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvbl8\" (UniqueName: \"kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-kube-api-access-fvbl8\") pod \"e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.675082 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.675058 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:53.816400 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.816375 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s"] Jun 11 15:59:53.818491 ip-10-0-131-203 kubenswrapper[2560]: W0611 15:59:53.818465 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883ff846_7038_4f98_8684_2595532a462c.slice/crio-533725599d0060c79c5ccaff4df188797d15caafad883c8c07428a5784a07982 WatchSource:0}: Error finding container 533725599d0060c79c5ccaff4df188797d15caafad883c8c07428a5784a07982: Status 404 returned error can't find the container with id 533725599d0060c79c5ccaff4df188797d15caafad883c8c07428a5784a07982 Jun 11 15:59:53.820740 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.820709 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:59:53.820825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.820771 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:59:53.820825 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:53.820805 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:59:54.121854 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:54.121762 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" event={"ID":"883ff846-7038-4f98-8684-2595532a462c","Type":"ContainerStarted","Data":"e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420"} Jun 11 15:59:54.121854 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:54.121816 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" event={"ID":"883ff846-7038-4f98-8684-2595532a462c","Type":"ContainerStarted","Data":"533725599d0060c79c5ccaff4df188797d15caafad883c8c07428a5784a07982"} Jun 11 15:59:54.145057 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:54.144979 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" podStartSLOduration=1.144960211 podStartE2EDuration="1.144960211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:59:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:59:54.143336241 +0000 UTC m=+2529.354526041" watchObservedRunningTime="2026-06-11 15:59:54.144960211 +0000 UTC m=+2529.356150008" Jun 11 15:59:54.675830 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:54.675790 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:54.680651 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:54.680628 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:55.127048 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:55.127017 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:55.127922 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:55.127902 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 15:59:59.913036 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:59.912983 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s"] Jun 11 15:59:59.913481 ip-10-0-131-203 kubenswrapper[2560]: I0611 15:59:59.913221 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" podUID="883ff846-7038-4f98-8684-2595532a462c" containerName="istio-proxy" containerID="cri-o://e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420" gracePeriod=30 Jun 11 16:00:05.159568 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.159541 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 16:00:05.174901 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.174831 2560 generic.go:356] "Generic (PLEG): container finished" podID="883ff846-7038-4f98-8684-2595532a462c" containerID="e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420" exitCode=0 Jun 11 16:00:05.174901 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.174876 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" Jun 11 16:00:05.175086 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.174916 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" event={"ID":"883ff846-7038-4f98-8684-2595532a462c","Type":"ContainerDied","Data":"e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420"} Jun 11 16:00:05.175086 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.174971 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s" event={"ID":"883ff846-7038-4f98-8684-2595532a462c","Type":"ContainerDied","Data":"533725599d0060c79c5ccaff4df188797d15caafad883c8c07428a5784a07982"} Jun 11 16:00:05.175086 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.175016 2560 scope.go:117] "RemoveContainer" containerID="e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420" Jun 11 16:00:05.185118 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.185096 2560 scope.go:117] "RemoveContainer" containerID="e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420" Jun 11 16:00:05.185468 ip-10-0-131-203 kubenswrapper[2560]: E0611 16:00:05.185444 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420\": container with ID starting with e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420 not found: ID does not exist" containerID="e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420" Jun 11 16:00:05.185560 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.185481 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420"} err="failed to get container status \"e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420\": rpc error: code = NotFound desc = could not find container \"e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420\": container with ID starting with e124833cae2514bc1d73a1a7f887f1c45fd36f8dae532b5ac3e360c0b6e28420 not found: ID does not exist" Jun 11 16:00:05.198211 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198188 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-data\") pod \"883ff846-7038-4f98-8684-2595532a462c\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " Jun 11 16:00:05.198342 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198219 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-certs\") pod \"883ff846-7038-4f98-8684-2595532a462c\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " Jun 11 16:00:05.198342 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198248 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-credential-socket\") pod \"883ff846-7038-4f98-8684-2595532a462c\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " Jun 11 16:00:05.198342 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198271 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/883ff846-7038-4f98-8684-2595532a462c-istio-podinfo\") pod \"883ff846-7038-4f98-8684-2595532a462c\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " Jun 11 16:00:05.198342 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198286 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-envoy\") pod \"883ff846-7038-4f98-8684-2595532a462c\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " Jun 11 16:00:05.198342 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198321 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-socket\") pod \"883ff846-7038-4f98-8684-2595532a462c\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " Jun 11 16:00:05.198599 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198369 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-istio-token\") pod \"883ff846-7038-4f98-8684-2595532a462c\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " Jun 11 16:00:05.198599 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198407 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/883ff846-7038-4f98-8684-2595532a462c-istiod-ca-cert\") pod \"883ff846-7038-4f98-8684-2595532a462c\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " Jun 11 16:00:05.198599 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198436 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvbl8\" (UniqueName: \"kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-kube-api-access-fvbl8\") pod \"883ff846-7038-4f98-8684-2595532a462c\" (UID: \"883ff846-7038-4f98-8684-2595532a462c\") " Jun 11 16:00:05.198599 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198446 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-data" (OuterVolumeSpecName: "istio-data") pod "883ff846-7038-4f98-8684-2595532a462c" (UID: "883ff846-7038-4f98-8684-2595532a462c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:00:05.198795 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198610 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "883ff846-7038-4f98-8684-2595532a462c" (UID: "883ff846-7038-4f98-8684-2595532a462c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:00:05.198795 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198708 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-data\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:05.198795 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198726 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-credential-socket\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:05.198949 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198806 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "883ff846-7038-4f98-8684-2595532a462c" (UID: "883ff846-7038-4f98-8684-2595532a462c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:00:05.198949 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198890 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "883ff846-7038-4f98-8684-2595532a462c" (UID: "883ff846-7038-4f98-8684-2595532a462c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:00:05.198949 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.198893 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/883ff846-7038-4f98-8684-2595532a462c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "883ff846-7038-4f98-8684-2595532a462c" (UID: "883ff846-7038-4f98-8684-2595532a462c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:00:05.200883 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.200852 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "883ff846-7038-4f98-8684-2595532a462c" (UID: "883ff846-7038-4f98-8684-2595532a462c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:00:05.200973 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.200883 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/883ff846-7038-4f98-8684-2595532a462c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "883ff846-7038-4f98-8684-2595532a462c" (UID: "883ff846-7038-4f98-8684-2595532a462c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 16:00:05.201041 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.200966 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-istio-token" (OuterVolumeSpecName: "istio-token") pod "883ff846-7038-4f98-8684-2595532a462c" (UID: "883ff846-7038-4f98-8684-2595532a462c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:00:05.201142 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.201120 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-kube-api-access-fvbl8" (OuterVolumeSpecName: "kube-api-access-fvbl8") pod "883ff846-7038-4f98-8684-2595532a462c" (UID: "883ff846-7038-4f98-8684-2595532a462c"). InnerVolumeSpecName "kube-api-access-fvbl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:00:05.299404 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.299368 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-istio-token\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:05.299545 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.299431 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/883ff846-7038-4f98-8684-2595532a462c-istiod-ca-cert\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:05.299545 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.299476 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvbl8\" (UniqueName: \"kubernetes.io/projected/883ff846-7038-4f98-8684-2595532a462c-kube-api-access-fvbl8\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:05.299628 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.299553 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-certs\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:05.299628 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.299585 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/883ff846-7038-4f98-8684-2595532a462c-istio-podinfo\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:05.299628 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.299601 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-istio-envoy\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:05.299628 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.299623 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/883ff846-7038-4f98-8684-2595532a462c-workload-socket\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:05.496413 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.496335 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s"] Jun 11 16:00:05.499801 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:05.499778 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e8b9b93f-openshift-default-7dc9ff8ccd-j988s"] Jun 11 16:00:07.147455 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.147416 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b"] Jun 11 16:00:07.148051 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.148030 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ff846-7038-4f98-8684-2595532a462c" containerName="istio-proxy" Jun 11 16:00:07.148051 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.148052 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ff846-7038-4f98-8684-2595532a462c" containerName="istio-proxy" Jun 11 16:00:07.148202 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.148157 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ff846-7038-4f98-8684-2595532a462c" containerName="istio-proxy" Jun 11 16:00:07.151382 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.151361 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.153851 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.153824 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4ca9c151-openshift-default-dockercfg-ts5r9\"" Jun 11 16:00:07.163329 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.163306 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b"] Jun 11 16:00:07.215851 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.215815 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-envoy\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.216032 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.215854 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-socket\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.216032 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.215920 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istiod-ca-cert\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.216032 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.215973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-credential-socket\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.216032 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.216016 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-token\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.216169 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.216057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-data\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.216169 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.216085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-podinfo\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.216169 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.216123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-certs\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.216169 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.216156 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpbvb\" (UniqueName: \"kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-kube-api-access-qpbvb\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.236067 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.236037 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="883ff846-7038-4f98-8684-2595532a462c" path="/var/lib/kubelet/pods/883ff846-7038-4f98-8684-2595532a462c/volumes" Jun 11 16:00:07.316845 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.316808 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-envoy\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.316845 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.316851 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-socket\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317113 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.316881 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istiod-ca-cert\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317113 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.316913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-credential-socket\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317113 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.316929 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-token\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317113 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.316951 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-data\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317113 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.316976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-podinfo\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317113 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.317033 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-certs\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317113 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.317085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpbvb\" (UniqueName: \"kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-kube-api-access-qpbvb\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317425 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.317388 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-socket\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317562 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.317540 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-data\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317633 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.317567 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-certs\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.317633 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.317598 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-credential-socket\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.318087 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.318063 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istiod-ca-cert\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.319522 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.319499 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-envoy\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.319675 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.319658 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-podinfo\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.330302 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.330273 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-token\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.330724 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.330699 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpbvb\" (UniqueName: \"kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-kube-api-access-qpbvb\") pod \"e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.462764 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.462681 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:07.607404 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.607378 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b"] Jun 11 16:00:07.609605 ip-10-0-131-203 kubenswrapper[2560]: W0611 16:00:07.609577 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291d4b60_c7a3_4ebf_aab3_7f1a7b9b9f60.slice/crio-355de34c99088efa458f94addd0b2a257467702e2e333c724ec1bbd2e9dabfdd WatchSource:0}: Error finding container 355de34c99088efa458f94addd0b2a257467702e2e333c724ec1bbd2e9dabfdd: Status 404 returned error can't find the container with id 355de34c99088efa458f94addd0b2a257467702e2e333c724ec1bbd2e9dabfdd Jun 11 16:00:07.611543 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.611514 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:00:07.611598 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.611578 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:00:07.611643 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:07.611604 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 16:00:08.191155 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:08.191115 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" event={"ID":"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60","Type":"ContainerStarted","Data":"2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48"} Jun 11 16:00:08.191496 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:08.191174 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" event={"ID":"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60","Type":"ContainerStarted","Data":"355de34c99088efa458f94addd0b2a257467702e2e333c724ec1bbd2e9dabfdd"} Jun 11 16:00:08.220536 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:08.220488 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" podStartSLOduration=1.220473538 podStartE2EDuration="1.220473538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:00:08.218914937 +0000 UTC m=+2543.430104735" watchObservedRunningTime="2026-06-11 16:00:08.220473538 +0000 UTC m=+2543.431663335" Jun 11 16:00:08.463488 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:08.463388 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:08.468872 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:08.468848 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:09.195802 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:09.195772 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:09.196852 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:09.196837 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:14.718828 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:14.718790 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b"] Jun 11 16:00:14.719281 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:14.719004 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" podUID="291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" containerName="istio-proxy" containerID="cri-o://2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48" gracePeriod=30 Jun 11 16:00:19.975138 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:19.975099 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:20.015810 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.015738 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istiod-ca-cert\") pod \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " Jun 11 16:00:20.015810 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.015795 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-socket\") pod \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " Jun 11 16:00:20.016058 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.015821 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-token\") pod \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " Jun 11 16:00:20.016058 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.015851 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-envoy\") pod \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " Jun 11 16:00:20.016058 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.015877 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-certs\") pod \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " Jun 11 16:00:20.016058 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.015945 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-podinfo\") pod \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " Jun 11 16:00:20.016058 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.016010 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-credential-socket\") pod \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " Jun 11 16:00:20.016058 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.016036 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-data\") pod \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " Jun 11 16:00:20.016346 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.016071 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpbvb\" (UniqueName: \"kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-kube-api-access-qpbvb\") pod \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\" (UID: \"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60\") " Jun 11 16:00:20.016346 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.016215 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" (UID: "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:00:20.016346 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.016258 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" (UID: "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:00:20.016506 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.016380 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-certs\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:20.016506 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.016178 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" (UID: "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:00:20.016506 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.016431 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" (UID: "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:00:20.016506 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.016452 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-data" (OuterVolumeSpecName: "istio-data") pod "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" (UID: "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:00:20.016506 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.016436 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-credential-socket\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:20.018359 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.018329 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" (UID: "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:00:20.018731 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.018711 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" (UID: "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 16:00:20.018795 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.018771 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-token" (OuterVolumeSpecName: "istio-token") pod "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" (UID: "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:00:20.018883 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.018866 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-kube-api-access-qpbvb" (OuterVolumeSpecName: "kube-api-access-qpbvb") pod "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" (UID: "291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60"). InnerVolumeSpecName "kube-api-access-qpbvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:00:20.117355 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.117318 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-podinfo\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:20.117355 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.117347 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-data\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:20.117355 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.117356 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpbvb\" (UniqueName: \"kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-kube-api-access-qpbvb\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:20.117565 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.117365 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istiod-ca-cert\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:20.117565 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.117376 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-workload-socket\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:20.117565 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.117384 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-token\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:20.117565 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.117393 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60-istio-envoy\") on node \"ip-10-0-131-203.ec2.internal\" DevicePath \"\"" Jun 11 16:00:20.251118 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.251075 2560 generic.go:356] "Generic (PLEG): container finished" podID="291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" containerID="2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48" exitCode=0 Jun 11 16:00:20.251284 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.251135 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" Jun 11 16:00:20.251284 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.251156 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" event={"ID":"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60","Type":"ContainerDied","Data":"2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48"} Jun 11 16:00:20.251284 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.251214 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b" event={"ID":"291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60","Type":"ContainerDied","Data":"355de34c99088efa458f94addd0b2a257467702e2e333c724ec1bbd2e9dabfdd"} Jun 11 16:00:20.251284 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.251235 2560 scope.go:117] "RemoveContainer" containerID="2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48" Jun 11 16:00:20.260412 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.260389 2560 scope.go:117] "RemoveContainer" containerID="2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48" Jun 11 16:00:20.260697 ip-10-0-131-203 kubenswrapper[2560]: E0611 16:00:20.260676 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48\": container with ID starting with 2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48 not found: ID does not exist" containerID="2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48" Jun 11 16:00:20.260763 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.260705 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48"} err="failed to get container status \"2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48\": rpc error: code = NotFound desc = could not find container \"2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48\": container with ID starting with 2c021e93f4a5a0bae6d559e611888f94ffaaab08bf3b3ada5c89d9dcc8036a48 not found: ID does not exist" Jun 11 16:00:20.281876 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.281800 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b"] Jun 11 16:00:20.292553 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:20.292528 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4ca9c151-openshift-default-f8b6f44cb-s6j4b"] Jun 11 16:00:21.235126 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:21.235087 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" path="/var/lib/kubelet/pods/291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60/volumes" Jun 11 16:00:32.834527 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:32.834493 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-65d958f89-x45p7_a51beed3-5271-4a7a-84e8-4e3db12767c1/nginx/0.log" Jun 11 16:00:33.218932 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:33.218902 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-765b8cfdc5-7jwkk_3778c1df-64ca-4546-bc6e-5d905f09b9ce/maas-api/0.log" Jun 11 16:00:33.606830 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:33.606754 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c6f77956-8fzv6_4fc34a04-a9f1-466a-9352-77c75e66531a/manager/0.log" Jun 11 16:00:34.267332 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:34.267303 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf4ff8955-wgjn9_dc70ea5e-028f-4a18-bfda-fbfb1d41215d/copy-manifests/0.log" Jun 11 16:00:34.279706 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:34.279678 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf4ff8955-wgjn9_dc70ea5e-028f-4a18-bfda-fbfb1d41215d/manager/0.log" Jun 11 16:00:35.882094 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:35.882063 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-r9pjw_b2e93fcb-61e2-4e2d-9615-809b68ff11f9/manager/0.log" Jun 11 16:00:35.998147 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:35.998115 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bpf7b_8d56662d-d7c7-448b-af2a-205b58840348/manager/0.log" Jun 11 16:00:36.109012 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:36.108965 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rlhhb_0e286d93-4c87-438f-aad7-03e0f937afa2/kuadrant-console-plugin/0.log" Jun 11 16:00:36.233924 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:36.233841 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xffc5_57ccef89-f423-4003-b986-44f921352de6/registry-server/0.log" Jun 11 16:00:36.601371 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:36.601298 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-742gf_5dfde31f-a4e4-4e6a-b4d2-f40bd3cdf427/manager/0.log" Jun 11 16:00:36.956885 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:36.956853 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kqsst_56b6760e-4bf9-405e-a67e-ddc5d88e7a15/istio-proxy/0.log" Jun 11 16:00:37.566511 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:37.566483 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-64gt5_4d5e2d27-7cf1-4755-9d41-f155106be6db/payload-pre-processing/0.log" Jun 11 16:00:37.692268 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:37.692238 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-798lh_a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2/payload-processing/0.log" Jun 11 16:00:38.168140 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:38.168110 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh_b0dad01f-70d8-4cb7-a37f-899efdc0f158/storage-initializer/0.log" Jun 11 16:00:38.175937 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:38.175921 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-lxlzh_b0dad01f-70d8-4cb7-a37f-899efdc0f158/main/0.log" Jun 11 16:00:38.425978 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:38.425903 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vnwgx_06d6b6f7-82be-4ba5-9f4f-a9ae41244d22/storage-initializer/0.log" Jun 11 16:00:38.682677 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:38.682595 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-cn97l_5a12ee70-88d3-403c-86e7-6738761ad45d/storage-initializer/0.log" Jun 11 16:00:38.690051 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:38.690020 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-cn97l_5a12ee70-88d3-403c-86e7-6738761ad45d/main/0.log" Jun 11 16:00:47.655469 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:47.655435 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cw7jd_5bf6c2b6-01c8-4995-9f22-350ed453fd06/global-pull-secret-syncer/0.log" Jun 11 16:00:47.861763 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:47.861733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r96qj_59c700d7-40aa-4758-8642-50c7f6efee9a/konnectivity-agent/0.log" Jun 11 16:00:47.913273 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:47.913192 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-203.ec2.internal_c6bb98369c1cbcd0b4b0ea517d85aa9e/haproxy/0.log" Jun 11 16:00:53.630587 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:53.630512 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-r9pjw_b2e93fcb-61e2-4e2d-9615-809b68ff11f9/manager/0.log" Jun 11 16:00:53.676432 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:53.676404 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bpf7b_8d56662d-d7c7-448b-af2a-205b58840348/manager/0.log" Jun 11 16:00:53.705393 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:53.705367 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rlhhb_0e286d93-4c87-438f-aad7-03e0f937afa2/kuadrant-console-plugin/0.log" Jun 11 16:00:53.750744 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:53.750713 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xffc5_57ccef89-f423-4003-b986-44f921352de6/registry-server/0.log" Jun 11 16:00:53.959863 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:53.959793 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-742gf_5dfde31f-a4e4-4e6a-b4d2-f40bd3cdf427/manager/0.log" Jun 11 16:00:56.037547 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:56.037466 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-scnc4_f2d4b856-4ff8-4066-b807-8b9728a3d227/monitoring-plugin/0.log" Jun 11 16:00:56.156922 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:56.156890 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrxqq_bc716dcd-ff09-455b-b2a8-73809d3ca6f1/node-exporter/0.log" Jun 11 16:00:56.185945 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:56.185919 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrxqq_bc716dcd-ff09-455b-b2a8-73809d3ca6f1/kube-rbac-proxy/0.log" Jun 11 16:00:56.212105 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:56.212077 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrxqq_bc716dcd-ff09-455b-b2a8-73809d3ca6f1/init-textfile/0.log" Jun 11 16:00:56.346929 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:56.346856 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ggjrf_14091220-37dd-4abf-a2be-67f6abd54b64/kube-rbac-proxy-main/0.log" Jun 11 16:00:56.373162 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:56.373130 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ggjrf_14091220-37dd-4abf-a2be-67f6abd54b64/kube-rbac-proxy-self/0.log" Jun 11 16:00:56.397942 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:56.397918 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ggjrf_14091220-37dd-4abf-a2be-67f6abd54b64/openshift-state-metrics/0.log" Jun 11 16:00:59.054528 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.054495 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn"] Jun 11 16:00:59.054922 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.054838 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" containerName="istio-proxy" Jun 11 16:00:59.054922 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.054848 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" containerName="istio-proxy" Jun 11 16:00:59.055020 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.054928 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="291d4b60-c7a3-4ebf-aab3-7f1a7b9b9f60" containerName="istio-proxy" Jun 11 16:00:59.059153 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.059137 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.061968 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.061945 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z99v2\"/\"kube-root-ca.crt\"" Jun 11 16:00:59.062741 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.062720 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z99v2\"/\"openshift-service-ca.crt\"" Jun 11 16:00:59.062835 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.062722 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z99v2\"/\"default-dockercfg-5d86z\"" Jun 11 16:00:59.066016 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.065968 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn"] Jun 11 16:00:59.142162 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.142131 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-proc\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.142329 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.142167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-podres\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.142329 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.142201 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-sys\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.142329 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.142218 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-lib-modules\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.142329 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.142262 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zc7c\" (UniqueName: \"kubernetes.io/projected/a6421bc2-ec9e-4821-a626-4dafa043fcf7-kube-api-access-6zc7c\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.242882 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.242851 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-proc\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.243070 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.242891 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-podres\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.243070 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.242926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-sys\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.243070 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.242941 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-lib-modules\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.243070 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.242960 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zc7c\" (UniqueName: \"kubernetes.io/projected/a6421bc2-ec9e-4821-a626-4dafa043fcf7-kube-api-access-6zc7c\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.243070 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.242976 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-proc\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.243070 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.243050 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-sys\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.243302 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.243095 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-lib-modules\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.243302 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.243107 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6421bc2-ec9e-4821-a626-4dafa043fcf7-podres\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.252174 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.252153 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zc7c\" (UniqueName: \"kubernetes.io/projected/a6421bc2-ec9e-4821-a626-4dafa043fcf7-kube-api-access-6zc7c\") pod \"perf-node-gather-daemonset-9zttn\" (UID: \"a6421bc2-ec9e-4821-a626-4dafa043fcf7\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.369384 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.369358 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:00:59.500208 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:00:59.500135 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn"] Jun 11 16:00:59.503183 ip-10-0-131-203 kubenswrapper[2560]: W0611 16:00:59.503148 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda6421bc2_ec9e_4821_a626_4dafa043fcf7.slice/crio-ecbf8f853af3df7151104f62cfde724c3765e311b003f3a765b89d239b1cf647 WatchSource:0}: Error finding container ecbf8f853af3df7151104f62cfde724c3765e311b003f3a765b89d239b1cf647: Status 404 returned error can't find the container with id ecbf8f853af3df7151104f62cfde724c3765e311b003f3a765b89d239b1cf647 Jun 11 16:01:00.440706 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:00.440669 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" event={"ID":"a6421bc2-ec9e-4821-a626-4dafa043fcf7","Type":"ContainerStarted","Data":"319906b6c4f44a8be9e88681423855d93ed5e7e7eb4f4a745ae886e1dd6be299"} Jun 11 16:01:00.441097 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:00.440719 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" event={"ID":"a6421bc2-ec9e-4821-a626-4dafa043fcf7","Type":"ContainerStarted","Data":"ecbf8f853af3df7151104f62cfde724c3765e311b003f3a765b89d239b1cf647"} Jun 11 16:01:00.441097 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:00.440799 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:01:00.459839 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:00.459775 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" podStartSLOduration=1.459760075 podStartE2EDuration="1.459760075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:01:00.459093433 +0000 UTC m=+2595.670283231" watchObservedRunningTime="2026-06-11 16:01:00.459760075 +0000 UTC m=+2595.670949872" Jun 11 16:01:01.328594 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:01.328560 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4795t_9ad166b7-8da6-4903-8756-21e2d6f7826d/dns/0.log" Jun 11 16:01:01.357584 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:01.357554 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4795t_9ad166b7-8da6-4903-8756-21e2d6f7826d/kube-rbac-proxy/0.log" Jun 11 16:01:01.541045 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:01.541015 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tw7qk_546a5e49-90ce-450d-98ab-e223385e4e39/dns-node-resolver/0.log" Jun 11 16:01:02.210572 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:02.210547 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-shj99_ec312546-eabd-4bf5-b4fa-107a6791ec0a/node-ca/0.log" Jun 11 16:01:03.241772 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:03.241742 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kqsst_56b6760e-4bf9-405e-a67e-ddc5d88e7a15/istio-proxy/0.log" Jun 11 16:01:03.542212 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:03.542133 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-64gt5_4d5e2d27-7cf1-4755-9d41-f155106be6db/payload-pre-processing/0.log" Jun 11 16:01:03.604967 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:03.604935 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-798lh_a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2/payload-processing/0.log" Jun 11 16:01:04.311045 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:04.311011 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbrzr_bb67107c-8286-416d-9c14-cddc1cab5eee/serve-healthcheck-canary/0.log" Jun 11 16:01:05.013644 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:05.013613 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9bzw_3f37afe7-ad2e-4ead-b228-a622981ac108/kube-rbac-proxy/0.log" Jun 11 16:01:05.036899 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:05.036870 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9bzw_3f37afe7-ad2e-4ead-b228-a622981ac108/exporter/0.log" Jun 11 16:01:05.060077 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:05.060050 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9bzw_3f37afe7-ad2e-4ead-b228-a622981ac108/extractor/0.log" Jun 11 16:01:06.455171 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:06.455147 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-9zttn" Jun 11 16:01:07.414297 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:07.414262 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-65d958f89-x45p7_a51beed3-5271-4a7a-84e8-4e3db12767c1/nginx/0.log" Jun 11 16:01:07.615426 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:07.615396 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-765b8cfdc5-7jwkk_3778c1df-64ca-4546-bc6e-5d905f09b9ce/maas-api/0.log" Jun 11 16:01:07.736666 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:07.736580 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c6f77956-8fzv6_4fc34a04-a9f1-466a-9352-77c75e66531a/manager/0.log" Jun 11 16:01:08.128247 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:08.128220 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf4ff8955-wgjn9_dc70ea5e-028f-4a18-bfda-fbfb1d41215d/manager/0.log" Jun 11 16:01:08.154021 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:08.153973 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf4ff8955-wgjn9_dc70ea5e-028f-4a18-bfda-fbfb1d41215d/copy-manifests/0.log" Jun 11 16:01:10.038649 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:10.038615 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c548d559f-v9kng_494220ab-7755-4ef9-91c1-fbfbac761489/manager/0.log" Jun 11 16:01:12.394654 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:12.394604 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kqsst_56b6760e-4bf9-405e-a67e-ddc5d88e7a15/istio-proxy/0.log" Jun 11 16:01:12.639156 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:12.639130 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-64gt5_4d5e2d27-7cf1-4755-9d41-f155106be6db/payload-pre-processing/0.log" Jun 11 16:01:12.692449 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:12.692369 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-798lh_a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2/payload-processing/0.log" Jun 11 16:01:13.846279 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:13.846251 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kqsst_56b6760e-4bf9-405e-a67e-ddc5d88e7a15/istio-proxy/0.log" Jun 11 16:01:14.107570 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:14.107487 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-64gt5_4d5e2d27-7cf1-4755-9d41-f155106be6db/payload-pre-processing/0.log" Jun 11 16:01:14.162269 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:14.162241 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-798lh_a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2/payload-processing/0.log" Jun 11 16:01:15.957436 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:15.957397 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kqsst_56b6760e-4bf9-405e-a67e-ddc5d88e7a15/istio-proxy/0.log" Jun 11 16:01:16.202708 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:16.202674 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-64gt5_4d5e2d27-7cf1-4755-9d41-f155106be6db/payload-pre-processing/0.log" Jun 11 16:01:16.253026 ip-10-0-131-203 kubenswrapper[2560]: I0611 16:01:16.252940 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-798lh_a7c49e4b-c6e4-4133-a8c8-e4eeae913cd2/payload-processing/0.log"